python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1071264 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2655802'] with mtr_portfolio_ids : ['21243482'] and first list_photo_ids : [] new path : /proc/1071264/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.20173072814941406 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 10 22:20:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10149 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 22:20:36.665126: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 22:20:36.691093: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 22:20:36.693341: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2468000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 22:20:36.693392: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 22:20:36.697994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 22:20:36.982745: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x316be7e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 22:20:36.982930: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 22:20:36.984937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 22:20:36.985425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 22:20:36.988515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 22:20:37.002783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 22:20:37.003249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 22:20:37.031843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 22:20:37.037583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 22:20:37.087995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 22:20:37.091436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 22:20:37.091879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 22:20:37.093588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 22:20:37.093610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 22:20:37.093623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 22:20:37.097347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9256 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 22:20:37.418445: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 22:20:37.418521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 22:20:37.418541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 22:20:37.418559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 22:20:37.418576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 22:20:37.418592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 22:20:37.418608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 22:20:37.418625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 22:20:37.421191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 22:20:37.422575: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 22:20:37.422631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 22:20:37.422649: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 22:20:37.422664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 22:20:37.422678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 22:20:37.422692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 22:20:37.422706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 22:20:37.422721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 22:20:37.424932: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 22:20:37.424993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 22:20:37.425009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 22:20:37.425019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 22:20:37.427598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9256 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 22:20:47.040663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 22:20:47.323391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.63750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 615 time to create 1 rle with old method : 0.0012521743774414062 length of segment : 43 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 6 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.001819610595703125 length of segment : 36 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 4348 time to create 1 rle with old method : 0.00794219970703125 length of segment : 63 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0008158683776855469 length of segment : 24 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0006837844848632812 length of segment : 22 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0018477439880371094 length of segment : 33 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1504 time to create 1 rle with old method : 0.0019481182098388672 length of segment : 70 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.001444101333618164 length of segment : 58 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1408 time to create 1 rle with old method : 0.0020360946655273438 length of segment : 79 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 1960 time to create 1 rle with old method : 0.002974271774291992 length of segment : 90 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0012176036834716797 length of segment : 62 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1591 time to create 1 rle with old method : 0.002146005630493164 length of segment : 47 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 2656 time to create 1 rle with old method : 0.003878355026245117 length of segment : 76 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0033295154571533203 length of segment : 71 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005803108215332031 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005044937133789062 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.78594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006742477416992188 length of segment : 37 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1410 time to create 1 rle with old method : 0.002184152603149414 length of segment : 34 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1776 time to create 1 rle with old method : 0.002729177474975586 length of segment : 62 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 2175 time to create 1 rle with old method : 0.003188610076904297 length of segment : 58 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0008406639099121094 length of segment : 26 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 23 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1949 time to create 1 rle with old method : 0.0025720596313476562 length of segment : 50 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 4230 time to create 1 rle with old method : 0.005661964416503906 length of segment : 75 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0017104148864746094 length of segment : 59 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007655620574951172 length of segment : 22 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.000244140625 length of segment : 14 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0015339851379394531 length of segment : 48 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0004067420959472656 length of segment : 17 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 2686 time to create 1 rle with old method : 0.004357814788818359 length of segment : 109 time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 1982 time to create 1 rle with old method : 0.003081798553466797 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.03984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 2807 time to create 1 rle with old method : 0.0035848617553710938 length of segment : 50 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0017938613891601562 length of segment : 46 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0016040802001953125 length of segment : 41 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0019075870513916016 length of segment : 62 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 39 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00041174888610839844 length of segment : 16 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 20 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.001360177993774414 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 22 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1930 time to create 1 rle with old method : 0.002629518508911133 length of segment : 84 time for calcul the mask position with numpy : 0.0001468658447265625 nb_pixel_total : 4144 time to create 1 rle with old method : 0.005052804946899414 length of segment : 117 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004649162292480469 length of segment : 20 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00039196014404296875 length of segment : 16 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0008983612060546875 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.000461578369140625 length of segment : 31 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 17 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008971691131591797 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.47734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0022406578063964844 length of segment : 34 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 2485 time to create 1 rle with old method : 0.0038275718688964844 length of segment : 62 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1087 time to create 1 rle with old method : 0.001795053482055664 length of segment : 46 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 2297 time to create 1 rle with old method : 0.00765228271484375 length of segment : 53 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0021436214447021484 length of segment : 39 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 3354 time to create 1 rle with old method : 0.005226612091064453 length of segment : 69 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0025119781494140625 length of segment : 31 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.001055002212524414 length of segment : 42 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 2334 time to create 1 rle with old method : 0.003440380096435547 length of segment : 56 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0007884502410888672 length of segment : 23 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0011417865753173828 length of segment : 32 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0006315708160400391 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 96.00000 max: 170.00000 molded_images shape: (1, 640, 640, 3) min: -27.70000 max: 62.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.57500 max: 145.19766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0008432865142822266 length of segment : 31 time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 1135 time to create 1 rle with old method : 0.0017130374908447266 length of segment : 88 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 3594 time to create 1 rle with old method : 0.00553584098815918 length of segment : 78 time for calcul the mask position with numpy : 0.0001628398895263672 nb_pixel_total : 3580 time to create 1 rle with old method : 0.006115436553955078 length of segment : 75 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 327 time to create 1 rle with old method : 0.0007066726684570312 length of segment : 50 time for calcul the mask position with numpy : 0.0007255077362060547 nb_pixel_total : 15300 time to create 1 rle with old method : 0.036191701889038086 length of segment : 276 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 14305 time to create 1 rle with old method : 0.020461320877075195 length of segment : 325 Processing 1 images image shape: (400, 160, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004417896270751953 nb_pixel_total : 32922 time to create 1 rle with old method : 0.03875851631164551 length of segment : 586 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2845 time to create 1 rle with old method : 0.0034058094024658203 length of segment : 122 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0014524459838867188 length of segment : 54 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005331039428710938 length of segment : 21 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1251 time to create 1 rle with old method : 0.0016055107116699219 length of segment : 61 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008060932159423828 length of segment : 45 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0018055438995361328 length of segment : 106 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002753734588623047 length of segment : 22 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0008525848388671875 length of segment : 25 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 16 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00042557716369628906 length of segment : 18 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005791187286376953 length of segment : 35 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 35 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006535053253173828 length of segment : 27 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011897087097167969 length of segment : 10 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1001 time to create 1 rle with old method : 0.0014281272888183594 length of segment : 72 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006518363952636719 length of segment : 26 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0008375644683837891 length of segment : 21 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0018544197082519531 length of segment : 94 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.86797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 1273 time to create 1 rle with old method : 0.0015935897827148438 length of segment : 53 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 2199 time to create 1 rle with old method : 0.0028820037841796875 length of segment : 36 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00048804283142089844 length of segment : 17 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.0012240409851074219 length of segment : 63 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0011181831359863281 length of segment : 39 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004267692565917969 length of segment : 20 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 39 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 2301 time to create 1 rle with old method : 0.002909421920776367 length of segment : 63 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.00048041343688964844 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002377033233642578 length of segment : 21 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 11 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006814002990722656 length of segment : 23 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.0003554821014404297 length of segment : 6 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.0017998218536376953 length of segment : 41 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0006413459777832031 length of segment : 23 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 2266 time to create 1 rle with old method : 0.004105806350708008 length of segment : 44 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0010883808135986328 length of segment : 28 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0006000995635986328 length of segment : 22 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.001161336898803711 length of segment : 20 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 2008 time to create 1 rle with old method : 0.0035810470581054688 length of segment : 76 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0015101432800292969 length of segment : 33 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0012793540954589844 length of segment : 23 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 15 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0010707378387451172 length of segment : 28 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00027298927307128906 length of segment : 17 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 1990 time to create 1 rle with old method : 0.003103017807006836 length of segment : 80 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006458759307861328 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.97734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 28 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0015828609466552734 length of segment : 80 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 21 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006191730499267578 length of segment : 25 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 11 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0017495155334472656 length of segment : 59 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00025153160095214844 length of segment : 16 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2036 time to create 1 rle with old method : 0.0027017593383789062 length of segment : 87 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005996227264404297 length of segment : 20 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0010886192321777344 length of segment : 27 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001728534698486328 length of segment : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 30 time to create 1 rle with old method : 0.00017189979553222656 length of segment : 15 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 13 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2342 time to create 1 rle with old method : 0.0029861927032470703 length of segment : 64 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0004048347473144531 length of segment : 12 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 17 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 2169 time to create 1 rle with old method : 0.002766132354736328 length of segment : 51 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 2615 time to create 1 rle with old method : 0.003137826919555664 length of segment : 99 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 4497 time to create 1 rle with old method : 0.005524158477783203 length of segment : 87 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0003056526184082031 length of segment : 12 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0016531944274902344 length of segment : 56 time for calcul the mask position with numpy : 0.00013566017150878906 nb_pixel_total : 2889 time to create 1 rle with old method : 0.003382444381713867 length of segment : 106 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004715919494628906 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 21 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004673004150390625 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 22 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1508 time to create 1 rle with old method : 0.0017864704132080078 length of segment : 60 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006802082061767578 length of segment : 49 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 4630 time to create 1 rle with old method : 0.005380392074584961 length of segment : 100 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.89531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0007841587066650391 length of segment : 16 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.002057313919067383 length of segment : 41 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006024837493896484 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 112.00000 max: 168.00000 molded_images shape: (1, 640, 640, 3) min: -11.70000 max: 56.86172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.79844 max: 150.60781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1184 time to create 1 rle with old method : 0.0022902488708496094 length of segment : 77 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1112 time to create 1 rle with old method : 0.0017161369323730469 length of segment : 70 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014209747314453125 length of segment : 11 Processing 1 images image shape: (400, 160, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025272369384765625 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.45391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006577968597412109 length of segment : 32 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0016720294952392578 length of segment : 57 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 3835 time to create 1 rle with old method : 0.004896402359008789 length of segment : 102 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004105567932128906 length of segment : 21 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004241466522216797 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.50859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 945 time to create 1 rle with old method : 0.0014848709106445312 length of segment : 36 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017545223236083984 length of segment : 63 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 2567 time to create 1 rle with old method : 0.0032072067260742188 length of segment : 86 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 27 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 17 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 19 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0015797615051269531 length of segment : 59 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 21 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0023641586303710938 length of segment : 51 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008504390716552734 length of segment : 38 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 30 time to create 1 rle with old method : 7.605552673339844e-05 length of segment : 8 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2986 time to create 1 rle with old method : 0.0036475658416748047 length of segment : 97 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1823 time to create 1 rle with old method : 0.0023446083068847656 length of segment : 60 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 27 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1690 time to create 1 rle with old method : 0.002087116241455078 length of segment : 77 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005292892456054688 length of segment : 14 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 2639 time to create 1 rle with old method : 0.0033576488494873047 length of segment : 48 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009417533874511719 length of segment : 33 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00016570091247558594 length of segment : 10 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1719 time to create 1 rle with old method : 0.0022013187408447266 length of segment : 54 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008246898651123047 length of segment : 31 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008442401885986328 length of segment : 19 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0009188652038574219 length of segment : 21 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00029587745666503906 length of segment : 21 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2673 time to create 1 rle with old method : 0.0032846927642822266 length of segment : 50 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008900165557861328 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.42656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 25 time for calcul the mask position with numpy : 0.00012946128845214844 nb_pixel_total : 2214 time to create 1 rle with old method : 0.0027136802673339844 length of segment : 84 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0008764266967773438 length of segment : 43 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0014460086822509766 length of segment : 41 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0006189346313476562 length of segment : 27 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.001313924789428711 length of segment : 31 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 1555 time to create 1 rle with old method : 0.003446340560913086 length of segment : 88 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0008883476257324219 length of segment : 29 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1426 time to create 1 rle with old method : 0.001893758773803711 length of segment : 48 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 1735 time to create 1 rle with old method : 0.002763032913208008 length of segment : 50 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 26 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 2101 time to create 1 rle with old method : 0.0027239322662353516 length of segment : 55 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 17 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0007164478302001953 length of segment : 24 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0012204647064208984 length of segment : 60 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00040841102600097656 length of segment : 23 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008223056793212891 length of segment : 41 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 2103 time to create 1 rle with old method : 0.002502918243408203 length of segment : 60 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 2642 time to create 1 rle with old method : 0.0032258033752441406 length of segment : 85 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006034374237060547 length of segment : 23 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 3085 time to create 1 rle with old method : 0.0072841644287109375 length of segment : 82 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0006730556488037109 length of segment : 30 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0019354820251464844 length of segment : 54 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0019812583923339844 length of segment : 58 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1414 time to create 1 rle with old method : 0.0016798973083496094 length of segment : 67 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2022 time to create 1 rle with old method : 0.002634286880493164 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -83.59844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002002716064453125 length of segment : 21 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0008013248443603516 length of segment : 31 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0002532005310058594 length of segment : 14 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007925033569335938 length of segment : 38 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007429122924804688 length of segment : 41 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.00029730796813964844 length of segment : 24 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 21 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003857612609863281 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 132.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: 8.30000 max: 112.48672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.94609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0021619796752929688 length of segment : 40 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 16 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006682872772216797 length of segment : 31 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0011513233184814453 length of segment : 37 time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 4035 time to create 1 rle with old method : 0.004915714263916016 length of segment : 103 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 814 time to create 1 rle with old method : 0.001119375228881836 length of segment : 65 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.81094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 924 time to create 1 rle with old method : 0.001691579818725586 length of segment : 42 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 631 time to create 1 rle with old method : 0.0014955997467041016 length of segment : 38 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005202293395996094 length of segment : 33 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0011608600616455078 length of segment : 30 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0011432170867919922 length of segment : 90 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002684593200683594 length of segment : 18 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 11 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005259513854980469 length of segment : 35 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004775524139404297 length of segment : 39 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 23 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003490447998046875 length of segment : 13 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006639957427978516 length of segment : 31 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1517 time to create 1 rle with old method : 0.002062559127807617 length of segment : 45 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2646 time to create 1 rle with old method : 0.0035212039947509766 length of segment : 70 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1555 time to create 1 rle with old method : 0.0020596981048583984 length of segment : 52 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0009636878967285156 length of segment : 37 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0006165504455566406 length of segment : 25 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 12 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.0011136531829833984 length of segment : 79 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1002 time to create 1 rle with old method : 0.0014145374298095703 length of segment : 34 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00034332275390625 length of segment : 28 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 33 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0015902519226074219 length of segment : 22 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015735626220703125 length of segment : 14 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1346 time to create 1 rle with old method : 0.002027273178100586 length of segment : 58 time for calcul the mask position with numpy : 0.0007188320159912109 nb_pixel_total : 43512 time to create 1 rle with old method : 0.055612802505493164 length of segment : 261 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005116462707519531 length of segment : 56 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1185 time to create 1 rle with old method : 0.0015892982482910156 length of segment : 36 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008144378662109375 length of segment : 35 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005490779876708984 length of segment : 21 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.0008068084716796875 length of segment : 19 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0016989707946777344 length of segment : 39 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006878376007080078 length of segment : 18 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0006573200225830078 length of segment : 22 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008924007415771484 length of segment : 26 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 2061 time to create 1 rle with old method : 0.0028870105743408203 length of segment : 45 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005526542663574219 length of segment : 28 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004901885986328125 length of segment : 21 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006535053253173828 length of segment : 20 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 26 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 14 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 17 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00025916099548339844 length of segment : 21 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008792877197265625 length of segment : 26 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0005013942718505859 length of segment : 19 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1389 time to create 1 rle with old method : 0.0018572807312011719 length of segment : 37 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 10 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00018477439880371094 length of segment : 14 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0003604888916015625 length of segment : 15 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004055500030517578 length of segment : 21 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005345344543457031 length of segment : 36 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 45 time to create 1 rle with old method : 0.00010251998901367188 length of segment : 8 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00030803680419921875 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00021696090698242188 length of segment : 16 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0009164810180664062 length of segment : 30 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005476474761962891 length of segment : 20 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0010256767272949219 length of segment : 31 Processing 1 images image shape: (240, 400, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.94219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 99.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 86.33437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00051116943359375 length of segment : 25 time for calcul the mask position with numpy : 0.00047016143798828125 nb_pixel_total : 28775 time to create 1 rle with old method : 0.0530858039855957 length of segment : 139 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1144 time to create 1 rle with old method : 0.001466989517211914 length of segment : 36 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0022487640380859375 length of segment : 36 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 238.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.65716 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 21 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 17 time to create 1 rle with old method : 5.054473876953125e-05 length of segment : 5 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 9 time to create 1 rle with old method : 4.3392181396484375e-05 length of segment : 4 Detection mask done ! Trying to reset tf kernel 1071889 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4061 tf kernel not reseted sub process len(results) : 286 len(list_Values) 286 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 286 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9350 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 293 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 295 save missing photos in datou_result : time spend for datou_step_exec : 26.663653135299683 time spend to save output : 0.42800402641296387 total time spend for step 1 : 27.091657161712646 step2:brightness Mon Mar 10 22:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.00783228874206543 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.009956598281860352 save missing photos in datou_result : time spend for datou_step_exec : 0.02684926986694336 time spend to save output : 0.02181386947631836 total time spend for step 2 : 0.04866313934326172 step3:blur_detection Mon Mar 10 22:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.007822275161743164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.008017778396606445 save missing photos in datou_result : time spend for datou_step_exec : 0.02312636375427246 time spend to save output : 0.021959781646728516 total time spend for step 3 : 0.04508614540100098 step4:rle_unique_nms_with_priority Mon Mar 10 22:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 293 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 291 nb_hashtags : 7 time to prepare the origin masks : 1.9143986701965332 time for calcul the mask position with numpy : 0.4320523738861084 nb_pixel_total : 3339691 time to create 1 rle with new method : 0.7196650505065918 time for calcul the mask position with numpy : 0.017433881759643555 nb_pixel_total : 32914 time to create 1 rle with old method : 0.04541897773742676 time for calcul the mask position with numpy : 0.0166928768157959 nb_pixel_total : 910 time to create 1 rle with old method : 0.0011568069458007812 time for calcul the mask position with numpy : 0.015990495681762695 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005664825439453125 time for calcul the mask position with numpy : 0.015521526336669922 nb_pixel_total : 1410 time to create 1 rle with old method : 0.001825571060180664 time for calcul the mask position with numpy : 0.01917266845703125 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004324913024902344 time for calcul the mask position with numpy : 0.015591859817504883 nb_pixel_total : 2175 time to create 1 rle with old method : 0.002588987350463867 time for calcul the mask position with numpy : 0.017161846160888672 nb_pixel_total : 15264 time to create 1 rle with old method : 0.020978689193725586 time for calcul the mask position with numpy : 0.01745915412902832 nb_pixel_total : 134 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.01726245880126953 nb_pixel_total : 3594 time to create 1 rle with old method : 0.005967378616333008 time for calcul the mask position with numpy : 0.017522573471069336 nb_pixel_total : 85 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.015151739120483398 nb_pixel_total : 9234 time to create 1 rle with old method : 0.010509014129638672 time for calcul the mask position with numpy : 0.015233755111694336 nb_pixel_total : 4348 time to create 1 rle with old method : 0.005156755447387695 time for calcul the mask position with numpy : 0.014980792999267578 nb_pixel_total : 404 time to create 1 rle with old method : 0.00047969818115234375 time for calcul the mask position with numpy : 0.015093803405761719 nb_pixel_total : 715 time to create 1 rle with old method : 0.0009038448333740234 time for calcul the mask position with numpy : 0.015050172805786133 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005791187286376953 time for calcul the mask position with numpy : 0.01498103141784668 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0019156932830810547 time for calcul the mask position with numpy : 0.01512002944946289 nb_pixel_total : 653 time to create 1 rle with old method : 0.0007846355438232422 time for calcul the mask position with numpy : 0.015361309051513672 nb_pixel_total : 2807 time to create 1 rle with old method : 0.003381490707397461 time for calcul the mask position with numpy : 0.015169382095336914 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004150867462158203 time for calcul the mask position with numpy : 0.01597428321838379 nb_pixel_total : 1960 time to create 1 rle with old method : 0.0024030208587646484 time for calcul the mask position with numpy : 0.015466928482055664 nb_pixel_total : 2656 time to create 1 rle with old method : 0.0036630630493164062 time for calcul the mask position with numpy : 0.01545405387878418 nb_pixel_total : 89 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.015387535095214844 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014257431030273438 time for calcul the mask position with numpy : 0.015892744064331055 nb_pixel_total : 258 time to create 1 rle with old method : 0.00031685829162597656 time for calcul the mask position with numpy : 0.016982078552246094 nb_pixel_total : 28 time to create 1 rle with old method : 0.00011587142944335938 time for calcul the mask position with numpy : 0.01591968536376953 nb_pixel_total : 2297 time to create 1 rle with old method : 0.0027685165405273438 time for calcul the mask position with numpy : 0.017008066177368164 nb_pixel_total : 1395 time to create 1 rle with old method : 0.002125263214111328 time for calcul the mask position with numpy : 0.018323659896850586 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007135868072509766 time for calcul the mask position with numpy : 0.01724839210510254 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0022735595703125 time for calcul the mask position with numpy : 0.01504373550415039 nb_pixel_total : 209 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.015086174011230469 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003962516784667969 time for calcul the mask position with numpy : 0.015316247940063477 nb_pixel_total : 1376 time to create 1 rle with old method : 0.001627206802368164 time for calcul the mask position with numpy : 0.015468120574951172 nb_pixel_total : 1591 time to create 1 rle with old method : 0.0018000602722167969 time for calcul the mask position with numpy : 0.015239715576171875 nb_pixel_total : 1173 time to create 1 rle with old method : 0.001447439193725586 time for calcul the mask position with numpy : 0.0180814266204834 nb_pixel_total : 391 time to create 1 rle with old method : 0.0006489753723144531 time for calcul the mask position with numpy : 0.016868114471435547 nb_pixel_total : 3 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.01488804817199707 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008597373962402344 time for calcul the mask position with numpy : 0.015095710754394531 nb_pixel_total : 468 time to create 1 rle with old method : 0.00054168701171875 time for calcul the mask position with numpy : 0.014814138412475586 nb_pixel_total : 4230 time to create 1 rle with old method : 0.00463104248046875 time for calcul the mask position with numpy : 0.01604485511779785 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0021238327026367188 time for calcul the mask position with numpy : 0.015034914016723633 nb_pixel_total : 334 time to create 1 rle with old method : 0.0003857612609863281 time for calcul the mask position with numpy : 0.015083789825439453 nb_pixel_total : 909 time to create 1 rle with old method : 0.0013129711151123047 time for calcul the mask position with numpy : 0.015053033828735352 nb_pixel_total : 20 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.01853322982788086 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.015052318572998047 nb_pixel_total : 3354 time to create 1 rle with old method : 0.003903627395629883 time for calcul the mask position with numpy : 0.014995813369750977 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0012569427490234375 time for calcul the mask position with numpy : 0.015027523040771484 nb_pixel_total : 1482 time to create 1 rle with old method : 0.001718759536743164 time for calcul the mask position with numpy : 0.015015840530395508 nb_pixel_total : 4143 time to create 1 rle with old method : 0.0047550201416015625 time for calcul the mask position with numpy : 0.01738739013671875 nb_pixel_total : 437 time to create 1 rle with old method : 0.0008282661437988281 time for calcul the mask position with numpy : 0.015099763870239258 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0012705326080322266 time for calcul the mask position with numpy : 0.014957904815673828 nb_pixel_total : 1950 time to create 1 rle with old method : 0.0022187232971191406 time for calcul the mask position with numpy : 0.014977455139160156 nb_pixel_total : 328 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.015012025833129883 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0014815330505371094 time for calcul the mask position with numpy : 0.01503610610961914 nb_pixel_total : 274 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.015058517456054688 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0014612674713134766 time for calcul the mask position with numpy : 0.015077352523803711 nb_pixel_total : 77 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.01503300666809082 nb_pixel_total : 26 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.015106678009033203 nb_pixel_total : 1504 time to create 1 rle with old method : 0.0017573833465576172 time for calcul the mask position with numpy : 0.015056848526000977 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.015246391296386719 nb_pixel_total : 2683 time to create 1 rle with old method : 0.003069639205932617 time for calcul the mask position with numpy : 0.015114545822143555 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0012593269348144531 time for calcul the mask position with numpy : 0.015101432800292969 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007545948028564453 time for calcul the mask position with numpy : 0.015019655227661133 nb_pixel_total : 2485 time to create 1 rle with old method : 0.0027816295623779297 time for calcul the mask position with numpy : 0.014972209930419922 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003237724304199219 time for calcul the mask position with numpy : 0.015072345733642578 nb_pixel_total : 321 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.015406370162963867 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003249645233154297 time for calcul the mask position with numpy : 0.015074729919433594 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010600090026855469 time for calcul the mask position with numpy : 0.014992237091064453 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0011763572692871094 time for calcul the mask position with numpy : 0.015067577362060547 nb_pixel_total : 275 time to create 1 rle with old method : 0.00034928321838378906 time for calcul the mask position with numpy : 0.015038728713989258 nb_pixel_total : 122 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.015061378479003906 nb_pixel_total : 63 time to create 1 rle with old method : 9.012222290039062e-05 time for calcul the mask position with numpy : 0.01511836051940918 nb_pixel_total : 177 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.015496492385864258 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003211498260498047 time for calcul the mask position with numpy : 0.01521611213684082 nb_pixel_total : 367 time to create 1 rle with old method : 0.00046515464782714844 time for calcul the mask position with numpy : 0.015464305877685547 nb_pixel_total : 85 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.01760077476501465 nb_pixel_total : 587 time to create 1 rle with old method : 0.0009844303131103516 time for calcul the mask position with numpy : 0.017590045928955078 nb_pixel_total : 2008 time to create 1 rle with old method : 0.003541231155395508 time for calcul the mask position with numpy : 0.01753687858581543 nb_pixel_total : 98 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.016985654830932617 nb_pixel_total : 2615 time to create 1 rle with old method : 0.0029566287994384766 time for calcul the mask position with numpy : 0.015060901641845703 nb_pixel_total : 176 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.015455484390258789 nb_pixel_total : 288 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.015131711959838867 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0015840530395507812 time for calcul the mask position with numpy : 0.01502227783203125 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001811981201171875 time for calcul the mask position with numpy : 0.014926433563232422 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.01491999626159668 nb_pixel_total : 21 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.01512598991394043 nb_pixel_total : 30 time to create 1 rle with old method : 9.822845458984375e-05 time for calcul the mask position with numpy : 0.015219449996948242 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011420249938964844 time for calcul the mask position with numpy : 0.0150604248046875 nb_pixel_total : 2 time to create 1 rle with old method : 2.8848648071289062e-05 time for calcul the mask position with numpy : 0.014990091323852539 nb_pixel_total : 104 time to create 1 rle with old method : 0.00014138221740722656 time for calcul the mask position with numpy : 0.014975309371948242 nb_pixel_total : 154 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.015041351318359375 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005023479461669922 time for calcul the mask position with numpy : 0.015039682388305664 nb_pixel_total : 157 time to create 1 rle with old method : 0.00019741058349609375 time for calcul the mask position with numpy : 0.015108108520507812 nb_pixel_total : 1001 time to create 1 rle with old method : 0.001173257827758789 time for calcul the mask position with numpy : 0.01518869400024414 nb_pixel_total : 27 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.015133380889892578 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007271766662597656 time for calcul the mask position with numpy : 0.015182971954345703 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007126331329345703 time for calcul the mask position with numpy : 0.015058755874633789 nb_pixel_total : 2 time to create 1 rle with old method : 1.6689300537109375e-05 time for calcul the mask position with numpy : 0.017322063446044922 nb_pixel_total : 2169 time to create 1 rle with old method : 0.003627300262451172 time for calcul the mask position with numpy : 0.017132997512817383 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005395412445068359 time for calcul the mask position with numpy : 0.016959428787231445 nb_pixel_total : 190 time to create 1 rle with old method : 0.00022935867309570312 time for calcul the mask position with numpy : 0.014901876449584961 nb_pixel_total : 1184 time to create 1 rle with old method : 0.0013358592987060547 time for calcul the mask position with numpy : 0.01495981216430664 nb_pixel_total : 64 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 341 time to create 1 rle with old method : 0.00042247772216796875 time for calcul the mask position with numpy : 0.01491546630859375 nb_pixel_total : 2035 time to create 1 rle with old method : 0.002320528030395508 time for calcul the mask position with numpy : 0.014975309371948242 nb_pixel_total : 121 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.015005111694335938 nb_pixel_total : 203 time to create 1 rle with old method : 0.00028252601623535156 time for calcul the mask position with numpy : 0.014962196350097656 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0015451908111572266 time for calcul the mask position with numpy : 0.01497507095336914 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005288124084472656 time for calcul the mask position with numpy : 0.014976024627685547 nb_pixel_total : 224 time to create 1 rle with old method : 0.00035119056701660156 time for calcul the mask position with numpy : 0.015093088150024414 nb_pixel_total : 4496 time to create 1 rle with old method : 0.005018711090087891 time for calcul the mask position with numpy : 0.014923810958862305 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003712177276611328 time for calcul the mask position with numpy : 0.014911174774169922 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0014500617980957031 time for calcul the mask position with numpy : 0.014933586120605469 nb_pixel_total : 2199 time to create 1 rle with old method : 0.0024847984313964844 time for calcul the mask position with numpy : 0.014984607696533203 nb_pixel_total : 1273 time to create 1 rle with old method : 0.0014421939849853516 time for calcul the mask position with numpy : 0.014944076538085938 nb_pixel_total : 792 time to create 1 rle with old method : 0.0009074211120605469 time for calcul the mask position with numpy : 0.0150146484375 nb_pixel_total : 2266 time to create 1 rle with old method : 0.0025758743286132812 time for calcul the mask position with numpy : 0.014953851699829102 nb_pixel_total : 1251 time to create 1 rle with old method : 0.0014157295227050781 time for calcul the mask position with numpy : 0.014950037002563477 nb_pixel_total : 138 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.015021085739135742 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003685951232910156 time for calcul the mask position with numpy : 0.015329837799072266 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005922317504882812 time for calcul the mask position with numpy : 0.015106916427612305 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009026527404785156 time for calcul the mask position with numpy : 0.015196800231933594 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007677078247070312 time for calcul the mask position with numpy : 0.015136003494262695 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003514289855957031 time for calcul the mask position with numpy : 0.015090465545654297 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005536079406738281 time for calcul the mask position with numpy : 0.015040874481201172 nb_pixel_total : 6 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.015043020248413086 nb_pixel_total : 550 time to create 1 rle with old method : 0.0006623268127441406 time for calcul the mask position with numpy : 0.01504206657409668 nb_pixel_total : 3 time to create 1 rle with old method : 2.0742416381835938e-05 time for calcul the mask position with numpy : 0.015035390853881836 nb_pixel_total : 372 time to create 1 rle with old method : 0.00046706199645996094 time for calcul the mask position with numpy : 0.015029430389404297 nb_pixel_total : 779 time to create 1 rle with old method : 0.0009095668792724609 time for calcul the mask position with numpy : 0.015268802642822266 nb_pixel_total : 2302 time to create 1 rle with old method : 0.0027229785919189453 time for calcul the mask position with numpy : 0.015192747116088867 nb_pixel_total : 1155 time to create 1 rle with old method : 0.0013637542724609375 time for calcul the mask position with numpy : 0.015145063400268555 nb_pixel_total : 2342 time to create 1 rle with old method : 0.0026941299438476562 time for calcul the mask position with numpy : 0.014975786209106445 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005524158477783203 time for calcul the mask position with numpy : 0.015016317367553711 nb_pixel_total : 20 time to create 1 rle with old method : 5.53131103515625e-05 time for calcul the mask position with numpy : 0.014954805374145508 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007004737854003906 time for calcul the mask position with numpy : 0.016384601593017578 nb_pixel_total : 114 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.014966726303100586 nb_pixel_total : 1001 time to create 1 rle with old method : 0.001214742660522461 time for calcul the mask position with numpy : 0.014940261840820312 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006389617919921875 time for calcul the mask position with numpy : 0.014948844909667969 nb_pixel_total : 951 time to create 1 rle with old method : 0.0010826587677001953 time for calcul the mask position with numpy : 0.014900445938110352 nb_pixel_total : 5 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.014916419982910156 nb_pixel_total : 925 time to create 1 rle with old method : 0.0010676383972167969 time for calcul the mask position with numpy : 0.015002965927124023 nb_pixel_total : 165 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.014989137649536133 nb_pixel_total : 158 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.015018939971923828 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.014935970306396484 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0015833377838134766 time for calcul the mask position with numpy : 0.01498866081237793 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.015010595321655273 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005216598510742188 time for calcul the mask position with numpy : 0.015004158020019531 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004668235778808594 time for calcul the mask position with numpy : 0.015006780624389648 nb_pixel_total : 339 time to create 1 rle with old method : 0.0003972053527832031 time for calcul the mask position with numpy : 0.015046834945678711 nb_pixel_total : 159 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.015063047409057617 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003840923309326172 time for calcul the mask position with numpy : 0.015021562576293945 nb_pixel_total : 290 time to create 1 rle with old method : 0.00040721893310546875 time for calcul the mask position with numpy : 0.015095949172973633 nb_pixel_total : 266 time to create 1 rle with old method : 0.00033283233642578125 time for calcul the mask position with numpy : 0.015006065368652344 nb_pixel_total : 343 time to create 1 rle with old method : 0.0007491111755371094 time for calcul the mask position with numpy : 0.015049934387207031 nb_pixel_total : 171 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.015272855758666992 nb_pixel_total : 253 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.015163660049438477 nb_pixel_total : 25 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.016870498657226562 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007741451263427734 time for calcul the mask position with numpy : 0.015104532241821289 nb_pixel_total : 850 time to create 1 rle with old method : 0.001010894775390625 time for calcul the mask position with numpy : 0.015123367309570312 nb_pixel_total : 317 time to create 1 rle with old method : 0.00040078163146972656 time for calcul the mask position with numpy : 0.01505732536315918 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0015621185302734375 time for calcul the mask position with numpy : 0.015042543411254883 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.015181303024291992 nb_pixel_total : 945 time to create 1 rle with old method : 0.0011241436004638672 time for calcul the mask position with numpy : 0.015073299407958984 nb_pixel_total : 103 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.015018224716186523 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003044605255126953 time for calcul the mask position with numpy : 0.015052080154418945 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007443428039550781 time for calcul the mask position with numpy : 0.015176773071289062 nb_pixel_total : 2642 time to create 1 rle with old method : 0.0030379295349121094 time for calcul the mask position with numpy : 0.015337467193603516 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.01567244529724121 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0033805370330810547 time for calcul the mask position with numpy : 0.015042304992675781 nb_pixel_total : 1556 time to create 1 rle with old method : 0.0017733573913574219 time for calcul the mask position with numpy : 0.01503443717956543 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0020744800567626953 time for calcul the mask position with numpy : 0.015296220779418945 nb_pixel_total : 562 time to create 1 rle with old method : 0.000720977783203125 time for calcul the mask position with numpy : 0.015034675598144531 nb_pixel_total : 277 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.015021324157714844 nb_pixel_total : 241 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.015224218368530273 nb_pixel_total : 114 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.01565074920654297 nb_pixel_total : 1426 time to create 1 rle with old method : 0.002328157424926758 time for calcul the mask position with numpy : 0.015493392944335938 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0021059513092041016 time for calcul the mask position with numpy : 0.015119791030883789 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002923011779785156 time for calcul the mask position with numpy : 0.015381336212158203 nb_pixel_total : 188 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.015400171279907227 nb_pixel_total : 167 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.01534581184387207 nb_pixel_total : 2567 time to create 1 rle with old method : 0.002927541732788086 time for calcul the mask position with numpy : 0.015128135681152344 nb_pixel_total : 367 time to create 1 rle with old method : 0.00044274330139160156 time for calcul the mask position with numpy : 0.015036344528198242 nb_pixel_total : 924 time to create 1 rle with old method : 0.0010848045349121094 time for calcul the mask position with numpy : 0.015014410018920898 nb_pixel_total : 1200 time to create 1 rle with old method : 0.001369476318359375 time for calcul the mask position with numpy : 0.014917612075805664 nb_pixel_total : 308 time to create 1 rle with old method : 0.00037097930908203125 time for calcul the mask position with numpy : 0.014998912811279297 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0012462139129638672 time for calcul the mask position with numpy : 0.014978885650634766 nb_pixel_total : 301 time to create 1 rle with old method : 0.00037932395935058594 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007793903350830078 time for calcul the mask position with numpy : 0.014989852905273438 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.014993667602539062 nb_pixel_total : 968 time to create 1 rle with old method : 0.0011398792266845703 time for calcul the mask position with numpy : 0.015035390853881836 nb_pixel_total : 325 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.015111446380615234 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0014467239379882812 time for calcul the mask position with numpy : 0.014999866485595703 nb_pixel_total : 1690 time to create 1 rle with old method : 0.0019347667694091797 time for calcul the mask position with numpy : 0.014996528625488281 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002522468566894531 time for calcul the mask position with numpy : 0.015040874481201172 nb_pixel_total : 1515 time to create 1 rle with old method : 0.001775503158569336 time for calcul the mask position with numpy : 0.015064716339111328 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004134178161621094 time for calcul the mask position with numpy : 0.01511073112487793 nb_pixel_total : 8 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.015004158020019531 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007562637329101562 time for calcul the mask position with numpy : 0.01505589485168457 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007259845733642578 time for calcul the mask position with numpy : 0.01661539077758789 nb_pixel_total : 2101 time to create 1 rle with old method : 0.0025224685668945312 time for calcul the mask position with numpy : 0.015223503112792969 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007865428924560547 time for calcul the mask position with numpy : 0.01542520523071289 nb_pixel_total : 2215 time to create 1 rle with old method : 0.0025641918182373047 time for calcul the mask position with numpy : 0.016000747680664062 nb_pixel_total : 798 time to create 1 rle with old method : 0.0009670257568359375 time for calcul the mask position with numpy : 0.015342950820922852 nb_pixel_total : 28 time to create 1 rle with old method : 8.130073547363281e-05 time for calcul the mask position with numpy : 0.015275716781616211 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010287761688232422 time for calcul the mask position with numpy : 0.015171527862548828 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0015981197357177734 time for calcul the mask position with numpy : 0.015217781066894531 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007195472717285156 time for calcul the mask position with numpy : 0.015118837356567383 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008966922760009766 time for calcul the mask position with numpy : 0.015079498291015625 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018835067749023438 time for calcul the mask position with numpy : 0.015030622482299805 nb_pixel_total : 2639 time to create 1 rle with old method : 0.0029914379119873047 time for calcul the mask position with numpy : 0.015009880065917969 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.014957189559936523 nb_pixel_total : 6 time to create 1 rle with old method : 3.3855438232421875e-05 time for calcul the mask position with numpy : 0.015012264251708984 nb_pixel_total : 1 time to create 1 rle with old method : 1.2159347534179688e-05 time for calcul the mask position with numpy : 0.01497650146484375 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.014862298965454102 nb_pixel_total : 4 time to create 1 rle with old method : 1.9788742065429688e-05 time for calcul the mask position with numpy : 0.014795064926147461 nb_pixel_total : 422 time to create 1 rle with old method : 0.0006775856018066406 time for calcul the mask position with numpy : 0.016659975051879883 nb_pixel_total : 1718 time to create 1 rle with old method : 0.0021903514862060547 time for calcul the mask position with numpy : 0.01508951187133789 nb_pixel_total : 108 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.014948368072509766 nb_pixel_total : 274 time to create 1 rle with old method : 0.00035119056701660156 time for calcul the mask position with numpy : 0.015300273895263672 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0023775100708007812 time for calcul the mask position with numpy : 0.015114068984985352 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004601478576660156 time for calcul the mask position with numpy : 0.014996528625488281 nb_pixel_total : 493 time to create 1 rle with old method : 0.0005984306335449219 time for calcul the mask position with numpy : 0.015154600143432617 nb_pixel_total : 420 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.015130996704101562 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008330345153808594 time for calcul the mask position with numpy : 0.014982938766479492 nb_pixel_total : 394 time to create 1 rle with old method : 0.00045680999755859375 time for calcul the mask position with numpy : 0.015049219131469727 nb_pixel_total : 241 time to create 1 rle with old method : 0.00029659271240234375 time for calcul the mask position with numpy : 0.014986276626586914 nb_pixel_total : 4035 time to create 1 rle with old method : 0.0045185089111328125 time for calcul the mask position with numpy : 0.014986038208007812 nb_pixel_total : 575 time to create 1 rle with old method : 0.00066375732421875 time for calcul the mask position with numpy : 0.015201568603515625 nb_pixel_total : 3835 time to create 1 rle with old method : 0.00465083122253418 time for calcul the mask position with numpy : 0.015036821365356445 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007150173187255859 time for calcul the mask position with numpy : 0.015021324157714844 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006878376007080078 time for calcul the mask position with numpy : 0.015063762664794922 nb_pixel_total : 1735 time to create 1 rle with old method : 0.001958131790161133 time for calcul the mask position with numpy : 0.015151739120483398 nb_pixel_total : 847 time to create 1 rle with old method : 0.0013904571533203125 time for calcul the mask position with numpy : 0.01556086540222168 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005421638488769531 time for calcul the mask position with numpy : 0.015217065811157227 nb_pixel_total : 34 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.015350103378295898 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.015295267105102539 nb_pixel_total : 218 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.01721787452697754 nb_pixel_total : 637 time to create 1 rle with old method : 0.0010616779327392578 time for calcul the mask position with numpy : 0.01719188690185547 nb_pixel_total : 2060 time to create 1 rle with old method : 0.003293275833129883 time for calcul the mask position with numpy : 0.0171811580657959 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.017218589782714844 nb_pixel_total : 8 time to create 1 rle with old method : 6.103515625e-05 time for calcul the mask position with numpy : 0.015558958053588867 nb_pixel_total : 113 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.015085220336914062 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.015040159225463867 nb_pixel_total : 28549 time to create 1 rle with old method : 0.031806230545043945 time for calcul the mask position with numpy : 0.015205860137939453 nb_pixel_total : 39749 time to create 1 rle with old method : 0.04411888122558594 time for calcul the mask position with numpy : 0.014976024627685547 nb_pixel_total : 91 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.014985799789428711 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006632804870605469 time for calcul the mask position with numpy : 0.015156269073486328 nb_pixel_total : 1518 time to create 1 rle with old method : 0.0017266273498535156 time for calcul the mask position with numpy : 0.01492619514465332 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005812644958496094 time for calcul the mask position with numpy : 0.014903068542480469 nb_pixel_total : 61 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.014889001846313477 nb_pixel_total : 90 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.014894485473632812 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.014885902404785156 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0014286041259765625 time for calcul the mask position with numpy : 0.014978647232055664 nb_pixel_total : 19 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.014980077743530273 nb_pixel_total : 266 time to create 1 rle with old method : 0.00031375885009765625 time for calcul the mask position with numpy : 0.015015363693237305 nb_pixel_total : 226 time to create 1 rle with old method : 0.00026416778564453125 time for calcul the mask position with numpy : 0.015181779861450195 nb_pixel_total : 336 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.014981746673583984 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.015087127685546875 nb_pixel_total : 243 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.016816377639770508 nb_pixel_total : 317 time to create 1 rle with old method : 0.000453948974609375 time for calcul the mask position with numpy : 0.015087127685546875 nb_pixel_total : 329 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.015267133712768555 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007040500640869141 time for calcul the mask position with numpy : 0.014976978302001953 nb_pixel_total : 297 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.015045404434204102 nb_pixel_total : 9 time to create 1 rle with old method : 2.2649765014648438e-05 time for calcul the mask position with numpy : 0.015749454498291016 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009686946868896484 time for calcul the mask position with numpy : 0.015126705169677734 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004458427429199219 time for calcul the mask position with numpy : 0.015017271041870117 nb_pixel_total : 1348 time to create 1 rle with old method : 0.001558065414428711 time for calcul the mask position with numpy : 0.014911890029907227 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.014963388442993164 nb_pixel_total : 434 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.015001773834228516 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.015402793884277344 nb_pixel_total : 203 time to create 1 rle with old method : 0.00047326087951660156 time for calcul the mask position with numpy : 0.014830827713012695 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.014586210250854492 nb_pixel_total : 174 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.014775991439819336 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008046627044677734 time for calcul the mask position with numpy : 0.014918327331542969 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005192756652832031 time for calcul the mask position with numpy : 0.01494145393371582 nb_pixel_total : 14 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.015044212341308594 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004773139953613281 time for calcul the mask position with numpy : 0.014710426330566406 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004572868347167969 time for calcul the mask position with numpy : 0.014561176300048828 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.014738082885742188 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004341602325439453 time for calcul the mask position with numpy : 0.014876127243041992 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.014755487442016602 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0011985301971435547 time for calcul the mask position with numpy : 0.014924287796020508 nb_pixel_total : 109 time to create 1 rle with old method : 0.000148773193359375 time for calcul the mask position with numpy : 0.01665353775024414 nb_pixel_total : 136 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.01462554931640625 nb_pixel_total : 1389 time to create 1 rle with old method : 0.0015797615051269531 time for calcul the mask position with numpy : 0.014787435531616211 nb_pixel_total : 139 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.014525175094604492 nb_pixel_total : 45 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.01455831527709961 nb_pixel_total : 2645 time to create 1 rle with old method : 0.0029916763305664062 time for calcul the mask position with numpy : 0.02167344093322754 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.014954328536987305 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0011699199676513672 time for calcul the mask position with numpy : 0.014989852905273438 nb_pixel_total : 17 time to create 1 rle with old method : 3.075599670410156e-05 create new chi : 6.078672170639038 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.015451431274414062 batch 1 Loaded 295 chid ids of type : 4230 Number RLEs to save : 23716 TO DO : save crop sub photo not yet done ! save time : 1.536236047744751 map_output_result : {1342585602: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 1 /1342585602.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.017726421356201172 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.849679470062256 time spend to save output : 0.018227338790893555 total time spend for step 4 : 9.86790680885315 step5:crop_condition Mon Mar 10 22:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 295 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 144 About to insert : list_path_to_insert length 144 new photo from crops ! About to upload 144 photos upload in portfolio : 4869462 init cache_photo without model_param we have 144 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741641674_1071264 we have uploaded 144 photos in the portfolio 4869462 time of upload the photos Elapsed time : 32.20866084098816 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 4869462 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741641707_1071264 we have uploaded 47 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.199148178100586 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741641719_1071264 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.346210479736328 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741641722_1071264 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.5834319591522217 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741641725_1071264 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6727681159973145 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 210 /1342683875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342683998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342684173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 631 time used for this insertion : 0.8376302719116211 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.26859188079834 time spend to save output : 0.8514094352722168 total time spend for step 5 : 56.12000131607056 step6:thcl Mon Mar 10 22:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.012166738510131836 time to convert the images to numpy array : 0.062476396560668945 time to import caffe and check if the image exist : 0.019932270050048828 time to convert the images to numpy array : 0.07526540756225586 time to import caffe and check if the image exist : 0.014811992645263672 time to convert the images to numpy array : 0.08896040916442871 time to import caffe and check if the image exist : 0.029498577117919922 time to convert the images to numpy array : 0.07796382904052734 time to import caffe and check if the image exist : 0.033547163009643555 time to convert the images to numpy array : 0.07522821426391602 time to import caffe and check if the image exist : 0.03423142433166504 time to convert the images to numpy array : 0.07503247261047363 time to import caffe and check if the image exist : 0.04064512252807617 time to convert the images to numpy array : 0.0738227367401123 time to import caffe and check if the image exist : 0.024413108825683594 time to convert the images to numpy array : 0.09193181991577148 time to import caffe and check if the image exist : 0.048523902893066406 time to convert the images to numpy array : 0.06970834732055664 time to import caffe and check if the image exist : 0.03148317337036133 time to convert the images to numpy array : 0.08375287055969238 total time to convert the images to numpy array : 0.7058727741241455 list photo_ids error: [] list photo_ids correct : [1342683875, 1342683876, 1342683877, 1342683878, 1342683879, 1342683880, 1342683882, 1342683883, 1342683885, 1342683886, 1342683887, 1342683889, 1342683890, 1342683891, 1342683893, 1342683894, 1342683896, 1342683898, 1342683899, 1342683901, 1342683904, 1342684104, 1342684105, 1342684106, 1342684107, 1342684109, 1342684110, 1342684111, 1342684112, 1342684113, 1342684114, 1342684115, 1342684116, 1342684117, 1342684118, 1342684119, 1342684120, 1342684121, 1342684122, 1342684123, 1342684124, 1342684125, 1342684024, 1342684025, 1342684027, 1342684028, 1342684029, 1342684031, 1342684032, 1342684033, 1342684035, 1342684036, 1342684037, 1342684039, 1342684040, 1342684041, 1342684042, 1342684043, 1342684044, 1342684045, 1342684046, 1342684047, 1342684048, 1342684080, 1342684081, 1342684082, 1342684083, 1342684084, 1342684085, 1342684086, 1342684087, 1342684088, 1342684089, 1342684090, 1342684091, 1342684092, 1342684093, 1342684094, 1342684095, 1342684096, 1342684099, 1342684101, 1342684102, 1342684103, 1342683935, 1342683937, 1342683938, 1342683939, 1342683941, 1342683942, 1342683943, 1342683945, 1342683946, 1342683947, 1342683949, 1342683950, 1342683951, 1342683953, 1342683954, 1342683955, 1342683957, 1342683958, 1342683959, 1342683961, 1342683962, 1342683963, 1342683965, 1342683966, 1342683967, 1342683969, 1342683970, 1342683971, 1342683973, 1342683974, 1342683975, 1342683977, 1342683978, 1342683979, 1342683981, 1342683982, 1342683983, 1342683985, 1342683986, 1342683988, 1342683989, 1342683990, 1342683992, 1342683993, 1342683994, 1342683996, 1342683997, 1342683998, 1342684000, 1342684001, 1342684002, 1342684004, 1342684006, 1342684008, 1342684009, 1342684010, 1342684012, 1342684013, 1342684016, 1342684018, 1342684019, 1342684020, 1342684022, 1342684049, 1342684050, 1342684051, 1342684052, 1342684053, 1342684054, 1342684055, 1342684056, 1342684057, 1342684058, 1342684059, 1342684060, 1342684061, 1342684062, 1342684063, 1342684064, 1342684065, 1342684066, 1342684077, 1342684078, 1342684079, 1342683905, 1342683907, 1342683909, 1342683910, 1342683912, 1342683913, 1342683914, 1342683916, 1342683918, 1342683919, 1342683921, 1342683922, 1342683923, 1342683925, 1342683926, 1342683927, 1342683929, 1342683930, 1342683931, 1342683933, 1342683934, 1342684126, 1342684127, 1342684133, 1342684134, 1342684136, 1342684137, 1342684138, 1342684140, 1342684141, 1342684142, 1342684144, 1342684157, 1342684159, 1342684160, 1342684162, 1342684163, 1342684164, 1342684165, 1342684167, 1342684168, 1342684173] number of photos to traite : 210 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5446 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5227 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1912407875061035 time used to do the prediction : 0.9039483070373535 save descriptor for thcl : 3237 time to traite the descriptors : 1.4251811504364014 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1342683875 To insert : 1342683876 To insert : 1342683877 To insert : 1342683878 To insert : 1342683879 To insert : 1342683880 To insert : 1342683882 To insert : 1342683883 To insert : 1342683885 To insert : 1342683886 To insert : 1342683887 To insert : 1342683889 To insert : 1342683890 To insert : 1342683891 To insert : 1342683893 To insert : 1342683894 To insert : 1342683896 To insert : 1342683898 To insert : 1342683899 To insert : 1342683901 To insert : 1342683904 To insert : 1342684104 To insert : 1342684105 To insert : 1342684106 To insert : 1342684107 To insert : 1342684109 To insert : 1342684110 To insert : 1342684111 To insert : 1342684112 To insert : 1342684113 To insert : 1342684114 To insert : 1342684115 To insert : 1342684116 To insert : 1342684117 To insert : 1342684118 To insert : 1342684119 To insert : 1342684120 To insert : 1342684121 To insert : 1342684122 To insert : 1342684123 To insert : 1342684124 To insert : 1342684125 To insert : 1342684024 To insert : 1342684025 To insert : 1342684027 To insert : 1342684028 To insert : 1342684029 To insert : 1342684031 To insert : 1342684032 To insert : 1342684033 To insert : 1342684035 To insert : 1342684036 To insert : 1342684037 To insert : 1342684039 To insert : 1342684040 To insert : 1342684041 To insert : 1342684042 To insert : 1342684043 To insert : 1342684044 To insert : 1342684045 To insert : 1342684046 To insert : 1342684047 To insert : 1342684048 To insert : 1342684080 To insert : 1342684081 To insert : 1342684082 To insert : 1342684083 To insert : 1342684084 To insert : 1342684085 To insert : 1342684086 To insert : 1342684087 To insert : 1342684088 To insert : 1342684089 To insert : 1342684090 To insert : 1342684091 To insert : 1342684092 To insert : 1342684093 To insert : 1342684094 To insert : 1342684095 To insert : 1342684096 To insert : 1342684099 To insert : 1342684101 To insert : 1342684102 To insert : 1342684103 To insert : 1342683935 To insert : 1342683937 To insert : 1342683938 To insert : 1342683939 To insert : 1342683941 To insert : 1342683942 To insert : 1342683943 To insert : 1342683945 To insert : 1342683946 To insert : 1342683947 To insert : 1342683949 To insert : 1342683950 To insert : 1342683951 To insert : 1342683953 To insert : 1342683954 To insert : 1342683955 To insert : 1342683957 To insert : 1342683958 To insert : 1342683959 To insert : 1342683961 To insert : 1342683962 To insert : 1342683963 To insert : 1342683965 To insert : 1342683966 To insert : 1342683967 To insert : 1342683969 To insert : 1342683970 To insert : 1342683971 To insert : 1342683973 To insert : 1342683974 To insert : 1342683975 To insert : 1342683977 To insert : 1342683978 To insert : 1342683979 To insert : 1342683981 To insert : 1342683982 To insert : 1342683983 To insert : 1342683985 To insert : 1342683986 To insert : 1342683988 To insert : 1342683989 To insert : 1342683990 To insert : 1342683992 To insert : 1342683993 To insert : 1342683994 To insert : 1342683996 To insert : 1342683997 To insert : 1342683998 To insert : 1342684000 To insert : 1342684001 To insert : 1342684002 To insert : 1342684004 To insert : 1342684006 To insert : 1342684008 To insert : 1342684009 To insert : 1342684010 To insert : 1342684012 To insert : 1342684013 To insert : 1342684016 To insert : 1342684018 To insert : 1342684019 To insert : 1342684020 To insert : 1342684022 To insert : 1342684049 To insert : 1342684050 To insert : 1342684051 To insert : 1342684052 To insert : 1342684053 To insert : 1342684054 To insert : 1342684055 To insert : 1342684056 To insert : 1342684057 To insert : 1342684058 To insert : 1342684059 To insert : 1342684060 To insert : 1342684061 To insert : 1342684062 To insert : 1342684063 To insert : 1342684064 To insert : 1342684065 To insert : 1342684066 To insert : 1342684077 To insert : 1342684078 To insert : 1342684079 To insert : 1342683905 To insert : 1342683907 To insert : 1342683909 To insert : 1342683910 To insert : 1342683912 To insert : 1342683913 To insert : 1342683914 To insert : 1342683916 To insert : 1342683918 To insert : 1342683919 To insert : 1342683921 To insert : 1342683922 To insert : 1342683923 To insert : 1342683925 To insert : 1342683926 To insert : 1342683927 To insert : 1342683929 To insert : 1342683930 To insert : 1342683931 To insert : 1342683933 To insert : 1342683934 To insert : 1342684126 To insert : 1342684127 To insert : 1342684133 To insert : 1342684134 To insert : 1342684136 To insert : 1342684137 To insert : 1342684138 To insert : 1342684140 To insert : 1342684141 To insert : 1342684142 To insert : 1342684144 To insert : 1342684157 To insert : 1342684159 To insert : 1342684160 To insert : 1342684162 To insert : 1342684163 To insert : 1342684164 To insert : 1342684165 To insert : 1342684167 To insert : 1342684168 To insert : 1342684173 time to insert the descriptors : 37.87210988998413 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 308 time used for this insertion : 0.5045685768127441 save missing photos in datou_result : time spend for datou_step_exec : 47.301737785339355 time spend to save output : 0.5511960983276367 total time spend for step 6 : 47.85293388366699 step7:ventilate_hashtags_in_portfolio Mon Mar 10 22:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21243482 get user id for portfolio 21243482 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243482 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','PEHD','Papier','autre','pet_fonce','pet_clair','papier','refus','PET_clair','Carton','PET_fonce','metal','environnement','flou','Film_plastique','carton','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243482 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','PEHD','Papier','autre','pet_fonce','pet_clair','papier','refus','PET_clair','Carton','PET_fonce','metal','environnement','flou','Film_plastique','carton','Tetrapak')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243482 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','PEHD','Papier','autre','pet_fonce','pet_clair','papier','refus','PET_clair','Carton','PET_fonce','metal','environnement','flou','Film_plastique','carton','Tetrapak')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243482 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','PEHD','Papier','autre','pet_fonce','pet_clair','papier','refus','PET_clair','Carton','PET_fonce','metal','environnement','flou','Film_plastique','carton','Tetrapak')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21244822,21244821,21244829,21244824,21244837,21244833,21244831,21244847,21244839,21244841,21244843,21244845,21244848?tags=pehd,mal_croppe,papier,autre,pet_fonce,pet_clair,refus,carton,metal,environnement,flou,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=21243482 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 1 /21243482. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015742778778076172 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.9480204582214355 time spend to save output : 0.016010046005249023 total time spend for step 7 : 7.964030504226685 step8:final Mon Mar 10 22:23:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342585602: ('0.7725544308014027',)} new output for save of step final : {1342585602: ('0.7725544308014027',)} [1342585602] Looping around the photos to save general results len do output : 1 /1342585602.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012294769287109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.359729290008545 time spend to save output : 0.01256108283996582 total time spend for step 8 : 1.3722903728485107 step9:velours_tree Mon Mar 10 22:23:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21244822,21244821,21244829,21244824,21244837,21244833,21244831,21244847,21244839,21244841,21244843,21244845,21244848 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244822 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244821 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244829 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244824 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244837 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244833 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244831 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244847 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244839 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244841 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244843 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244845 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21244848 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 210 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 0 1 1 0 1 2 2 3 0 1 1 1 4 1 1 5 1 2 0 2 1 4 0 2 4 3 4 2 5 1 1 1 1 1 1 4 0 0 1 1 0 1 5 2 4 2 0 0 1 2 0 1 4 0 3 1 2 0 0 1 1 4 3 1 0 1 3 0 0 1 2 1 3 1 0 1 0 0 5 1 2 0 0 0 5 0 1 1 3 2 4 4 1 1 2 0 2 4 2 1 1 2 4 3 3 0 2 2 2 0 3 1 0 4 2 5 3 2 0 1 1 1 0 1 1 1 1 5 0 0 5 5 2 4 2 0 1 0 1 2 2 1 2 0 1 0 2 4 1 2 1 0 1 4 1 2 1 2 2 1 5 1 0 1 3 1 1 2 4 3 1 1 2 2 4 5 2 2 5 2 0 2 1 5 0 1 2 1 0 1 3 5 0 1 0 0 3 5 0 2 1 4 1 2 1 4 0 5 1] Elapsed time: 0.04570269584655762 graph_id used : 82557 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21244822,21244821,21244829,21244824,21244837,21244833,21244831,21244847,21244839,21244841,21244843,21244845,21244848?tags=pehd,mal_croppe,papier,autre,pet_fonce,pet_clair,refus,carton,metal,environnement,flou,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=21243482&tree_id=82557 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 1 /21243482Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.019992828369140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.656759023666382 time spend to save output : 0.020460844039916992 total time spend for step 9 : 17.6772198677063 step10:send_mail_cod Mon Mar 10 22:23:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf 21244788 imagette212447881741641801 21244787 imagette212447871741641801 21244793 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212447931741641801 21244790 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212447901741641802 21244797 change filename to text .imagette212447971741641802 21244795 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212447951741641802 21244794 imagette212447941741641803 21244802 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212448021741641803 21244798 imagette212447981741641803 21244800 imagette212448001741641803 21244801 imagette212448011741641803 21244803 imagette212448031741641803 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21243482 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21244822,21244821,21244829,21244824,21244837,21244833,21244831,21244847,21244839,21244841,21244843,21244845,21244848?tags=pehd,mal_croppe,papier,autre,pet_fonce,pet_clair,refus,carton,metal,environnement,flou,film_plastique,tetrapak&datou_id_consolidate=4235&port_consolidate=21243482&tree_id=82557 your option no_mail is active, we will not send the real mail to your client args[1342585602] : ((1342585602, -7.622747345911999, 492609224), (1342585602, 0.30111399544950707, 2107752395), '0.7725544308014027') We are sending mail with results at cod@fotonower.com refus_total : 0.7725544308014027 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21243482 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21243482','results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf','pdf','','0.12','0.7725544308014027') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 2.932920217514038 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.788132905960083 time spend to save output : 2.9331939220428467 total time spend for step 10 : 6.72132682800293 step11:split_time_score Mon Mar 10 22:23:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10032025 21243482 Nombre de photos uploadées : 1 / 23040 (0%) 10032025 21243482 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 10032025 21243482 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.5020370483398438e-05 ? elapsed_time : fill_and_build_computed_from_old_data 0.00020766258239746094 elapsed_time : insert_dashboard_record_day_entry 0.031401634216308594 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243440 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243446 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243452 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243479 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243480 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243481 order by id desc limit 1 Qualite : 0.7725544308014027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243482_10-03-2025_22_23_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243482 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243482 AND mptpi.`type`=4230 To do Qualite : 0.8419982158060035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243483_10-03-2025_22_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243483 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243483 AND mptpi.`type`=4230 To do Qualite : 0.8529070030224067 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243484_10-03-2025_21_59_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243484 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243484 AND mptpi.`type`=4230 To do Qualite : 0.8959614648624126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21243485_10-03-2025_22_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21243485 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21243485 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10032025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342585602] Looping around the photos to save general results len do output : 1 /21243482Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2655802') ('4234', '21243482', '1342585602', None, None, None, None, None, '2655802') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012462854385375977 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.897149801254272 time spend to save output : 0.012767791748046875 total time spend for step 11 : 11.90991759300232 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 39.01user 23.46system 3:12.39elapsed 32%CPU (0avgtext+0avgdata 2479104maxresident)k 1129984inputs+13848outputs (14800major+3285134minor)pagefaults 0swaps