python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1106775 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2538751'] with mtr_portfolio_ids : ['20164380'] and first list_photo_ids : [] new path : /proc/1106775/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.15378546714782715 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 3 03:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-03 03:20:33.650134: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-03 03:20:33.679597: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-03 03:20:33.681543: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f87ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-03 03:20:33.681607: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-03 03:20:33.685129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-03 03:20:34.005519: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x26d15720 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-03 03:20:34.005593: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-03 03:20:34.007092: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 03:20:34.007572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 03:20:34.010920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 03:20:34.014024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 03:20:34.014566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 03:20:34.017588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 03:20:34.018632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 03:20:34.023255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 03:20:34.024869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 03:20:34.024946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 03:20:34.025681: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 03:20:34.025696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 03:20:34.025705: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 03:20:34.026969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-03 03:20:34.279110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 03:20:34.279229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 03:20:34.279251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 03:20:34.279270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 03:20:34.279288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 03:20:34.279306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 03:20:34.279339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 03:20:34.279358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 03:20:34.280917: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 03:20:34.282415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 03:20:34.282449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 03:20:34.282467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 03:20:34.282484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 03:20:34.282501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 03:20:34.282517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 03:20:34.282534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 03:20:34.282551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 03:20:34.284110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 03:20:34.284148: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 03:20:34.284157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 03:20:34.284164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 03:20:34.285361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-03 03:20:41.604360: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 03:20:41.834588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0005540847778320312 length of segment : 21 time for calcul the mask position with numpy : 0.0004942417144775391 nb_pixel_total : 26908 time to create 1 rle with old method : 0.05022454261779785 length of segment : 192 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013065338134765625 length of segment : 23 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 21 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00022411346435546875 length of segment : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001926422119140625 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.07109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005459785461425781 length of segment : 23 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006315708160400391 length of segment : 16 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 19 time for calcul the mask position with numpy : 0.0003345012664794922 nb_pixel_total : 28978 time to create 1 rle with old method : 0.03307509422302246 length of segment : 126 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.00047659873962402344 length of segment : 17 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001270771026611328 length of segment : 18 time for calcul the mask position with numpy : 0.00020956993103027344 nb_pixel_total : 15331 time to create 1 rle with old method : 0.01700758934020996 length of segment : 132 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.02813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2452 time to create 1 rle with old method : 0.003003835678100586 length of segment : 60 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 3213 time to create 1 rle with old method : 0.003859996795654297 length of segment : 115 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00028634071350097656 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00044798851013183594 length of segment : 26 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1284 time to create 1 rle with old method : 0.0016298294067382812 length of segment : 31 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.0012943744659423828 length of segment : 39 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 580 time to create 1 rle with old method : 0.0007963180541992188 length of segment : 29 time for calcul the mask position with numpy : 0.0004627704620361328 nb_pixel_total : 44223 time to create 1 rle with old method : 0.059244394302368164 length of segment : 144 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.00034999847412109375 length of segment : 27 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00033020973205566406 length of segment : 17 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001735687255859375 length of segment : 9 time for calcul the mask position with numpy : 0.0003428459167480469 nb_pixel_total : 25955 time to create 1 rle with old method : 0.027384281158447266 length of segment : 166 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 17 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009503364562988281 length of segment : 26 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005557537078857422 length of segment : 23 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007951259613037109 length of segment : 30 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005805492401123047 length of segment : 20 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 753 time to create 1 rle with old method : 0.0009944438934326172 length of segment : 32 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 23 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.00176239013671875 length of segment : 32 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011777877807617188 length of segment : 8 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005581378936767578 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00039649009704589844 length of segment : 21 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0015213489532470703 length of segment : 31 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0011055469512939453 length of segment : 35 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 50 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0010249614715576172 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.31328 max: 150.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 24 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.000537872314453125 length of segment : 27 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 23 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1128 time to create 1 rle with old method : 0.0015056133270263672 length of segment : 88 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0010867118835449219 length of segment : 26 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 2119 time to create 1 rle with old method : 0.002577543258666992 length of segment : 77 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 167.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 57.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011560916900634766 nb_pixel_total : 20801 time to create 1 rle with old method : 0.025038957595825195 length of segment : 410 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.43047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0012722015380859375 length of segment : 29 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0009140968322753906 length of segment : 27 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0008940696716308594 length of segment : 21 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0009717941284179688 length of segment : 19 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 632 time to create 1 rle with old method : 0.0024912357330322266 length of segment : 33 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0005781650543212891 length of segment : 36 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0014369487762451172 length of segment : 21 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00024390220642089844 length of segment : 23 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0010831356048583984 length of segment : 24 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0007345676422119141 length of segment : 19 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0004904270172119141 length of segment : 22 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005133152008056641 length of segment : 20 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005276203155517578 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00040411949157714844 length of segment : 17 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1117 time to create 1 rle with old method : 0.0014579296112060547 length of segment : 33 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005190372467041016 length of segment : 20 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00048613548278808594 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.09063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 4510 time to create 1 rle with old method : 0.0054318904876708984 length of segment : 93 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0009369850158691406 length of segment : 34 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 824 time to create 1 rle with old method : 0.0010378360748291016 length of segment : 39 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005102157592773438 length of segment : 30 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 23 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.000492095947265625 length of segment : 16 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005397796630859375 length of segment : 24 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0013756752014160156 length of segment : 54 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004773139953613281 length of segment : 23 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0011510848999023438 length of segment : 50 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 14 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0016045570373535156 length of segment : 49 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003180503845214844 length of segment : 23 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1154 time to create 1 rle with old method : 0.0014274120330810547 length of segment : 42 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1992 time to create 1 rle with old method : 0.002351045608520508 length of segment : 63 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005741119384765625 length of segment : 27 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 26 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007240772247314453 length of segment : 58 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.0011060237884521484 length of segment : 36 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0015168190002441406 length of segment : 39 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0012154579162597656 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.76250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 21 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0016357898712158203 length of segment : 44 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 26 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0013580322265625 length of segment : 41 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0023114681243896484 length of segment : 31 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002358675003051758 length of segment : 39 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012736320495605469 length of segment : 30 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0009541511535644531 length of segment : 39 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0012912750244140625 length of segment : 33 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010802745819091797 length of segment : 37 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 10 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002868175506591797 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006363391876220703 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00034427642822265625 length of segment : 25 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 13 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1655 time to create 1 rle with old method : 0.0019202232360839844 length of segment : 61 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0012831687927246094 length of segment : 55 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0011157989501953125 length of segment : 45 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 18 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.0009677410125732422 length of segment : 43 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1840 time to create 1 rle with old method : 0.0022950172424316406 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.000560760498046875 length of segment : 34 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0019559860229492188 length of segment : 65 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0007693767547607422 length of segment : 41 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00018453598022460938 length of segment : 12 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012753009796142578 length of segment : 38 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0019330978393554688 length of segment : 28 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005278587341308594 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004184246063232422 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.000644683837890625 length of segment : 20 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010521411895751953 length of segment : 40 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004088878631591797 length of segment : 18 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0016968250274658203 length of segment : 48 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 18 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005340576171875 length of segment : 38 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00032639503479003906 length of segment : 18 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002415180206298828 length of segment : 21 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009372234344482422 length of segment : 43 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002846717834472656 length of segment : 19 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0015921592712402344 length of segment : 50 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1283 time to create 1 rle with old method : 0.0016069412231445312 length of segment : 36 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0008611679077148438 length of segment : 21 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 3205 time to create 1 rle with old method : 0.005498409271240234 length of segment : 59 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 22 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2768 time to create 1 rle with old method : 0.004613399505615234 length of segment : 75 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0006964206695556641 length of segment : 16 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0010645389556884766 length of segment : 27 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 528 time to create 1 rle with old method : 0.0009784698486328125 length of segment : 31 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0007176399230957031 length of segment : 28 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0008840560913085938 length of segment : 20 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0022745132446289062 length of segment : 35 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0011034011840820312 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.79766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 30 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004119873046875 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004127025604248047 length of segment : 28 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 23 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1534 time to create 1 rle with old method : 0.0019550323486328125 length of segment : 50 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002892017364501953 length of segment : 25 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2638 time to create 1 rle with old method : 0.003226757049560547 length of segment : 60 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016546249389648438 length of segment : 12 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 19 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0009112358093261719 length of segment : 25 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0012714862823486328 length of segment : 33 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 36 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 25 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1658 time to create 1 rle with old method : 0.001994609832763672 length of segment : 62 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002703666687011719 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 25 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.00047588348388671875 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0010323524475097656 length of segment : 33 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 4724 time to create 1 rle with old method : 0.005412578582763672 length of segment : 91 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0012922286987304688 length of segment : 22 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 21 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014464855194091797 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1184 time to create 1 rle with old method : 0.0015938282012939453 length of segment : 33 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0009953975677490234 length of segment : 29 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0006642341613769531 length of segment : 21 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006291866302490234 length of segment : 38 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003390312194824219 length of segment : 21 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 993 time to create 1 rle with old method : 0.0012531280517578125 length of segment : 39 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005085468292236328 length of segment : 31 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0008516311645507812 length of segment : 52 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011773109436035156 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.000362396240234375 length of segment : 22 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1945 time to create 1 rle with old method : 0.0023696422576904297 length of segment : 70 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006549358367919922 length of segment : 25 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006172657012939453 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 19 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 2056 time to create 1 rle with old method : 0.003131389617919922 length of segment : 82 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005195140838623047 length of segment : 27 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00034117698669433594 length of segment : 21 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 235.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 1490 time to create 1 rle with old method : 0.002439260482788086 length of segment : 85 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.15313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0014443397521972656 length of segment : 56 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002079010009765625 length of segment : 7 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004413127899169922 length of segment : 21 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007293224334716797 length of segment : 34 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 17 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007898807525634766 length of segment : 39 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.00046443939208984375 length of segment : 20 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005879402160644531 length of segment : 13 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.00042724609375 length of segment : 21 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 12 time for calcul the mask position with numpy : 2.6702880859375e-05 nb_pixel_total : 34 time to create 1 rle with old method : 8.034706115722656e-05 length of segment : 6 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004756450653076172 length of segment : 22 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0008189678192138672 length of segment : 33 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002789497375488281 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.10234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008676052093505859 length of segment : 19 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009126663208007812 length of segment : 44 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 32 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 28 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004513263702392578 length of segment : 45 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.00034332275390625 length of segment : 19 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 35 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 27 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 20 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1217 time to create 1 rle with old method : 0.0015630722045898438 length of segment : 45 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006971359252929688 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001609325408935547 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00039124488830566406 length of segment : 23 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00024008750915527344 length of segment : 21 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00018978118896484375 length of segment : 23 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00016236305236816406 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003643035888671875 length of segment : 17 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025177001953125 length of segment : 17 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00023818016052246094 length of segment : 15 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00035572052001953125 length of segment : 20 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 44 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.000431060791015625 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00037860870361328125 length of segment : 15 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005216598510742188 length of segment : 27 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.06719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 960 time to create 1 rle with old method : 0.0011446475982666016 length of segment : 47 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 20 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005817413330078125 length of segment : 23 time for calcul the mask position with numpy : 0.0001556873321533203 nb_pixel_total : 5698 time to create 1 rle with old method : 0.006801128387451172 length of segment : 143 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0012080669403076172 length of segment : 22 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010149478912353516 length of segment : 40 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003590583801269531 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005319118499755859 length of segment : 31 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005319118499755859 length of segment : 19 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005266666412353516 length of segment : 38 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.000972747802734375 length of segment : 57 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 15 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0024976730346679688 length of segment : 38 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002884864807128906 length of segment : 39 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 21 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.00093841552734375 length of segment : 45 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2962 time to create 1 rle with old method : 0.003378152847290039 length of segment : 64 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003376007080078125 length of segment : 19 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 7 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00037860870361328125 length of segment : 22 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.0012085437774658203 length of segment : 31 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 3292 time to create 1 rle with old method : 0.0037806034088134766 length of segment : 68 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 799 time to create 1 rle with old method : 0.0010421276092529297 length of segment : 43 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006237030029296875 length of segment : 31 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005657672882080078 length of segment : 24 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009312629699707031 length of segment : 73 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00010919570922851562 length of segment : 8 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005967617034912109 length of segment : 26 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00014972686767578125 length of segment : 11 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2359 time to create 1 rle with old method : 0.0026726722717285156 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 34 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.000530242919921875 length of segment : 22 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2369 time to create 1 rle with old method : 0.0027060508728027344 length of segment : 60 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004222393035888672 length of segment : 29 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004532337188720703 length of segment : 21 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0013573169708251953 length of segment : 47 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 3975 time to create 1 rle with old method : 0.0056362152099609375 length of segment : 74 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004787445068359375 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 32 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1549 time to create 1 rle with old method : 0.001840353012084961 length of segment : 39 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 835 time to create 1 rle with old method : 0.0010311603546142578 length of segment : 39 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1689 time to create 1 rle with old method : 0.001922607421875 length of segment : 58 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 35 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1955 time to create 1 rle with old method : 0.0024237632751464844 length of segment : 50 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0005838871002197266 length of segment : 43 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00036525726318359375 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006525516510009766 length of segment : 34 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004680156707763672 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003387928009033203 length of segment : 30 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2071 time to create 1 rle with old method : 0.0022394657135009766 length of segment : 54 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005512237548828125 length of segment : 23 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0008869171142578125 length of segment : 45 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005748271942138672 length of segment : 30 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0019643306732177734 length of segment : 63 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002944469451904297 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002281665802001953 length of segment : 14 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005314350128173828 length of segment : 72 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0010738372802734375 length of segment : 31 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 31 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00021648406982421875 length of segment : 15 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.0001430511474609375 length of segment : 18 time for calcul the mask position with numpy : 2.5987625122070312e-05 nb_pixel_total : 66 time to create 1 rle with old method : 0.00010657310485839844 length of segment : 8 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001456737518310547 length of segment : 15 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002808570861816406 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.82109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 49 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0013823509216308594 length of segment : 47 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1545 time to create 1 rle with old method : 0.001867532730102539 length of segment : 41 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1908 time to create 1 rle with old method : 0.0023496150970458984 length of segment : 68 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0009350776672363281 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.17656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.0002529621124267578 length of segment : 18 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.000946044921875 length of segment : 41 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00011420249938964844 length of segment : 14 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 3659 time to create 1 rle with old method : 0.004078388214111328 length of segment : 88 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004513263702392578 length of segment : 28 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006799697875976562 length of segment : 27 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2686 time to create 1 rle with old method : 0.003155946731567383 length of segment : 82 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 3320 time to create 1 rle with old method : 0.0037674903869628906 length of segment : 82 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006153583526611328 length of segment : 32 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 2352 time to create 1 rle with old method : 0.002767324447631836 length of segment : 49 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2826 time to create 1 rle with old method : 0.003331899642944336 length of segment : 82 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 179.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.51016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 36 time to create 1 rle with old method : 0.00015044212341308594 length of segment : 11 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00023293495178222656 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 12 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1620 time to create 1 rle with old method : 0.0019953250885009766 length of segment : 26 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0006175041198730469 length of segment : 12 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002319812774658203 length of segment : 29 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009071826934814453 length of segment : 27 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00021314620971679688 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 21 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 22 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0016865730285644531 length of segment : 49 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0013875961303710938 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006093978881835938 length of segment : 52 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.000202178955078125 length of segment : 22 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011529922485351562 length of segment : 35 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00029659271240234375 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007109642028808594 length of segment : 35 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 25 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 16 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005767345428466797 length of segment : 31 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.000247955322265625 length of segment : 10 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009205341339111328 length of segment : 28 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00012230873107910156 length of segment : 15 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 21 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1179 time to create 1 rle with old method : 0.0015354156494140625 length of segment : 60 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00021982192993164062 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 21 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020456314086914062 length of segment : 13 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003476142883300781 length of segment : 20 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006732940673828125 length of segment : 29 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0011563301086425781 length of segment : 35 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 16 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008904933929443359 length of segment : 32 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.00044918060302734375 length of segment : 26 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00041294097900390625 length of segment : 27 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 20 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 3149 time to create 1 rle with old method : 0.0036382675170898438 length of segment : 68 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0014884471893310547 length of segment : 59 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0014798641204833984 length of segment : 43 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00030422210693359375 length of segment : 30 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 9 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0014319419860839844 length of segment : 31 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002276897430419922 length of segment : 16 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1849 time to create 1 rle with old method : 0.002061605453491211 length of segment : 51 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00023698806762695312 length of segment : 15 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0013058185577392578 length of segment : 37 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0015070438385009766 length of segment : 22 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 3200 time to create 1 rle with old method : 0.003672361373901367 length of segment : 72 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0013804435729980469 length of segment : 38 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.001392364501953125 length of segment : 41 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005993843078613281 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 25 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1596 time to create 1 rle with old method : 0.002012491226196289 length of segment : 26 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1901 time to create 1 rle with old method : 0.0022978782653808594 length of segment : 47 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 40623 time to create 1 rle with old method : 0.05111837387084961 length of segment : 250 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1906 time to create 1 rle with old method : 0.0023860931396484375 length of segment : 47 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.51547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 14 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00017118453979492188 length of segment : 40 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001285076141357422 length of segment : 18 Detection mask done ! Trying to reset tf kernel 1107349 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4577 tf kernel not reseted sub process len(results) : 360 len(list_Values) 360 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 360 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 452 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 4122 save missing photos in datou_result : time spend for datou_step_exec : 22.29492688179016 time spend to save output : 0.9768168926239014 total time spend for step 1 : 23.271743774414062 step2:brightness Mon Feb 3 03:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.008931875228881836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.007915258407592773 save missing photos in datou_result : time spend for datou_step_exec : 0.025689363479614258 time spend to save output : 0.020879507064819336 total time spend for step 2 : 0.046568870544433594 step3:blur_detection Mon Feb 3 03:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.007928133010864258 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.007987499237060547 save missing photos in datou_result : time spend for datou_step_exec : 0.021151065826416016 time spend to save output : 0.019843578338623047 total time spend for step 3 : 0.04099464416503906 step4:rle_unique_nms_with_priority Mon Feb 3 03:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 452 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 441 nb_hashtags : 7 time to prepare the origin masks : 1.8278453350067139 time for calcul the mask position with numpy : 0.0984811782836914 nb_pixel_total : 3294705 time to create 1 rle with new method : 0.7871654033660889 time for calcul the mask position with numpy : 0.015156745910644531 nb_pixel_total : 20741 time to create 1 rle with old method : 0.027815580368041992 time for calcul the mask position with numpy : 0.015347957611083984 nb_pixel_total : 87 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.015159368515014648 nb_pixel_total : 5385 time to create 1 rle with old method : 0.006804227828979492 time for calcul the mask position with numpy : 0.015140771865844727 nb_pixel_total : 26715 time to create 1 rle with old method : 0.03391623497009277 time for calcul the mask position with numpy : 0.015176773071289062 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003063678741455078 time for calcul the mask position with numpy : 0.015194892883300781 nb_pixel_total : 1 time to create 1 rle with old method : 1.3828277587890625e-05 time for calcul the mask position with numpy : 0.015140771865844727 nb_pixel_total : 777 time to create 1 rle with old method : 0.0008928775787353516 time for calcul the mask position with numpy : 0.015074491500854492 nb_pixel_total : 1286 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.015038728713989258 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007050037384033203 time for calcul the mask position with numpy : 0.015060901641845703 nb_pixel_total : 16 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.015101909637451172 nb_pixel_total : 115 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.015244722366333008 nb_pixel_total : 41319 time to create 1 rle with old method : 0.04686617851257324 time for calcul the mask position with numpy : 0.01485300064086914 nb_pixel_total : 428 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.014751195907592773 nb_pixel_total : 869 time to create 1 rle with old method : 0.0009109973907470703 time for calcul the mask position with numpy : 0.01476144790649414 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004570484161376953 time for calcul the mask position with numpy : 0.015490293502807617 nb_pixel_total : 8 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.015341997146606445 nb_pixel_total : 9 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.015087604522705078 nb_pixel_total : 1128 time to create 1 rle with old method : 0.001401662826538086 time for calcul the mask position with numpy : 0.01541447639465332 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006690025329589844 time for calcul the mask position with numpy : 0.01575446128845215 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.015106439590454102 nb_pixel_total : 62 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.015004634857177734 nb_pixel_total : 25 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.015116453170776367 nb_pixel_total : 1338 time to create 1 rle with old method : 0.0016283988952636719 time for calcul the mask position with numpy : 0.014995574951171875 nb_pixel_total : 266 time to create 1 rle with old method : 0.00030040740966796875 time for calcul the mask position with numpy : 0.014896392822265625 nb_pixel_total : 3 time to create 1 rle with old method : 1.0967254638671875e-05 time for calcul the mask position with numpy : 0.015199899673461914 nb_pixel_total : 226 time to create 1 rle with old method : 0.0004229545593261719 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 308 time to create 1 rle with old method : 0.00037550926208496094 time for calcul the mask position with numpy : 0.0151824951171875 nb_pixel_total : 22 time to create 1 rle with old method : 5.054473876953125e-05 time for calcul the mask position with numpy : 0.015120506286621094 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004646778106689453 time for calcul the mask position with numpy : 0.01481938362121582 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.015070676803588867 nb_pixel_total : 28068 time to create 1 rle with old method : 0.03037548065185547 time for calcul the mask position with numpy : 0.014681577682495117 nb_pixel_total : 2488 time to create 1 rle with old method : 0.0027458667755126953 time for calcul the mask position with numpy : 0.014436006546020508 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.014816522598266602 nb_pixel_total : 580 time to create 1 rle with old method : 0.0006716251373291016 time for calcul the mask position with numpy : 0.014583826065063477 nb_pixel_total : 2454 time to create 1 rle with old method : 0.002649068832397461 time for calcul the mask position with numpy : 0.01494455337524414 nb_pixel_total : 10 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.01702117919921875 nb_pixel_total : 753 time to create 1 rle with old method : 0.0008978843688964844 time for calcul the mask position with numpy : 0.014801740646362305 nb_pixel_total : 32 time to create 1 rle with old method : 6.461143493652344e-05 time for calcul the mask position with numpy : 0.014307022094726562 nb_pixel_total : 1 time to create 1 rle with old method : 1.33514404296875e-05 time for calcul the mask position with numpy : 0.014394998550415039 nb_pixel_total : 2300 time to create 1 rle with old method : 0.002528667449951172 time for calcul the mask position with numpy : 0.014253616333007812 nb_pixel_total : 376 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.014637231826782227 nb_pixel_total : 22 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.014801502227783203 nb_pixel_total : 321 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.014473676681518555 nb_pixel_total : 983 time to create 1 rle with old method : 0.0010960102081298828 time for calcul the mask position with numpy : 0.014266252517700195 nb_pixel_total : 232 time to create 1 rle with old method : 0.000270843505859375 time for calcul the mask position with numpy : 0.014819860458374023 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0023412704467773438 time for calcul the mask position with numpy : 0.014711618423461914 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002346038818359375 time for calcul the mask position with numpy : 0.015009641647338867 nb_pixel_total : 992 time to create 1 rle with old method : 0.0011134147644042969 time for calcul the mask position with numpy : 0.014222383499145508 nb_pixel_total : 27 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.014440536499023438 nb_pixel_total : 738 time to create 1 rle with old method : 0.0008244514465332031 time for calcul the mask position with numpy : 0.014627456665039062 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.014199495315551758 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003304481506347656 time for calcul the mask position with numpy : 0.014689922332763672 nb_pixel_total : 11 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.01469874382019043 nb_pixel_total : 118 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.014495134353637695 nb_pixel_total : 14 time to create 1 rle with old method : 3.0517578125e-05 time for calcul the mask position with numpy : 0.014531850814819336 nb_pixel_total : 94 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.014411449432373047 nb_pixel_total : 404 time to create 1 rle with old method : 0.0004918575286865234 time for calcul the mask position with numpy : 0.014985799789428711 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.01460123062133789 nb_pixel_total : 1 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.014943361282348633 nb_pixel_total : 117 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.014185905456542969 nb_pixel_total : 320 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.014008522033691406 nb_pixel_total : 1 time to create 1 rle with old method : 8.106231689453125e-06 time for calcul the mask position with numpy : 0.014203310012817383 nb_pixel_total : 1183 time to create 1 rle with old method : 0.0012927055358886719 time for calcul the mask position with numpy : 0.014417886734008789 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005066394805908203 time for calcul the mask position with numpy : 0.01430964469909668 nb_pixel_total : 184 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.0189816951751709 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004436969757080078 time for calcul the mask position with numpy : 0.014886856079101562 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003337860107421875 time for calcul the mask position with numpy : 0.015114784240722656 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005064010620117188 time for calcul the mask position with numpy : 0.014570951461791992 nb_pixel_total : 6 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.014447212219238281 nb_pixel_total : 585 time to create 1 rle with old method : 0.0006451606750488281 time for calcul the mask position with numpy : 0.014639616012573242 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0013802051544189453 time for calcul the mask position with numpy : 0.014083147048950195 nb_pixel_total : 229 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.014079570770263672 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003104209899902344 time for calcul the mask position with numpy : 0.014228105545043945 nb_pixel_total : 3 time to create 1 rle with old method : 1.6689300537109375e-05 time for calcul the mask position with numpy : 0.014416933059692383 nb_pixel_total : 184 time to create 1 rle with old method : 0.00019598007202148438 time for calcul the mask position with numpy : 0.014585733413696289 nb_pixel_total : 956 time to create 1 rle with old method : 0.0010960102081298828 time for calcul the mask position with numpy : 0.014267683029174805 nb_pixel_total : 206 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.014139175415039062 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002448558807373047 time for calcul the mask position with numpy : 0.013944387435913086 nb_pixel_total : 226 time to create 1 rle with old method : 0.00026726722717285156 time for calcul the mask position with numpy : 0.01416468620300293 nb_pixel_total : 759 time to create 1 rle with old method : 0.0007822513580322266 time for calcul the mask position with numpy : 0.013893842697143555 nb_pixel_total : 449 time to create 1 rle with old method : 0.0010640621185302734 time for calcul the mask position with numpy : 0.014019012451171875 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004277229309082031 time for calcul the mask position with numpy : 0.014117717742919922 nb_pixel_total : 236 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.01484537124633789 nb_pixel_total : 13 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.01429128646850586 nb_pixel_total : 327 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.014354228973388672 nb_pixel_total : 1949 time to create 1 rle with old method : 0.002004384994506836 time for calcul the mask position with numpy : 0.014331579208374023 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.014605283737182617 nb_pixel_total : 288 time to create 1 rle with old method : 0.00034999847412109375 time for calcul the mask position with numpy : 0.014828205108642578 nb_pixel_total : 20 time to create 1 rle with old method : 6.103515625e-05 time for calcul the mask position with numpy : 0.014437437057495117 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004391670227050781 time for calcul the mask position with numpy : 0.014513969421386719 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.017358779907226562 nb_pixel_total : 328 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.014444351196289062 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003650188446044922 time for calcul the mask position with numpy : 0.014594793319702148 nb_pixel_total : 874 time to create 1 rle with old method : 0.0009441375732421875 time for calcul the mask position with numpy : 0.014292716979980469 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005071163177490234 time for calcul the mask position with numpy : 0.013909578323364258 nb_pixel_total : 924 time to create 1 rle with old method : 0.001043081283569336 time for calcul the mask position with numpy : 0.014307975769042969 nb_pixel_total : 253 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.01382756233215332 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002143383026123047 time for calcul the mask position with numpy : 0.014706134796142578 nb_pixel_total : 267 time to create 1 rle with old method : 0.0002841949462890625 time for calcul the mask position with numpy : 0.014588117599487305 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005605220794677734 time for calcul the mask position with numpy : 0.014470100402832031 nb_pixel_total : 235 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.013993263244628906 nb_pixel_total : 325 time to create 1 rle with old method : 0.0003521442413330078 time for calcul the mask position with numpy : 0.01397252082824707 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001232624053955078 time for calcul the mask position with numpy : 0.01411294937133789 nb_pixel_total : 466 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.014182806015014648 nb_pixel_total : 859 time to create 1 rle with old method : 0.0009419918060302734 time for calcul the mask position with numpy : 0.014521121978759766 nb_pixel_total : 202 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.01405644416809082 nb_pixel_total : 9 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.014198064804077148 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.014389276504516602 nb_pixel_total : 43 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.014888525009155273 nb_pixel_total : 637 time to create 1 rle with old method : 0.0007965564727783203 time for calcul the mask position with numpy : 0.015110015869140625 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0014765262603759766 time for calcul the mask position with numpy : 0.014197587966918945 nb_pixel_total : 287 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.01439213752746582 nb_pixel_total : 632 time to create 1 rle with old method : 0.0007059574127197266 time for calcul the mask position with numpy : 0.013940811157226562 nb_pixel_total : 813 time to create 1 rle with old method : 0.0008273124694824219 time for calcul the mask position with numpy : 0.013881444931030273 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002536773681640625 time for calcul the mask position with numpy : 0.01410818099975586 nb_pixel_total : 4 time to create 1 rle with old method : 1.6689300537109375e-05 time for calcul the mask position with numpy : 0.01423335075378418 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003204345703125 time for calcul the mask position with numpy : 0.014645099639892578 nb_pixel_total : 407 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.014484405517578125 nb_pixel_total : 353 time to create 1 rle with old method : 0.00040149688720703125 time for calcul the mask position with numpy : 0.017330646514892578 nb_pixel_total : 101 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.015053033828735352 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004127025604248047 time for calcul the mask position with numpy : 0.014718294143676758 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.014755487442016602 nb_pixel_total : 5 time to create 1 rle with old method : 3.6716461181640625e-05 time for calcul the mask position with numpy : 0.014968633651733398 nb_pixel_total : 2 time to create 1 rle with old method : 2.3126602172851562e-05 time for calcul the mask position with numpy : 0.01703476905822754 nb_pixel_total : 2054 time to create 1 rle with old method : 0.0023887157440185547 time for calcul the mask position with numpy : 0.014460563659667969 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006129741668701172 time for calcul the mask position with numpy : 0.014565467834472656 nb_pixel_total : 4724 time to create 1 rle with old method : 0.004822492599487305 time for calcul the mask position with numpy : 0.014739751815795898 nb_pixel_total : 341 time to create 1 rle with old method : 0.0003943443298339844 time for calcul the mask position with numpy : 0.014776945114135742 nb_pixel_total : 555 time to create 1 rle with old method : 0.0006542205810546875 time for calcul the mask position with numpy : 0.014372587203979492 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003211498260498047 time for calcul the mask position with numpy : 0.014370441436767578 nb_pixel_total : 827 time to create 1 rle with old method : 0.0009539127349853516 time for calcul the mask position with numpy : 0.014384984970092773 nb_pixel_total : 12 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.015147686004638672 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.014493703842163086 nb_pixel_total : 466 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.014342784881591797 nb_pixel_total : 8 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.014312982559204102 nb_pixel_total : 2637 time to create 1 rle with old method : 0.0027098655700683594 time for calcul the mask position with numpy : 0.014261484146118164 nb_pixel_total : 2769 time to create 1 rle with old method : 0.003011465072631836 time for calcul the mask position with numpy : 0.014232873916625977 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002636909484863281 time for calcul the mask position with numpy : 0.014250755310058594 nb_pixel_total : 34 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.014119625091552734 nb_pixel_total : 823 time to create 1 rle with old method : 0.0008966922760009766 time for calcul the mask position with numpy : 0.014584779739379883 nb_pixel_total : 329 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.014285087585449219 nb_pixel_total : 1893 time to create 1 rle with old method : 0.0021016597747802734 time for calcul the mask position with numpy : 0.01456141471862793 nb_pixel_total : 41 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.014206647872924805 nb_pixel_total : 12 time to create 1 rle with old method : 2.5033950805664062e-05 time for calcul the mask position with numpy : 0.01440739631652832 nb_pixel_total : 315 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.014524221420288086 nb_pixel_total : 16 time to create 1 rle with old method : 8.678436279296875e-05 time for calcul the mask position with numpy : 0.014840126037597656 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0018537044525146484 time for calcul the mask position with numpy : 0.014443397521972656 nb_pixel_total : 7 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.014590263366699219 nb_pixel_total : 2 time to create 1 rle with old method : 1.811981201171875e-05 time for calcul the mask position with numpy : 0.014744997024536133 nb_pixel_total : 24 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.014652729034423828 nb_pixel_total : 4522 time to create 1 rle with old method : 0.00492548942565918 time for calcul the mask position with numpy : 0.01586604118347168 nb_pixel_total : 444 time to create 1 rle with old method : 0.0008678436279296875 time for calcul the mask position with numpy : 0.014582395553588867 nb_pixel_total : 41 time to create 1 rle with old method : 7.700920104980469e-05 time for calcul the mask position with numpy : 0.014609336853027344 nb_pixel_total : 573 time to create 1 rle with old method : 0.0006608963012695312 time for calcul the mask position with numpy : 0.015113353729248047 nb_pixel_total : 21 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.014862298965454102 nb_pixel_total : 1283 time to create 1 rle with old method : 0.001333475112915039 time for calcul the mask position with numpy : 0.02069544792175293 nb_pixel_total : 7 time to create 1 rle with old method : 7.581710815429688e-05 time for calcul the mask position with numpy : 0.01465606689453125 nb_pixel_total : 1533 time to create 1 rle with old method : 0.0017254352569580078 time for calcul the mask position with numpy : 0.015119075775146484 nb_pixel_total : 1992 time to create 1 rle with old method : 0.002150297164916992 time for calcul the mask position with numpy : 0.014412164688110352 nb_pixel_total : 1658 time to create 1 rle with old method : 0.0017445087432861328 time for calcul the mask position with numpy : 0.014451980590820312 nb_pixel_total : 43 time to create 1 rle with old method : 8.0108642578125e-05 time for calcul the mask position with numpy : 0.014097213745117188 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0010340213775634766 time for calcul the mask position with numpy : 0.013975381851196289 nb_pixel_total : 444 time to create 1 rle with old method : 0.000514984130859375 time for calcul the mask position with numpy : 0.014009475708007812 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0018122196197509766 time for calcul the mask position with numpy : 0.014403343200683594 nb_pixel_total : 1487 time to create 1 rle with old method : 0.0016717910766601562 time for calcul the mask position with numpy : 0.01433253288269043 nb_pixel_total : 756 time to create 1 rle with old method : 0.0007975101470947266 time for calcul the mask position with numpy : 0.013990402221679688 nb_pixel_total : 3204 time to create 1 rle with old method : 0.003255128860473633 time for calcul the mask position with numpy : 0.014119625091552734 nb_pixel_total : 158 time to create 1 rle with old method : 0.0001842975616455078 time for calcul the mask position with numpy : 0.014176607131958008 nb_pixel_total : 56 time to create 1 rle with old method : 0.0001304149627685547 time for calcul the mask position with numpy : 0.014366388320922852 nb_pixel_total : 697 time to create 1 rle with old method : 0.0007352828979492188 time for calcul the mask position with numpy : 0.014371871948242188 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0011303424835205078 time for calcul the mask position with numpy : 0.014189720153808594 nb_pixel_total : 13 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.014330387115478516 nb_pixel_total : 859 time to create 1 rle with old method : 0.0008885860443115234 time for calcul the mask position with numpy : 0.014297008514404297 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.0149993896484375 nb_pixel_total : 10 time to create 1 rle with old method : 3.62396240234375e-05 time for calcul the mask position with numpy : 0.014287233352661133 nb_pixel_total : 171 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.014058113098144531 nb_pixel_total : 993 time to create 1 rle with old method : 0.0011353492736816406 time for calcul the mask position with numpy : 0.014452219009399414 nb_pixel_total : 866 time to create 1 rle with old method : 0.0009152889251708984 time for calcul the mask position with numpy : 0.014022588729858398 nb_pixel_total : 7 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.01406097412109375 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.013999223709106445 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005013942718505859 time for calcul the mask position with numpy : 0.014356851577758789 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0015931129455566406 time for calcul the mask position with numpy : 0.014390230178833008 nb_pixel_total : 528 time to create 1 rle with old method : 0.0005581378936767578 time for calcul the mask position with numpy : 0.014312267303466797 nb_pixel_total : 41 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.014252662658691406 nb_pixel_total : 1655 time to create 1 rle with old method : 0.0016906261444091797 time for calcul the mask position with numpy : 0.014444828033447266 nb_pixel_total : 772 time to create 1 rle with old method : 0.000885009765625 time for calcul the mask position with numpy : 0.014600753784179688 nb_pixel_total : 1197 time to create 1 rle with old method : 0.001386404037475586 time for calcul the mask position with numpy : 0.014834403991699219 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004451274871826172 time for calcul the mask position with numpy : 0.014489889144897461 nb_pixel_total : 425 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.014261722564697266 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0013184547424316406 time for calcul the mask position with numpy : 0.0144500732421875 nb_pixel_total : 7 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.014900922775268555 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002830028533935547 time for calcul the mask position with numpy : 0.014434337615966797 nb_pixel_total : 1317 time to create 1 rle with old method : 0.001519918441772461 time for calcul the mask position with numpy : 0.01454305648803711 nb_pixel_total : 271 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.014847993850708008 nb_pixel_total : 33 time to create 1 rle with old method : 8.392333984375e-05 time for calcul the mask position with numpy : 0.014808177947998047 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003666877746582031 time for calcul the mask position with numpy : 0.014635562896728516 nb_pixel_total : 697 time to create 1 rle with old method : 0.0007946491241455078 time for calcul the mask position with numpy : 0.014765024185180664 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0011792182922363281 time for calcul the mask position with numpy : 0.014671564102172852 nb_pixel_total : 408 time to create 1 rle with old method : 0.00048232078552246094 time for calcul the mask position with numpy : 0.01471853256225586 nb_pixel_total : 362 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.01441502571105957 nb_pixel_total : 14 time to create 1 rle with old method : 3.4332275390625e-05 time for calcul the mask position with numpy : 0.014282703399658203 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009315013885498047 time for calcul the mask position with numpy : 0.014597892761230469 nb_pixel_total : 1117 time to create 1 rle with old method : 0.001216888427734375 time for calcul the mask position with numpy : 0.014905929565429688 nb_pixel_total : 20 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.01454925537109375 nb_pixel_total : 1055 time to create 1 rle with old method : 0.0010998249053955078 time for calcul the mask position with numpy : 0.014462947845458984 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005841255187988281 time for calcul the mask position with numpy : 0.013905525207519531 nb_pixel_total : 86 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.014111995697021484 nb_pixel_total : 695 time to create 1 rle with old method : 0.0007767677307128906 time for calcul the mask position with numpy : 0.01406097412109375 nb_pixel_total : 258 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.01399683952331543 nb_pixel_total : 37 time to create 1 rle with old method : 7.796287536621094e-05 time for calcul the mask position with numpy : 0.014684200286865234 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004258155822753906 time for calcul the mask position with numpy : 0.014521121978759766 nb_pixel_total : 4 time to create 1 rle with old method : 2.956390380859375e-05 time for calcul the mask position with numpy : 0.014143228530883789 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005371570587158203 time for calcul the mask position with numpy : 0.014312744140625 nb_pixel_total : 107 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.014434814453125 nb_pixel_total : 158 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.014659404754638672 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003485679626464844 time for calcul the mask position with numpy : 0.015159368515014648 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.014848947525024414 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003597736358642578 time for calcul the mask position with numpy : 0.015186309814453125 nb_pixel_total : 36 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.01517033576965332 nb_pixel_total : 112 time to create 1 rle with old method : 0.00015020370483398438 time for calcul the mask position with numpy : 0.015117645263671875 nb_pixel_total : 590 time to create 1 rle with old method : 0.000705718994140625 time for calcul the mask position with numpy : 0.015119791030883789 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.015138387680053711 nb_pixel_total : 58 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.015249967575073242 nb_pixel_total : 49 time to create 1 rle with old method : 0.00014019012451171875 time for calcul the mask position with numpy : 0.015040159225463867 nb_pixel_total : 726 time to create 1 rle with old method : 0.0008847713470458984 time for calcul the mask position with numpy : 0.015095233917236328 nb_pixel_total : 10 time to create 1 rle with old method : 3.314018249511719e-05 time for calcul the mask position with numpy : 0.015146493911743164 nb_pixel_total : 60 time to create 1 rle with old method : 9.393692016601562e-05 time for calcul the mask position with numpy : 0.01477670669555664 nb_pixel_total : 329 time to create 1 rle with old method : 0.00039577484130859375 time for calcul the mask position with numpy : 0.015121221542358398 nb_pixel_total : 632 time to create 1 rle with old method : 0.0007796287536621094 time for calcul the mask position with numpy : 0.01500391960144043 nb_pixel_total : 183 time to create 1 rle with old method : 0.00022602081298828125 time for calcul the mask position with numpy : 0.015410423278808594 nb_pixel_total : 350 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.016118764877319336 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0012485980987548828 time for calcul the mask position with numpy : 0.015077352523803711 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006268024444580078 time for calcul the mask position with numpy : 0.01638650894165039 nb_pixel_total : 79 time to create 1 rle with old method : 0.00016164779663085938 time for calcul the mask position with numpy : 0.016497135162353516 nb_pixel_total : 1545 time to create 1 rle with old method : 0.0018153190612792969 time for calcul the mask position with numpy : 0.01514577865600586 nb_pixel_total : 14 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.014521360397338867 nb_pixel_total : 244 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.015234231948852539 nb_pixel_total : 92 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.014777898788452148 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.015150785446166992 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005033016204833984 time for calcul the mask position with numpy : 0.015230655670166016 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.015163421630859375 nb_pixel_total : 742 time to create 1 rle with old method : 0.0008900165557861328 time for calcul the mask position with numpy : 0.01538848876953125 nb_pixel_total : 398 time to create 1 rle with old method : 0.00048065185546875 time for calcul the mask position with numpy : 0.015338420867919922 nb_pixel_total : 951 time to create 1 rle with old method : 0.001165628433227539 time for calcul the mask position with numpy : 0.0153656005859375 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.016539335250854492 nb_pixel_total : 659 time to create 1 rle with old method : 0.0007863044738769531 time for calcul the mask position with numpy : 0.0161588191986084 nb_pixel_total : 1101 time to create 1 rle with old method : 0.0014750957489013672 time for calcul the mask position with numpy : 0.01576995849609375 nb_pixel_total : 42 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.01771068572998047 nb_pixel_total : 94 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.01861119270324707 nb_pixel_total : 931 time to create 1 rle with old method : 0.0016329288482666016 time for calcul the mask position with numpy : 0.01960468292236328 nb_pixel_total : 775 time to create 1 rle with old method : 0.0016162395477294922 time for calcul the mask position with numpy : 0.01974940299987793 nb_pixel_total : 294 time to create 1 rle with old method : 0.0005922317504882812 time for calcul the mask position with numpy : 0.020194292068481445 nb_pixel_total : 34 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.01991891860961914 nb_pixel_total : 6 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.018976926803588867 nb_pixel_total : 5697 time to create 1 rle with old method : 0.006684780120849609 time for calcul the mask position with numpy : 0.015149831771850586 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.015308856964111328 nb_pixel_total : 240 time to create 1 rle with old method : 0.00030684471130371094 time for calcul the mask position with numpy : 0.015465497970581055 nb_pixel_total : 2369 time to create 1 rle with old method : 0.0026552677154541016 time for calcul the mask position with numpy : 0.015533685684204102 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007140636444091797 time for calcul the mask position with numpy : 0.015744447708129883 nb_pixel_total : 64 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.015559911727905273 nb_pixel_total : 1619 time to create 1 rle with old method : 0.002512693405151367 time for calcul the mask position with numpy : 0.015168905258178711 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005083084106445312 time for calcul the mask position with numpy : 0.015147686004638672 nb_pixel_total : 324 time to create 1 rle with old method : 0.00038433074951171875 time for calcul the mask position with numpy : 0.014760255813598633 nb_pixel_total : 138 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.015106678009033203 nb_pixel_total : 220 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.014922142028808594 nb_pixel_total : 260 time to create 1 rle with old method : 0.00031828880310058594 time for calcul the mask position with numpy : 0.015105247497558594 nb_pixel_total : 86 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.015094518661499023 nb_pixel_total : 810 time to create 1 rle with old method : 0.0009102821350097656 time for calcul the mask position with numpy : 0.015076160430908203 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002627372741699219 time for calcul the mask position with numpy : 0.015051603317260742 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006322860717773438 time for calcul the mask position with numpy : 0.015106439590454102 nb_pixel_total : 2069 time to create 1 rle with old method : 0.002403736114501953 time for calcul the mask position with numpy : 0.015156745910644531 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003612041473388672 time for calcul the mask position with numpy : 0.01506805419921875 nb_pixel_total : 610 time to create 1 rle with old method : 0.0006983280181884766 time for calcul the mask position with numpy : 0.0150909423828125 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.014835357666015625 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009362697601318359 time for calcul the mask position with numpy : 0.014474630355834961 nb_pixel_total : 1955 time to create 1 rle with old method : 0.002100229263305664 time for calcul the mask position with numpy : 0.014799833297729492 nb_pixel_total : 168 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.014881372451782227 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002841949462890625 time for calcul the mask position with numpy : 0.015178918838500977 nb_pixel_total : 799 time to create 1 rle with old method : 0.0009119510650634766 time for calcul the mask position with numpy : 0.015093564987182617 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003829002380371094 time for calcul the mask position with numpy : 0.015064001083374023 nb_pixel_total : 12 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.015110254287719727 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004324913024902344 time for calcul the mask position with numpy : 0.015056371688842773 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005199909210205078 time for calcul the mask position with numpy : 0.014959573745727539 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.014994621276855469 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0014064311981201172 time for calcul the mask position with numpy : 0.015109539031982422 nb_pixel_total : 277 time to create 1 rle with old method : 0.00040650367736816406 time for calcul the mask position with numpy : 0.015234231948852539 nb_pixel_total : 1907 time to create 1 rle with old method : 0.0022737979888916016 time for calcul the mask position with numpy : 0.015073537826538086 nb_pixel_total : 742 time to create 1 rle with old method : 0.0008409023284912109 time for calcul the mask position with numpy : 0.015081167221069336 nb_pixel_total : 398 time to create 1 rle with old method : 0.00048089027404785156 time for calcul the mask position with numpy : 0.014926433563232422 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.014321327209472656 nb_pixel_total : 2684 time to create 1 rle with old method : 0.002997159957885742 time for calcul the mask position with numpy : 0.014933347702026367 nb_pixel_total : 252 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.015396356582641602 nb_pixel_total : 858 time to create 1 rle with old method : 0.0009701251983642578 time for calcul the mask position with numpy : 0.01503133773803711 nb_pixel_total : 786 time to create 1 rle with old method : 0.0008914470672607422 time for calcul the mask position with numpy : 0.015053033828735352 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.015097618103027344 nb_pixel_total : 1174 time to create 1 rle with old method : 0.001333475112915039 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.015253782272338867 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006430149078369141 time for calcul the mask position with numpy : 0.015220403671264648 nb_pixel_total : 701 time to create 1 rle with old method : 0.00087738037109375 time for calcul the mask position with numpy : 0.014724016189575195 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.014894962310791016 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008914470672607422 time for calcul the mask position with numpy : 0.014997482299804688 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007786750793457031 time for calcul the mask position with numpy : 0.015056371688842773 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.015061378479003906 nb_pixel_total : 345 time to create 1 rle with old method : 0.0003972053527832031 time for calcul the mask position with numpy : 0.01502537727355957 nb_pixel_total : 2359 time to create 1 rle with old method : 0.0026688575744628906 time for calcul the mask position with numpy : 0.015097379684448242 nb_pixel_total : 2962 time to create 1 rle with old method : 0.003403902053833008 time for calcul the mask position with numpy : 0.015099525451660156 nb_pixel_total : 154 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.01753711700439453 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0018455982208251953 time for calcul the mask position with numpy : 0.015026092529296875 nb_pixel_total : 3658 time to create 1 rle with old method : 0.004118919372558594 time for calcul the mask position with numpy : 0.014706134796142578 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.015071868896484375 nb_pixel_total : 419 time to create 1 rle with old method : 0.00047326087951660156 time for calcul the mask position with numpy : 0.014588594436645508 nb_pixel_total : 312 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.015027761459350586 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005843639373779297 time for calcul the mask position with numpy : 0.015070915222167969 nb_pixel_total : 16 time to create 1 rle with old method : 5.316734313964844e-05 time for calcul the mask position with numpy : 0.015026569366455078 nb_pixel_total : 85 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.015165567398071289 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006337165832519531 time for calcul the mask position with numpy : 0.017306804656982422 nb_pixel_total : 1690 time to create 1 rle with old method : 0.001979827880859375 time for calcul the mask position with numpy : 0.015044689178466797 nb_pixel_total : 281 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.014762401580810547 nb_pixel_total : 7 time to create 1 rle with old method : 3.504753112792969e-05 time for calcul the mask position with numpy : 0.014236927032470703 nb_pixel_total : 2351 time to create 1 rle with old method : 0.0025997161865234375 time for calcul the mask position with numpy : 0.014770984649658203 nb_pixel_total : 809 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.015084981918334961 nb_pixel_total : 154 time to create 1 rle with old method : 0.0001971721649169922 time for calcul the mask position with numpy : 0.015064239501953125 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004329681396484375 time for calcul the mask position with numpy : 0.015287637710571289 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003285408020019531 time for calcul the mask position with numpy : 0.015120267868041992 nb_pixel_total : 1216 time to create 1 rle with old method : 0.001407623291015625 time for calcul the mask position with numpy : 0.015128612518310547 nb_pixel_total : 3 time to create 1 rle with old method : 1.8596649169921875e-05 time for calcul the mask position with numpy : 0.014818191528320312 nb_pixel_total : 3661 time to create 1 rle with old method : 0.0038204193115234375 time for calcul the mask position with numpy : 0.014606714248657227 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.015119552612304688 nb_pixel_total : 255 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.01507568359375 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004258155822753906 time for calcul the mask position with numpy : 0.015027999877929688 nb_pixel_total : 66 time to create 1 rle with old method : 9.059906005859375e-05 time for calcul the mask position with numpy : 0.01503300666809082 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004277229309082031 time for calcul the mask position with numpy : 0.015032768249511719 nb_pixel_total : 393 time to create 1 rle with old method : 0.00046515464782714844 time for calcul the mask position with numpy : 0.015067577362060547 nb_pixel_total : 29 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.014969825744628906 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002758502960205078 time for calcul the mask position with numpy : 0.015085697174072266 nb_pixel_total : 891 time to create 1 rle with old method : 0.0010399818420410156 time for calcul the mask position with numpy : 0.015063285827636719 nb_pixel_total : 322 time to create 1 rle with old method : 0.00037741661071777344 time for calcul the mask position with numpy : 0.015026569366455078 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004711151123046875 time for calcul the mask position with numpy : 0.015052556991577148 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.015067815780639648 nb_pixel_total : 204 time to create 1 rle with old method : 0.00025773048400878906 time for calcul the mask position with numpy : 0.014600276947021484 nb_pixel_total : 20 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.015070915222167969 nb_pixel_total : 76 time to create 1 rle with old method : 0.00010895729064941406 time for calcul the mask position with numpy : 0.01512455940246582 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008533000946044922 time for calcul the mask position with numpy : 0.015140533447265625 nb_pixel_total : 787 time to create 1 rle with old method : 0.0009248256683349609 time for calcul the mask position with numpy : 0.015041351318359375 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.014852285385131836 nb_pixel_total : 1596 time to create 1 rle with old method : 0.0016934871673583984 time for calcul the mask position with numpy : 0.014401674270629883 nb_pixel_total : 1277 time to create 1 rle with old method : 0.001398324966430664 time for calcul the mask position with numpy : 0.014828205108642578 nb_pixel_total : 239 time to create 1 rle with old method : 0.00028705596923828125 time for calcul the mask position with numpy : 0.01505732536315918 nb_pixel_total : 113 time to create 1 rle with old method : 0.00019788742065429688 time for calcul the mask position with numpy : 0.015072822570800781 nb_pixel_total : 1902 time to create 1 rle with old method : 0.0021882057189941406 time for calcul the mask position with numpy : 0.014993906021118164 nb_pixel_total : 1509 time to create 1 rle with old method : 0.0019042491912841797 time for calcul the mask position with numpy : 0.01525115966796875 nb_pixel_total : 40018 time to create 1 rle with old method : 0.042611122131347656 time for calcul the mask position with numpy : 0.019587993621826172 nb_pixel_total : 7 time to create 1 rle with old method : 3.981590270996094e-05 time for calcul the mask position with numpy : 0.014057397842407227 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0019252300262451172 time for calcul the mask position with numpy : 0.015099287033081055 nb_pixel_total : 127 time to create 1 rle with old method : 0.00021958351135253906 time for calcul the mask position with numpy : 0.015204429626464844 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008707046508789062 time for calcul the mask position with numpy : 0.015375614166259766 nb_pixel_total : 13 time to create 1 rle with old method : 7.367134094238281e-05 time for calcul the mask position with numpy : 0.015034675598144531 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.015135049819946289 nb_pixel_total : 23 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.015093564987182617 nb_pixel_total : 899 time to create 1 rle with old method : 0.0010898113250732422 time for calcul the mask position with numpy : 0.014715433120727539 nb_pixel_total : 334 time to create 1 rle with old method : 0.0003848075866699219 time for calcul the mask position with numpy : 0.015038490295410156 nb_pixel_total : 48 time to create 1 rle with old method : 9.465217590332031e-05 time for calcul the mask position with numpy : 0.015084028244018555 nb_pixel_total : 879 time to create 1 rle with old method : 0.0009894371032714844 time for calcul the mask position with numpy : 0.015090703964233398 nb_pixel_total : 21 time to create 1 rle with old method : 4.5299530029296875e-05 time for calcul the mask position with numpy : 0.014998674392700195 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.015069246292114258 nb_pixel_total : 3149 time to create 1 rle with old method : 0.0035109519958496094 time for calcul the mask position with numpy : 0.014931678771972656 nb_pixel_total : 312 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.014631986618041992 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.014318466186523438 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.014267206192016602 nb_pixel_total : 144 time to create 1 rle with old method : 0.00017571449279785156 time for calcul the mask position with numpy : 0.01420736312866211 nb_pixel_total : 173 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.014506816864013672 nb_pixel_total : 48 time to create 1 rle with old method : 9.846687316894531e-05 time for calcul the mask position with numpy : 0.014976024627685547 nb_pixel_total : 5 time to create 1 rle with old method : 2.1457672119140625e-05 time for calcul the mask position with numpy : 0.015716552734375 nb_pixel_total : 183 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.017540931701660156 nb_pixel_total : 20 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.015102386474609375 nb_pixel_total : 3 time to create 1 rle with old method : 1.6450881958007812e-05 time for calcul the mask position with numpy : 0.015230894088745117 nb_pixel_total : 162 time to create 1 rle with old method : 0.00020122528076171875 time for calcul the mask position with numpy : 0.014491558074951172 nb_pixel_total : 317 time to create 1 rle with old method : 0.0003647804260253906 time for calcul the mask position with numpy : 0.014675378799438477 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002117156982421875 time for calcul the mask position with numpy : 0.014997720718383789 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005402565002441406 time for calcul the mask position with numpy : 0.015059471130371094 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011324882507324219 time for calcul the mask position with numpy : 0.015068292617797852 nb_pixel_total : 2 time to create 1 rle with old method : 2.4318695068359375e-05 time for calcul the mask position with numpy : 0.015062570571899414 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.015094757080078125 nb_pixel_total : 1 time to create 1 rle with old method : 1.2636184692382812e-05 time for calcul the mask position with numpy : 0.015573501586914062 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0012378692626953125 time for calcul the mask position with numpy : 0.015196561813354492 nb_pixel_total : 23 time to create 1 rle with old method : 6.437301635742188e-05 time for calcul the mask position with numpy : 0.015198230743408203 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003762245178222656 time for calcul the mask position with numpy : 0.015182733535766602 nb_pixel_total : 8 time to create 1 rle with old method : 3.933906555175781e-05 time for calcul the mask position with numpy : 0.015032768249511719 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004343986511230469 time for calcul the mask position with numpy : 0.015105009078979492 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.014284849166870117 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003483295440673828 time for calcul the mask position with numpy : 0.014830589294433594 nb_pixel_total : 17 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.015027999877929688 nb_pixel_total : 2 time to create 1 rle with old method : 1.3828277587890625e-05 time for calcul the mask position with numpy : 0.015028953552246094 nb_pixel_total : 513 time to create 1 rle with old method : 0.0005946159362792969 time for calcul the mask position with numpy : 0.015084981918334961 nb_pixel_total : 19 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.01515507698059082 nb_pixel_total : 102 time to create 1 rle with old method : 0.00018358230590820312 time for calcul the mask position with numpy : 0.01522374153137207 nb_pixel_total : 16 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.015107393264770508 nb_pixel_total : 18 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.015112876892089844 nb_pixel_total : 3 time to create 1 rle with old method : 1.9550323486328125e-05 time for calcul the mask position with numpy : 0.014634370803833008 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.014389991760253906 nb_pixel_total : 10 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.014900445938110352 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.014446496963500977 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002968311309814453 time for calcul the mask position with numpy : 0.01507711410522461 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0012652873992919922 time for calcul the mask position with numpy : 0.015105485916137695 nb_pixel_total : 32 time to create 1 rle with old method : 6.890296936035156e-05 time for calcul the mask position with numpy : 0.015106678009033203 nb_pixel_total : 6 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.015071630477905273 nb_pixel_total : 9 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.014996767044067383 nb_pixel_total : 14 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.014617919921875 nb_pixel_total : 1031 time to create 1 rle with old method : 0.001203298568725586 time for calcul the mask position with numpy : 0.014844179153442383 nb_pixel_total : 6 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.014900922775268555 nb_pixel_total : 331 time to create 1 rle with old method : 0.00037670135498046875 time for calcul the mask position with numpy : 0.014685630798339844 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004885196685791016 time for calcul the mask position with numpy : 0.014342069625854492 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.014243841171264648 nb_pixel_total : 45 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.013719797134399414 nb_pixel_total : 153 time to create 1 rle with old method : 0.00016808509826660156 time for calcul the mask position with numpy : 0.013569116592407227 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0011796951293945312 time for calcul the mask position with numpy : 0.014093399047851562 nb_pixel_total : 48 time to create 1 rle with old method : 8.630752563476562e-05 time for calcul the mask position with numpy : 0.014110565185546875 nb_pixel_total : 428 time to create 1 rle with old method : 0.0004475116729736328 time for calcul the mask position with numpy : 0.013845443725585938 nb_pixel_total : 32 time to create 1 rle with old method : 8.225440979003906e-05 time for calcul the mask position with numpy : 0.013555765151977539 nb_pixel_total : 131 time to create 1 rle with old method : 0.00014662742614746094 time for calcul the mask position with numpy : 0.01348257064819336 nb_pixel_total : 10 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.013518571853637695 nb_pixel_total : 2 time to create 1 rle with old method : 1.3113021850585938e-05 time for calcul the mask position with numpy : 0.01351618766784668 nb_pixel_total : 12 time to create 1 rle with old method : 2.956390380859375e-05 time for calcul the mask position with numpy : 0.013750314712524414 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005156993865966797 time for calcul the mask position with numpy : 0.013418197631835938 nb_pixel_total : 292 time to create 1 rle with old method : 0.00032448768615722656 time for calcul the mask position with numpy : 0.013994693756103516 nb_pixel_total : 53 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.01381540298461914 nb_pixel_total : 990 time to create 1 rle with old method : 0.0010764598846435547 time for calcul the mask position with numpy : 0.0136871337890625 nb_pixel_total : 41 time to create 1 rle with old method : 7.748603820800781e-05 time for calcul the mask position with numpy : 0.019702911376953125 nb_pixel_total : 333 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.014012575149536133 nb_pixel_total : 9 time to create 1 rle with old method : 2.765655517578125e-05 time for calcul the mask position with numpy : 0.013875722885131836 nb_pixel_total : 8 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.014290094375610352 nb_pixel_total : 115 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.01392984390258789 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.014204978942871094 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.014345169067382812 nb_pixel_total : 1 time to create 1 rle with old method : 1.1920928955078125e-05 time for calcul the mask position with numpy : 0.013666629791259766 nb_pixel_total : 254 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.014401912689208984 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.014126062393188477 nb_pixel_total : 99 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.015651941299438477 nb_pixel_total : 1620 time to create 1 rle with old method : 0.0017864704132080078 time for calcul the mask position with numpy : 0.014649152755737305 nb_pixel_total : 51 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.014261722564697266 nb_pixel_total : 356 time to create 1 rle with old method : 0.000392913818359375 create new chi : 7.935479640960693 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.014417886734008789 batch 1 Loaded 484 chid ids of type : 4230 Number RLEs to save : 25872 TO DO : save crop sub photo not yet done ! save time : 4.608858823776245 map_output_result : {1334037689: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 1 /1334037689.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013238668441772461 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.665288209915161 time spend to save output : 0.013498783111572266 total time spend for step 4 : 14.678786993026733 step5:crop_condition Mon Feb 3 03:21:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 484 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 285 About to insert : list_path_to_insert length 285 new photo from crops ! About to upload 285 photos upload in portfolio : 4869462 init cache_photo without model_param we have 285 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738549274_1106775 we have uploaded 285 photos in the portfolio 4869462 time of upload the photos Elapsed time : 66.17382955551147 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4869462 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738549341_1106775 we have uploaded 45 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.980382204055786 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738549354_1106775 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.6083321571350098 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738549357_1106775 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9121825695037842 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 341 /1334063554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334063976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334064102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1024 time used for this insertion : 0.08284258842468262 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.67645049095154 time spend to save output : 0.09386324882507324 total time spend for step 5 : 88.77031373977661 step6:thcl Mon Feb 3 03:22:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.013538360595703125 time to convert the images to numpy array : 0.06399106979370117 time to import caffe and check if the image exist : 0.026031970977783203 time to convert the images to numpy array : 0.08191919326782227 time to import caffe and check if the image exist : 0.03281998634338379 time to convert the images to numpy array : 0.08718013763427734 time to import caffe and check if the image exist : 0.03415822982788086 time to convert the images to numpy array : 0.09458637237548828 time to import caffe and check if the image exist : 0.02745652198791504 time to convert the images to numpy array : 0.1066732406616211 time to import caffe and check if the image exist : 0.028005361557006836 time to convert the images to numpy array : 0.1085360050201416 time to import caffe and check if the image exist : 0.05282950401306152 time to convert the images to numpy array : 0.08833551406860352 time to import caffe and check if the image exist : 0.03056025505065918 time to convert the images to numpy array : 0.11558222770690918 time to import caffe and check if the image exist : 0.05981040000915527 time to convert the images to numpy array : 0.08478116989135742 time to import caffe and check if the image exist : 0.03781390190124512 time to convert the images to numpy array : 0.10898518562316895 total time to convert the images to numpy array : 0.40377092361450195 list photo_ids error: [] list photo_ids correct : [1334064076, 1334064077, 1334064078, 1334064079, 1334064080, 1334064081, 1334064082, 1334064083, 1334064084, 1334064085, 1334064086, 1334064087, 1334064088, 1334064089, 1334064090, 1334064091, 1334064092, 1334064093, 1334064094, 1334064096, 1334064097, 1334064098, 1334064099, 1334064100, 1334064101, 1334064102, 1334063856, 1334063857, 1334063858, 1334063859, 1334063860, 1334063861, 1334063862, 1334063863, 1334063864, 1334063865, 1334063866, 1334063867, 1334063868, 1334063869, 1334063870, 1334063871, 1334063872, 1334063873, 1334063874, 1334063875, 1334063876, 1334063877, 1334063878, 1334063879, 1334063880, 1334063881, 1334063882, 1334063883, 1334063884, 1334063886, 1334063887, 1334063888, 1334063889, 1334063890, 1334063891, 1334063624, 1334063626, 1334063628, 1334063630, 1334063632, 1334063634, 1334063636, 1334063638, 1334063640, 1334063642, 1334063644, 1334063646, 1334063648, 1334063650, 1334063652, 1334063654, 1334063656, 1334063658, 1334063660, 1334063662, 1334063664, 1334063666, 1334063668, 1334063670, 1334063672, 1334063674, 1334063677, 1334063679, 1334063681, 1334063683, 1334063685, 1334063687, 1334063689, 1334063691, 1334063693, 1334063695, 1334063697, 1334063699, 1334063701, 1334063704, 1334063706, 1334063708, 1334063710, 1334063712, 1334063714, 1334063716, 1334063718, 1334063720, 1334063722, 1334063724, 1334063726, 1334063728, 1334063730, 1334063732, 1334063734, 1334063736, 1334063738, 1334063740, 1334063742, 1334063744, 1334063746, 1334063748, 1334063750, 1334063752, 1334063754, 1334063756, 1334063758, 1334063760, 1334063762, 1334063764, 1334063766, 1334063768, 1334063770, 1334063772, 1334063774, 1334063776, 1334063778, 1334063780, 1334063782, 1334063784, 1334063786, 1334063788, 1334063790, 1334063792, 1334063794, 1334063796, 1334063798, 1334063800, 1334063802, 1334063803, 1334063804, 1334063805, 1334063806, 1334063807, 1334063808, 1334063809, 1334063811, 1334063812, 1334063813, 1334063814, 1334063815, 1334063816, 1334063817, 1334063818, 1334063819, 1334063968, 1334063970, 1334063972, 1334063974, 1334063976, 1334064046, 1334064047, 1334064048, 1334064049, 1334064050, 1334064051, 1334064052, 1334064053, 1334064054, 1334064055, 1334064056, 1334064057, 1334064058, 1334064059, 1334064060, 1334064061, 1334064062, 1334064063, 1334064064, 1334064065, 1334064066, 1334064067, 1334064068, 1334064069, 1334064070, 1334064071, 1334064072, 1334064073, 1334064074, 1334064075, 1334063892, 1334063893, 1334063894, 1334063895, 1334063896, 1334063897, 1334063898, 1334063899, 1334063900, 1334063901, 1334063902, 1334063903, 1334063904, 1334063905, 1334063906, 1334063907, 1334063908, 1334063909, 1334063910, 1334063911, 1334063912, 1334063913, 1334063914, 1334063915, 1334063916, 1334063917, 1334063918, 1334063919, 1334063920, 1334063921, 1334063922, 1334063923, 1334063924, 1334063925, 1334063926, 1334063554, 1334063556, 1334063558, 1334063560, 1334063562, 1334063564, 1334063566, 1334063568, 1334063570, 1334063572, 1334063574, 1334063576, 1334063578, 1334063580, 1334063582, 1334063584, 1334063586, 1334063588, 1334063590, 1334063592, 1334063594, 1334063596, 1334063598, 1334063600, 1334063602, 1334063604, 1334063606, 1334063608, 1334063610, 1334063612, 1334063614, 1334063616, 1334063618, 1334063620, 1334063622, 1334063927, 1334063928, 1334063929, 1334063930, 1334063931, 1334063932, 1334063933, 1334063934, 1334063935, 1334063936, 1334063937, 1334063938, 1334063939, 1334063940, 1334063941, 1334063942, 1334063943, 1334063944, 1334063945, 1334063946, 1334063947, 1334063948, 1334063950, 1334063951, 1334063952, 1334063953, 1334063954, 1334063955, 1334063956, 1334063957, 1334063958, 1334063959, 1334063961, 1334063963, 1334063965, 1334063820, 1334063821, 1334063822, 1334063823, 1334063824, 1334063825, 1334063826, 1334063827, 1334063828, 1334063829, 1334063830, 1334063831, 1334063832, 1334063833, 1334063834, 1334063835, 1334063836, 1334063837, 1334063838, 1334063839, 1334063840, 1334063841, 1334063842, 1334063843, 1334063844, 1334063845, 1334063847, 1334063848, 1334063849, 1334063850, 1334063851, 1334063852, 1334063853, 1334063854, 1334063855] number of photos to traite : 341 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.505690574645996 time used to do the prediction : 1.2039079666137695 save descriptor for thcl : 3237 time to traite the descriptors : 1.9124515056610107 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1334064076 To insert : 1334064077 To insert : 1334064078 To insert : 1334064079 To insert : 1334064080 To insert : 1334064081 To insert : 1334064082 To insert : 1334064083 To insert : 1334064084 To insert : 1334064085 To insert : 1334064086 To insert : 1334064087 To insert : 1334064088 To insert : 1334064089 To insert : 1334064090 To insert : 1334064091 To insert : 1334064092 To insert : 1334064093 To insert : 1334064094 To insert : 1334064096 To insert : 1334064097 To insert : 1334064098 To insert : 1334064099 To insert : 1334064100 To insert : 1334064101 To insert : 1334064102 To insert : 1334063856 To insert : 1334063857 To insert : 1334063858 To insert : 1334063859 To insert : 1334063860 To insert : 1334063861 To insert : 1334063862 To insert : 1334063863 To insert : 1334063864 To insert : 1334063865 To insert : 1334063866 To insert : 1334063867 To insert : 1334063868 To insert : 1334063869 To insert : 1334063870 To insert : 1334063871 To insert : 1334063872 To insert : 1334063873 To insert : 1334063874 To insert : 1334063875 To insert : 1334063876 To insert : 1334063877 To insert : 1334063878 To insert : 1334063879 To insert : 1334063880 To insert : 1334063881 To insert : 1334063882 To insert : 1334063883 To insert : 1334063884 To insert : 1334063886 To insert : 1334063887 To insert : 1334063888 To insert : 1334063889 To insert : 1334063890 To insert : 1334063891 To insert : 1334063624 To insert : 1334063626 To insert : 1334063628 To insert : 1334063630 To insert : 1334063632 To insert : 1334063634 To insert : 1334063636 To insert : 1334063638 To insert : 1334063640 To insert : 1334063642 To insert : 1334063644 To insert : 1334063646 To insert : 1334063648 To insert : 1334063650 To insert : 1334063652 To insert : 1334063654 To insert : 1334063656 To insert : 1334063658 To insert : 1334063660 To insert : 1334063662 To insert : 1334063664 To insert : 1334063666 To insert : 1334063668 To insert : 1334063670 To insert : 1334063672 To insert : 1334063674 To insert : 1334063677 To insert : 1334063679 To insert : 1334063681 To insert : 1334063683 To insert : 1334063685 To insert : 1334063687 To insert : 1334063689 To insert : 1334063691 To insert : 1334063693 To insert : 1334063695 To insert : 1334063697 To insert : 1334063699 To insert : 1334063701 To insert : 1334063704 To insert : 1334063706 To insert : 1334063708 To insert : 1334063710 To insert : 1334063712 To insert : 1334063714 To insert : 1334063716 To insert : 1334063718 To insert : 1334063720 To insert : 1334063722 To insert : 1334063724 To insert : 1334063726 To insert : 1334063728 To insert : 1334063730 To insert : 1334063732 To insert : 1334063734 To insert : 1334063736 To insert : 1334063738 To insert : 1334063740 To insert : 1334063742 To insert : 1334063744 To insert : 1334063746 To insert : 1334063748 To insert : 1334063750 To insert : 1334063752 To insert : 1334063754 To insert : 1334063756 To insert : 1334063758 To insert : 1334063760 To insert : 1334063762 To insert : 1334063764 To insert : 1334063766 To insert : 1334063768 To insert : 1334063770 To insert : 1334063772 To insert : 1334063774 To insert : 1334063776 To insert : 1334063778 To insert : 1334063780 To insert : 1334063782 To insert : 1334063784 To insert : 1334063786 To insert : 1334063788 To insert : 1334063790 To insert : 1334063792 To insert : 1334063794 To insert : 1334063796 To insert : 1334063798 To insert : 1334063800 To insert : 1334063802 To insert : 1334063803 To insert : 1334063804 To insert : 1334063805 To insert : 1334063806 To insert : 1334063807 To insert : 1334063808 To insert : 1334063809 To insert : 1334063811 To insert : 1334063812 To insert : 1334063813 To insert : 1334063814 To insert : 1334063815 To insert : 1334063816 To insert : 1334063817 To insert : 1334063818 To insert : 1334063819 To insert : 1334063968 To insert : 1334063970 To insert : 1334063972 To insert : 1334063974 To insert : 1334063976 To insert : 1334064046 To insert : 1334064047 To insert : 1334064048 To insert : 1334064049 To insert : 1334064050 To insert : 1334064051 To insert : 1334064052 To insert : 1334064053 To insert : 1334064054 To insert : 1334064055 To insert : 1334064056 To insert : 1334064057 To insert : 1334064058 To insert : 1334064059 To insert : 1334064060 To insert : 1334064061 To insert : 1334064062 To insert : 1334064063 To insert : 1334064064 To insert : 1334064065 To insert : 1334064066 To insert : 1334064067 To insert : 1334064068 To insert : 1334064069 To insert : 1334064070 To insert : 1334064071 To insert : 1334064072 To insert : 1334064073 To insert : 1334064074 To insert : 1334064075 To insert : 1334063892 To insert : 1334063893 To insert : 1334063894 To insert : 1334063895 To insert : 1334063896 To insert : 1334063897 To insert : 1334063898 To insert : 1334063899 To insert : 1334063900 To insert : 1334063901 To insert : 1334063902 To insert : 1334063903 To insert : 1334063904 To insert : 1334063905 To insert : 1334063906 To insert : 1334063907 To insert : 1334063908 To insert : 1334063909 To insert : 1334063910 To insert : 1334063911 To insert : 1334063912 To insert : 1334063913 To insert : 1334063914 To insert : 1334063915 To insert : 1334063916 To insert : 1334063917 To insert : 1334063918 To insert : 1334063919 To insert : 1334063920 To insert : 1334063921 To insert : 1334063922 To insert : 1334063923 To insert : 1334063924 To insert : 1334063925 To insert : 1334063926 To insert : 1334063554 To insert : 1334063556 To insert : 1334063558 To insert : 1334063560 To insert : 1334063562 To insert : 1334063564 To insert : 1334063566 To insert : 1334063568 To insert : 1334063570 To insert : 1334063572 To insert : 1334063574 To insert : 1334063576 To insert : 1334063578 To insert : 1334063580 To insert : 1334063582 To insert : 1334063584 To insert : 1334063586 To insert : 1334063588 To insert : 1334063590 To insert : 1334063592 To insert : 1334063594 To insert : 1334063596 To insert : 1334063598 To insert : 1334063600 To insert : 1334063602 To insert : 1334063604 To insert : 1334063606 To insert : 1334063608 To insert : 1334063610 To insert : 1334063612 To insert : 1334063614 To insert : 1334063616 To insert : 1334063618 To insert : 1334063620 To insert : 1334063622 To insert : 1334063927 To insert : 1334063928 To insert : 1334063929 To insert : 1334063930 To insert : 1334063931 To insert : 1334063932 To insert : 1334063933 To insert : 1334063934 To insert : 1334063935 To insert : 1334063936 To insert : 1334063937 To insert : 1334063938 To insert : 1334063939 To insert : 1334063940 To insert : 1334063941 To insert : 1334063942 To insert : 1334063943 To insert : 1334063944 To insert : 1334063945 To insert : 1334063946 To insert : 1334063947 To insert : 1334063948 To insert : 1334063950 To insert : 1334063951 To insert : 1334063952 To insert : 1334063953 To insert : 1334063954 To insert : 1334063955 To insert : 1334063956 To insert : 1334063957 To insert : 1334063958 To insert : 1334063959 To insert : 1334063961 To insert : 1334063963 To insert : 1334063965 To insert : 1334063820 To insert : 1334063821 To insert : 1334063822 To insert : 1334063823 To insert : 1334063824 To insert : 1334063825 To insert : 1334063826 To insert : 1334063827 To insert : 1334063828 To insert : 1334063829 To insert : 1334063830 To insert : 1334063831 To insert : 1334063832 To insert : 1334063833 To insert : 1334063834 To insert : 1334063835 To insert : 1334063836 To insert : 1334063837 To insert : 1334063838 To insert : 1334063839 To insert : 1334063840 To insert : 1334063841 To insert : 1334063842 To insert : 1334063843 To insert : 1334063844 To insert : 1334063845 To insert : 1334063847 To insert : 1334063848 To insert : 1334063849 To insert : 1334063850 To insert : 1334063851 To insert : 1334063852 To insert : 1334063853 To insert : 1334063854 To insert : 1334063855 time to insert the descriptors : 63.82666850090027 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 478 time used for this insertion : 1.1497633457183838 save missing photos in datou_result : time spend for datou_step_exec : 72.89246559143066 time spend to save output : 1.2039721012115479 total time spend for step 6 : 74.09643769264221 step7:ventilate_hashtags_in_portfolio Mon Feb 3 03:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20164380 get user id for portfolio 20164380 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164380 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Carton','PET_fonce','Tetrapak','autre','pet_fonce','Papier','flou','pehd','mal_croppe','PEHD','environnement','papier','carton','Film_plastique','PET_clair','refus','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164380 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Carton','PET_fonce','Tetrapak','autre','pet_fonce','Papier','flou','pehd','mal_croppe','PEHD','environnement','papier','carton','Film_plastique','PET_clair','refus','pet_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164380 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Carton','PET_fonce','Tetrapak','autre','pet_fonce','Papier','flou','pehd','mal_croppe','PEHD','environnement','papier','carton','Film_plastique','PET_clair','refus','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164380 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','Carton','PET_fonce','Tetrapak','autre','pet_fonce','Papier','flou','pehd','mal_croppe','PEHD','environnement','papier','carton','Film_plastique','PET_clair','refus','pet_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20165539,20165552,20165544,20165542,20165543,20165551,20165546,20165549,20165548,20165550,20165553,20165556,20165555?tags=metal,carton,pet_fonce,tetrapak,autre,papier,flou,pehd,mal_croppe,environnement,film_plastique,pet_clair,refus&datou_id_consolidate=4235&port_consolidate=20164380 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 1 /20164380. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.01174473762512207 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.486279249191284 time spend to save output : 0.011952400207519531 total time spend for step 7 : 6.498231649398804 step8:final Mon Feb 3 03:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334037689: ('0.7410012576783149',)} new output for save of step final : {1334037689: ('0.7410012576783149',)} [1334037689] Looping around the photos to save general results len do output : 1 /1334037689.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01072835922241211 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1071007251739502 time spend to save output : 0.010884284973144531 total time spend for step 8 : 0.11798501014709473 step9:velours_tree Mon Feb 3 03:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20165539,20165552,20165544,20165542,20165543,20165551,20165546,20165549,20165548,20165550,20165553,20165556,20165555 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165539 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165552 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165544 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165542 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165543 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165551 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165546 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165549 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165548 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165550 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165553 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165556 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20165555 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 341 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 0 2 1 0 1 0 0 3 0 5 5 0 2 5 0 5 0 0 0 0 2 0 0 0 0 5 2 4 1 0 0 5 0 5 0 0 0 0 5 0 0 0 0 2 0 4 4 2 3 0 0 3 0 0 0 3 0 0 0 0 3 3 0 2 4 4 0 3 0 0 3 2 2 3 2 0 0 0 0 0 0 2 2 0 0 0 0 2 0 2 0 3 2 3 3 2 0 0 0 0 0 0 3 3 2 0 3 5 3 3 2 2 0 0 2 0 0 0 0 0 0 0 1 1 5 0 0 0 3 3 2 2 3 3 1 4 3 3 0 2 5 5 0 0 3 4 5 5 0 0 2 0 0 3 3 2 0 5 0 4 0 4 0 3 0 4 3 0 3 0 2 1 2 3 2 2 0 0 3 0 2 3 0 0 0 0 3 3 2 0 3 0 3 4 0 1 0 0 0 2 0 0 0 2 0 0 0 3 1 0 0 0 4 0 0 0 3 0 2 1 0 3 3 4 0 1 3 3 3 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 2 1 1 3 0 0 3 3 0 3 2 0 0 0 0 0 0 0 0 0 3 0 0 2 2 1 4 1 0 0 0 0 1 2 0 2 0 0 2 0 2 2 0 2 0 0 4 4 2 3 3 0 2 0 2 0 0 4 2 0 3 0 0 3 0 2 1 1 2 3 1 0 0 2 2 3 2 0 2 3 3 3 0 2 0] Elapsed time: 0.06226515769958496 graph_id used : 75606 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20165539,20165552,20165544,20165542,20165543,20165551,20165546,20165549,20165548,20165550,20165553,20165556,20165555?tags=metal,carton,pet_fonce,tetrapak,autre,papier,flou,pehd,mal_croppe,environnement,film_plastique,pet_clair,refus&datou_id_consolidate=4235&port_consolidate=20164380&tree_id=75606 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 1 /20164380Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.01240229606628418 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.548065185546875 time spend to save output : 0.012614250183105469 total time spend for step 9 : 26.56067943572998 step10:send_mail_cod Mon Feb 3 03:24:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf 20165521 imagette201655211738549465 20165534 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201655341738549465 20165526 imagette201655261738549466 20165524 imagette201655241738549466 20165525 change filename to text .change filename to text .change filename to text .imagette201655251738549466 20165533 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201655331738549466 20165528 imagette201655281738549467 20165531 imagette201655311738549467 20165530 imagette201655301738549467 20165535 imagette201655351738549467 20165538 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201655381738549467 20165537 imagette201655371738549467 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20164380 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20165539,20165552,20165544,20165542,20165543,20165551,20165546,20165549,20165548,20165550,20165553,20165556,20165555?tags=metal,carton,pet_fonce,tetrapak,autre,papier,flou,pehd,mal_croppe,environnement,film_plastique,pet_clair,refus&datou_id_consolidate=4235&port_consolidate=20164380&tree_id=75606 your option no_mail is active, we will not send the real mail to your client args[1334037689] : ((1334037689, -8.400692741719768, 492609224), (1334037689, 0.09589205049076209, 2107752395), '0.7410012576783149') We are sending mail with results at cod@fotonower.com refus_total : 0.7410012576783149 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20164380 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20164380','results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf','pdf','','0.12','0.7410012576783149') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.016138792037963867 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.2631313800811768 time spend to save output : 0.0163266658782959 total time spend for step 10 : 3.2794580459594727 step11:split_time_score Mon Feb 3 03:24:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03022025 20164380 Nombre de photos uploadées : 1 / 23040 (0%) 03022025 20164380 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 03022025 20164380 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.00014925003051757812 elapsed_time : insert_dashboard_record_day_entry 0.047920942306518555 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.7410012576783149 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20164380_03-02-2025_03_24_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20164380 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164380 AND mptpi.`type`=4230 To do Qualite : 0.7809997311170407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20164381_03-02-2025_02_21_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20164381 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20164381 AND mptpi.`type`=4230 To do Qualite : 0.7847453987737214 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20165141_03-02-2025_03_06_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20165141 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20165141 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334037689] Looping around the photos to save general results len do output : 1 /20164380Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2538751') ('4234', '20164380', '1334037689', None, None, None, None, None, '2538751') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012515068054199219 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.40080976486206055 time spend to save output : 0.012730598449707031 total time spend for step 11 : 0.4135403633117676 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 39.61user 25.88system 4:03.11elapsed 26%CPU (0avgtext+0avgdata 2481284maxresident)k 352inputs+20576outputs (0major+4408133minor)pagefaults 0swaps