python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2845708 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2581837'] with mtr_portfolio_ids : ['20501972'] and first list_photo_ids : [] new path : /proc/2845708/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1640617847442627 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Feb 13 08:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10111 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-13 08:20:31.522855: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-13 08:20:31.551117: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-13 08:20:31.553233: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f28f0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-13 08:20:31.553277: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-13 08:20:31.558049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-13 08:20:31.801801: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x186c7bb0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-13 08:20:31.801859: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-13 08:20:31.803274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-13 08:20:31.803710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-13 08:20:31.806733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-13 08:20:31.814113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-13 08:20:31.814462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-13 08:20:31.825721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-13 08:20:31.828164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-13 08:20:31.842894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-13 08:20:31.844858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-13 08:20:31.845261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-13 08:20:31.846201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-13 08:20:31.846220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-13 08:20:31.846231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-13 08:20:31.848235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-13 08:20:32.179390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-13 08:20:32.179604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-13 08:20:32.179660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-13 08:20:32.179714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-13 08:20:32.179755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-13 08:20:32.179793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-13 08:20:32.179831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-13 08:20:32.179879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-13 08:20:32.181861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-13 08:20:32.183652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-13 08:20:32.183710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-13 08:20:32.183736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-13 08:20:32.183758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-13 08:20:32.183780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-13 08:20:32.183803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-13 08:20:32.183824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-13 08:20:32.183846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-13 08:20:32.185516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-13 08:20:32.185566: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-13 08:20:32.185586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-13 08:20:32.185597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-13 08:20:32.187372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-13 08:20:40.807761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-13 08:20:41.081359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 1313 time to create 1 rle with old method : 0.0023398399353027344 length of segment : 46 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0008063316345214844 length of segment : 36 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 19 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 19 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006701946258544922 length of segment : 30 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0008723735809326172 length of segment : 26 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 18 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0011703968048095703 length of segment : 23 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 23 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0015900135040283203 length of segment : 38 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0006971359252929688 length of segment : 20 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0015938282012939453 length of segment : 51 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0012977123260498047 length of segment : 30 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0013823509216308594 length of segment : 47 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0010807514190673828 length of segment : 33 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00042438507080078125 length of segment : 36 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 2106 time to create 1 rle with old method : 0.0026137828826904297 length of segment : 74 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.30938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004830360412597656 length of segment : 23 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00038552284240722656 length of segment : 22 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 917 time to create 1 rle with old method : 0.001394033432006836 length of segment : 33 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1917 time to create 1 rle with old method : 0.0023949146270751953 length of segment : 87 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00029015541076660156 length of segment : 15 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0007619857788085938 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0009918212890625 length of segment : 41 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007164478302001953 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010967254638671875 length of segment : 27 time for calcul the mask position with numpy : 0.00019168853759765625 nb_pixel_total : 10295 time to create 1 rle with old method : 0.012317180633544922 length of segment : 103 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004138946533203125 length of segment : 18 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0008499622344970703 length of segment : 17 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 21 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0011115074157714844 length of segment : 31 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003719329833984375 length of segment : 27 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1558 time to create 1 rle with old method : 0.002083301544189453 length of segment : 34 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 999 time to create 1 rle with old method : 0.0012748241424560547 length of segment : 37 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 35 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006792545318603516 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004906654357910156 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00037598609924316406 length of segment : 23 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.001058816909790039 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.16875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0009162425994873047 length of segment : 33 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00042247772216796875 length of segment : 22 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0013196468353271484 length of segment : 42 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00038051605224609375 length of segment : 14 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0010826587677001953 length of segment : 27 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0008203983306884766 length of segment : 39 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.000324249267578125 length of segment : 20 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00030994415283203125 length of segment : 24 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 3349 time to create 1 rle with old method : 0.004351377487182617 length of segment : 58 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0015826225280761719 length of segment : 43 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005960464477539062 length of segment : 27 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0011353492736816406 length of segment : 27 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004932880401611328 length of segment : 22 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00015974044799804688 length of segment : 11 time for calcul the mask position with numpy : 0.00022077560424804688 nb_pixel_total : 8457 time to create 1 rle with old method : 0.010209798812866211 length of segment : 164 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 1522 time to create 1 rle with old method : 0.001936197280883789 length of segment : 39 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 15 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00025200843811035156 length of segment : 7 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006468296051025391 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.28594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0006256103515625 length of segment : 21 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005486011505126953 length of segment : 35 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2819 time to create 1 rle with old method : 0.0038971900939941406 length of segment : 55 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 15 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007231235504150391 length of segment : 21 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0012793540954589844 length of segment : 84 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001266002655029297 length of segment : 9 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005316734313964844 length of segment : 22 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0012829303741455078 length of segment : 44 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0010874271392822266 length of segment : 38 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.00081634521484375 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.12969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.002305269241333008 length of segment : 56 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005512237548828125 length of segment : 28 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0005550384521484375 length of segment : 25 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.000514984130859375 length of segment : 20 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0025882720947265625 length of segment : 50 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 781 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 92 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.00135040283203125 length of segment : 48 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 164.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 50.49062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 26844 time to create 1 rle with old method : 0.029811620712280273 length of segment : 416 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.16875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006949901580810547 length of segment : 35 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003352165222167969 length of segment : 22 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0021305084228515625 length of segment : 44 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006062984466552734 length of segment : 37 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009300708770751953 length of segment : 36 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1244 time to create 1 rle with old method : 0.0016379356384277344 length of segment : 57 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007119178771972656 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 19 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1002 time to create 1 rle with old method : 0.001316070556640625 length of segment : 50 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002567768096923828 length of segment : 9 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007898807525634766 length of segment : 28 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007140636444091797 length of segment : 39 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006895065307617188 length of segment : 23 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 754 time to create 1 rle with old method : 0.0010688304901123047 length of segment : 64 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.001384735107421875 length of segment : 51 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.87188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0014955997467041016 length of segment : 63 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0012128353118896484 length of segment : 36 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0007321834564208984 length of segment : 25 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 581 time to create 1 rle with old method : 0.0009081363677978516 length of segment : 19 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 20 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009417533874511719 length of segment : 59 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.000568389892578125 length of segment : 13 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00047588348388671875 length of segment : 14 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0009720325469970703 length of segment : 36 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0006260871887207031 length of segment : 29 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 682 time to create 1 rle with old method : 0.0016117095947265625 length of segment : 39 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 811 time to create 1 rle with old method : 0.001157522201538086 length of segment : 40 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 19 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 21 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006701946258544922 length of segment : 24 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007824897766113281 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.21797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 33 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 1403 time to create 1 rle with old method : 0.0017540454864501953 length of segment : 46 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 1637 time to create 1 rle with old method : 0.002228975296020508 length of segment : 54 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 3877 time to create 1 rle with old method : 0.004621028900146484 length of segment : 69 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0010848045349121094 length of segment : 35 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0017962455749511719 length of segment : 30 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011720657348632812 length of segment : 40 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002429485321044922 length of segment : 13 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.001443624496459961 length of segment : 37 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004909038543701172 length of segment : 23 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0009527206420898438 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00017070770263671875 length of segment : 11 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0012090206146240234 length of segment : 59 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0015769004821777344 length of segment : 29 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007290840148925781 length of segment : 32 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 24 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0009670257568359375 length of segment : 24 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021600723266601562 length of segment : 13 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007257461547851562 length of segment : 32 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0017054080963134766 length of segment : 35 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0010373592376708984 length of segment : 35 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0023326873779296875 length of segment : 44 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008649826049804688 length of segment : 26 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0011186599731445312 length of segment : 29 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0014495849609375 length of segment : 37 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007665157318115234 length of segment : 42 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011610984802246094 length of segment : 11 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1223 time to create 1 rle with old method : 0.0017240047454833984 length of segment : 28 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0008378028869628906 length of segment : 35 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 15 time for calcul the mask position with numpy : 0.0001373291015625 nb_pixel_total : 3434 time to create 1 rle with old method : 0.004380941390991211 length of segment : 77 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 21 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.17266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 33 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 2417 time to create 1 rle with old method : 0.0030884742736816406 length of segment : 52 time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 5164 time to create 1 rle with old method : 0.006890535354614258 length of segment : 72 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004086494445800781 length of segment : 35 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0009355545043945312 length of segment : 38 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00028824806213378906 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005691051483154297 length of segment : 26 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.0010650157928466797 length of segment : 37 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1738 time to create 1 rle with old method : 0.002218484878540039 length of segment : 63 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 5411 time to create 1 rle with old method : 0.0067255496978759766 length of segment : 59 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008444786071777344 length of segment : 26 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.0012314319610595703 length of segment : 35 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005660057067871094 length of segment : 25 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1300 time to create 1 rle with old method : 0.001598358154296875 length of segment : 55 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1570 time to create 1 rle with old method : 0.001932382583618164 length of segment : 47 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1162 time to create 1 rle with old method : 0.0015189647674560547 length of segment : 28 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.001196146011352539 length of segment : 43 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0014302730560302734 length of segment : 51 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0011112689971923828 length of segment : 32 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0010831356048583984 length of segment : 52 time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 3983 time to create 1 rle with old method : 0.00648045539855957 length of segment : 78 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0003960132598876953 length of segment : 9 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 15 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0012273788452148438 length of segment : 31 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005278587341308594 length of segment : 17 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00047206878662109375 length of segment : 19 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 20 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0013976097106933594 length of segment : 20 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0007166862487792969 length of segment : 27 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0004467964172363281 length of segment : 13 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0024743080139160156 length of segment : 37 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 25 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006806850433349609 length of segment : 27 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.27422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 31 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004973411560058594 length of segment : 30 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0006058216094970703 length of segment : 22 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0010221004486083984 length of segment : 31 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 2777 time to create 1 rle with old method : 0.003472566604614258 length of segment : 66 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0017571449279785156 length of segment : 42 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1722 time to create 1 rle with old method : 0.0020744800567626953 length of segment : 96 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1862 time to create 1 rle with old method : 0.0022890567779541016 length of segment : 48 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00029206275939941406 length of segment : 19 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004222393035888672 length of segment : 24 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004858970642089844 length of segment : 22 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004215240478515625 length of segment : 19 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 3130 time to create 1 rle with old method : 0.0039865970611572266 length of segment : 67 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0011365413665771484 length of segment : 33 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 3154 time to create 1 rle with old method : 0.004069328308105469 length of segment : 65 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0019216537475585938 length of segment : 42 time for calcul the mask position with numpy : 0.00014853477478027344 nb_pixel_total : 2753 time to create 1 rle with old method : 0.003620624542236328 length of segment : 128 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00017690658569335938 length of segment : 15 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 7261 time to create 1 rle with old method : 0.008923768997192383 length of segment : 119 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1035 time to create 1 rle with old method : 0.001413106918334961 length of segment : 42 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0012319087982177734 length of segment : 41 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 32 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 20 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 2393 time to create 1 rle with old method : 0.0034554004669189453 length of segment : 114 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 45 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007107257843017578 length of segment : 22 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 2260 time to create 1 rle with old method : 0.0028502941131591797 length of segment : 105 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 7340 time to create 1 rle with old method : 0.008990049362182617 length of segment : 116 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 35 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 33 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00040721893310546875 length of segment : 19 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0020627975463867188 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0008234977722167969 length of segment : 30 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019693374633789062 length of segment : 15 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 29 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003616809844970703 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00029587745666503906 length of segment : 15 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003082752227783203 length of segment : 9 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00041174888610839844 length of segment : 20 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0005521774291992188 length of segment : 19 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 652 time to create 1 rle with old method : 0.0009112358093261719 length of segment : 51 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0015392303466796875 length of segment : 90 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 28 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005168914794921875 length of segment : 17 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.0013384819030761719 length of segment : 49 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 13 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0022721290588378906 length of segment : 54 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005948543548583984 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005967617034912109 length of segment : 29 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2349 time to create 1 rle with old method : 0.002756834030151367 length of segment : 65 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 93.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 824 time to create 1 rle with old method : 0.00131988525390625 length of segment : 85 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.28203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0006833076477050781 length of segment : 17 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0003237724304199219 length of segment : 14 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0011057853698730469 length of segment : 27 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0004515647888183594 length of segment : 18 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0009191036224365234 length of segment : 31 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0009274482727050781 length of segment : 35 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0006949901580810547 length of segment : 25 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0005347728729248047 length of segment : 16 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00027632713317871094 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.70391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 4043 time to create 1 rle with old method : 0.007301807403564453 length of segment : 122 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006282329559326172 length of segment : 31 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.00048160552978515625 length of segment : 21 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005757808685302734 length of segment : 27 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.002269268035888672 length of segment : 60 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 13 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0010306835174560547 length of segment : 43 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008881092071533203 length of segment : 33 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2186 time to create 1 rle with old method : 0.002768278121948242 length of segment : 54 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 20 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0009412765502929688 length of segment : 42 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.0011057853698730469 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.28203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0006439685821533203 length of segment : 44 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0011754035949707031 length of segment : 29 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006892681121826172 length of segment : 36 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005161762237548828 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005424022674560547 length of segment : 29 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.00043964385986328125 length of segment : 19 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.0012042522430419922 length of segment : 37 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 27 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006635189056396484 length of segment : 34 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002014636993408203 length of segment : 13 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006811618804931641 length of segment : 21 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1830 time to create 1 rle with old method : 0.0024077892303466797 length of segment : 49 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0016963481903076172 length of segment : 55 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0013418197631835938 length of segment : 42 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0023343563079833984 length of segment : 49 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0011723041534423828 length of segment : 42 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007576942443847656 length of segment : 31 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.001009225845336914 length of segment : 40 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.001585245132446289 length of segment : 51 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0015690326690673828 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007488727569580078 length of segment : 29 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006680488586425781 length of segment : 50 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0014476776123046875 length of segment : 43 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0014569759368896484 length of segment : 59 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004930496215820312 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00042438507080078125 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007607936859130859 length of segment : 32 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002570152282714844 length of segment : 18 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007064342498779297 length of segment : 27 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003559589385986328 length of segment : 19 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2127 time to create 1 rle with old method : 0.002763509750366211 length of segment : 76 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 2611 time to create 1 rle with old method : 0.0033884048461914062 length of segment : 50 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 4286 time to create 1 rle with old method : 0.005536794662475586 length of segment : 89 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004343986511230469 length of segment : 18 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0008847713470458984 length of segment : 31 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 42 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 12 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00039958953857421875 length of segment : 26 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012214183807373047 length of segment : 59 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 890 time to create 1 rle with old method : 0.0012156963348388672 length of segment : 34 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007727146148681641 length of segment : 46 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.00047850608825683594 length of segment : 21 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00039124488830566406 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003542900085449219 length of segment : 18 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1844 time to create 1 rle with old method : 0.002340078353881836 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.05156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0013287067413330078 length of segment : 39 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006749629974365234 length of segment : 17 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1715 time to create 1 rle with old method : 0.0023956298828125 length of segment : 47 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 29 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005252361297607422 length of segment : 39 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1681 time to create 1 rle with old method : 0.00780797004699707 length of segment : 48 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0018067359924316406 length of segment : 86 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005924701690673828 length of segment : 28 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 17 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0011637210845947266 length of segment : 40 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1451 time to create 1 rle with old method : 0.001972675323486328 length of segment : 45 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004737377166748047 length of segment : 17 time for calcul the mask position with numpy : 0.00014162063598632812 nb_pixel_total : 4739 time to create 1 rle with old method : 0.0060918331146240234 length of segment : 81 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00028252601623535156 length of segment : 17 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 4649 time to create 1 rle with old method : 0.005486965179443359 length of segment : 70 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00029754638671875 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0006086826324462891 length of segment : 38 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.000682830810546875 length of segment : 57 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0017118453979492188 length of segment : 98 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0011029243469238281 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.60234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 29 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2479 time to create 1 rle with old method : 0.0032961368560791016 length of segment : 50 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1826 time to create 1 rle with old method : 0.0023622512817382812 length of segment : 70 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 950 time to create 1 rle with old method : 0.0013136863708496094 length of segment : 35 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.001367330551147461 length of segment : 63 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1227 time to create 1 rle with old method : 0.0015523433685302734 length of segment : 50 time for calcul the mask position with numpy : 0.00020241737365722656 nb_pixel_total : 10140 time to create 1 rle with old method : 0.014636516571044922 length of segment : 108 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 23 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 998 time to create 1 rle with old method : 0.001220703125 length of segment : 32 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009546279907226562 length of segment : 32 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 3655 time to create 1 rle with old method : 0.00435185432434082 length of segment : 85 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006070137023925781 length of segment : 76 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 988 time to create 1 rle with old method : 0.0017483234405517578 length of segment : 32 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 801 time to create 1 rle with old method : 0.0014867782592773438 length of segment : 61 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 10 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2070 time to create 1 rle with old method : 0.0034945011138916016 length of segment : 37 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 2205 time to create 1 rle with old method : 0.005175352096557617 length of segment : 39 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 1880 time to create 1 rle with old method : 0.003950595855712891 length of segment : 45 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 177.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 59.04531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 36 time to create 1 rle with old method : 0.00012540817260742188 length of segment : 11 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.38359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 1590 time to create 1 rle with old method : 0.002134084701538086 length of segment : 149 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0010135173797607422 length of segment : 19 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.001990795135498047 length of segment : 29 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0015668869018554688 length of segment : 57 Processing 1 images image shape: (240, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0006251335144042969 length of segment : 29 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 30 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005314350128173828 length of segment : 22 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 17 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 21 Processing 1 images image shape: (240, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007748603820800781 length of segment : 28 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00037789344787597656 length of segment : 22 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00031304359436035156 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005645751953125 length of segment : 21 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00028014183044433594 length of segment : 13 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 10848 time to create 1 rle with old method : 0.013797760009765625 length of segment : 41 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004813671112060547 length of segment : 19 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 38 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002372264862060547 length of segment : 16 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002930164337158203 length of segment : 16 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1216 time to create 1 rle with old method : 0.001667022705078125 length of segment : 48 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0007548332214355469 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 15 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0004980564117431641 length of segment : 27 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 13 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008029937744140625 length of segment : 35 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00017142295837402344 length of segment : 8 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 13 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 17 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00024819374084472656 length of segment : 31 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00032448768615722656 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005023479461669922 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00011134147644042969 length of segment : 8 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006773471832275391 length of segment : 22 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005261898040771484 length of segment : 18 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.95547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 31854 time to create 1 rle with old method : 0.050261735916137695 length of segment : 142 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 13528 time to create 1 rle with old method : 0.016338109970092773 length of segment : 108 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004596710205078125 length of segment : 40 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018858909606933594 length of segment : 14 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0013628005981445312 length of segment : 24 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 12520 time to create 1 rle with old method : 0.015624046325683594 length of segment : 99 Processing 1 images image shape: (240, 160, 3) min: 5.00000 max: 232.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 117.07935 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 14 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001621246337890625 length of segment : 18 Detection mask done ! Trying to reset tf kernel 2846196 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3629 tf kernel not reseted sub process len(results) : 380 len(list_Values) 380 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 380 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10111 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 380 chid ids of type : 4228 Number RLEs to save : 14152 save missing photos in datou_result : time spend for datou_step_exec : 25.76897096633911 time spend to save output : 1.057293176651001 total time spend for step 1 : 26.826264142990112 step2:brightness Thu Feb 13 08:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739431228_2845708_1337287150_366a3424d137af3bdfc5b02383d82053.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.012950420379638672 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.010981082916259766 save missing photos in datou_result : time spend for datou_step_exec : 0.5807533264160156 time spend to save output : 0.029488086700439453 total time spend for step 2 : 0.6102414131164551 step3:blur_detection Thu Feb 13 08:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739431228_2845708_1337287150_366a3424d137af3bdfc5b02383d82053.jpg resize: (1440, 2560) 1337287150 -8.191397740934221 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.012024641036987305 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.01105809211730957 save missing photos in datou_result : time spend for datou_step_exec : 1.9199347496032715 time spend to save output : 0.02826714515686035 total time spend for step 3 : 1.9482018947601318 step4:rle_unique_nms_with_priority Thu Feb 13 08:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 380 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 380 nb_hashtags : 7 time to prepare the origin masks : 1.9069712162017822 time for calcul the mask position with numpy : 0.2830214500427246 nb_pixel_total : 3305269 time to create 1 rle with new method : 0.23557233810424805 time for calcul the mask position with numpy : 0.015002250671386719 nb_pixel_total : 26844 time to create 1 rle with old method : 0.02887272834777832 time for calcul the mask position with numpy : 0.015261173248291016 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011723041534423828 time for calcul the mask position with numpy : 0.015280008316040039 nb_pixel_total : 1313 time to create 1 rle with old method : 0.0015821456909179688 time for calcul the mask position with numpy : 0.015125751495361328 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005011558532714844 time for calcul the mask position with numpy : 0.015439987182617188 nb_pixel_total : 680 time to create 1 rle with old method : 0.0008800029754638672 time for calcul the mask position with numpy : 0.015949010848999023 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005118846893310547 time for calcul the mask position with numpy : 0.018775224685668945 nb_pixel_total : 781 time to create 1 rle with old method : 0.001218557357788086 time for calcul the mask position with numpy : 0.0157473087310791 nb_pixel_total : 1917 time to create 1 rle with old method : 0.0036635398864746094 time for calcul the mask position with numpy : 0.015170097351074219 nb_pixel_total : 330 time to create 1 rle with old method : 0.00040793418884277344 time for calcul the mask position with numpy : 0.014944791793823242 nb_pixel_total : 205 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.014998197555541992 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.015042543411254883 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0017802715301513672 time for calcul the mask position with numpy : 0.015005826950073242 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.015178918838500977 nb_pixel_total : 2 time to create 1 rle with old method : 2.765655517578125e-05 time for calcul the mask position with numpy : 0.0157468318939209 nb_pixel_total : 10295 time to create 1 rle with old method : 0.012072324752807617 time for calcul the mask position with numpy : 0.015001058578491211 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004925727844238281 time for calcul the mask position with numpy : 0.020226716995239258 nb_pixel_total : 373 time to create 1 rle with old method : 0.0007865428924560547 time for calcul the mask position with numpy : 0.016732215881347656 nb_pixel_total : 3349 time to create 1 rle with old method : 0.0037691593170166016 time for calcul the mask position with numpy : 0.01492166519165039 nb_pixel_total : 6146 time to create 1 rle with old method : 0.006900310516357422 time for calcul the mask position with numpy : 0.01495981216430664 nb_pixel_total : 168 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.01657700538635254 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0018658638000488281 time for calcul the mask position with numpy : 0.01513361930847168 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007112026214599609 time for calcul the mask position with numpy : 0.015102386474609375 nb_pixel_total : 1096 time to create 1 rle with old method : 0.001291513442993164 time for calcul the mask position with numpy : 0.014967918395996094 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.014908552169799805 nb_pixel_total : 308 time to create 1 rle with old method : 0.0006167888641357422 time for calcul the mask position with numpy : 0.014896154403686523 nb_pixel_total : 817 time to create 1 rle with old method : 0.000988006591796875 time for calcul the mask position with numpy : 0.014919281005859375 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002472400665283203 time for calcul the mask position with numpy : 0.01623249053955078 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008642673492431641 time for calcul the mask position with numpy : 0.016727209091186523 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005898475646972656 time for calcul the mask position with numpy : 0.01793050765991211 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009241104125976562 time for calcul the mask position with numpy : 0.015385866165161133 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0015079975128173828 time for calcul the mask position with numpy : 0.018756628036499023 nb_pixel_total : 35 time to create 1 rle with old method : 8.869171142578125e-05 time for calcul the mask position with numpy : 0.0166623592376709 nb_pixel_total : 477 time to create 1 rle with old method : 0.00057220458984375 time for calcul the mask position with numpy : 0.015239715576171875 nb_pixel_total : 51 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.01516270637512207 nb_pixel_total : 2106 time to create 1 rle with old method : 0.002498149871826172 time for calcul the mask position with numpy : 0.015241384506225586 nb_pixel_total : 271 time to create 1 rle with old method : 0.00035381317138671875 time for calcul the mask position with numpy : 0.015671730041503906 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003757476806640625 time for calcul the mask position with numpy : 0.016675233840942383 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006754398345947266 time for calcul the mask position with numpy : 0.01742410659790039 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005936622619628906 time for calcul the mask position with numpy : 0.017153263092041016 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009448528289794922 time for calcul the mask position with numpy : 0.015413522720336914 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007615089416503906 time for calcul the mask position with numpy : 0.017295360565185547 nb_pixel_total : 432 time to create 1 rle with old method : 0.0014846324920654297 time for calcul the mask position with numpy : 0.01864933967590332 nb_pixel_total : 367 time to create 1 rle with old method : 0.0007910728454589844 time for calcul the mask position with numpy : 0.018056154251098633 nb_pixel_total : 723 time to create 1 rle with old method : 0.001087188720703125 time for calcul the mask position with numpy : 0.019693851470947266 nb_pixel_total : 16 time to create 1 rle with old method : 0.0001049041748046875 time for calcul the mask position with numpy : 0.017441511154174805 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0016295909881591797 time for calcul the mask position with numpy : 0.017090797424316406 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007889270782470703 time for calcul the mask position with numpy : 0.016267061233520508 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007803440093994141 time for calcul the mask position with numpy : 0.015522241592407227 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003418922424316406 time for calcul the mask position with numpy : 0.015581130981445312 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005273818969726562 time for calcul the mask position with numpy : 0.015490055084228516 nb_pixel_total : 134 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.015412092208862305 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004222393035888672 time for calcul the mask position with numpy : 0.015676259994506836 nb_pixel_total : 1558 time to create 1 rle with old method : 0.0023038387298583984 time for calcul the mask position with numpy : 0.016055583953857422 nb_pixel_total : 557 time to create 1 rle with old method : 0.0006787776947021484 time for calcul the mask position with numpy : 0.01505589485168457 nb_pixel_total : 226 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.015174627304077148 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0012104511260986328 time for calcul the mask position with numpy : 0.015192270278930664 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003631114959716797 time for calcul the mask position with numpy : 0.01510310173034668 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005977153778076172 time for calcul the mask position with numpy : 0.015192508697509766 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003838539123535156 time for calcul the mask position with numpy : 0.015266895294189453 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.015315055847167969 nb_pixel_total : 275 time to create 1 rle with old method : 0.000354766845703125 time for calcul the mask position with numpy : 0.015504121780395508 nb_pixel_total : 178 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.015334844589233398 nb_pixel_total : 2819 time to create 1 rle with old method : 0.0032706260681152344 time for calcul the mask position with numpy : 0.015261650085449219 nb_pixel_total : 917 time to create 1 rle with old method : 0.0011246204376220703 time for calcul the mask position with numpy : 0.015259504318237305 nb_pixel_total : 854 time to create 1 rle with old method : 0.0010347366333007812 time for calcul the mask position with numpy : 0.015307903289794922 nb_pixel_total : 355 time to create 1 rle with old method : 0.00044798851013183594 time for calcul the mask position with numpy : 0.015271902084350586 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003795623779296875 time for calcul the mask position with numpy : 0.015270233154296875 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.016192197799682617 nb_pixel_total : 898 time to create 1 rle with old method : 0.0011451244354248047 time for calcul the mask position with numpy : 0.015240907669067383 nb_pixel_total : 928 time to create 1 rle with old method : 0.0011229515075683594 time for calcul the mask position with numpy : 0.015349864959716797 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009622573852539062 time for calcul the mask position with numpy : 0.01504659652709961 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.01505136489868164 nb_pixel_total : 999 time to create 1 rle with old method : 0.0012040138244628906 time for calcul the mask position with numpy : 0.015130281448364258 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.015067815780639648 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004477500915527344 time for calcul the mask position with numpy : 0.015158891677856445 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.015601158142089844 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006351470947265625 time for calcul the mask position with numpy : 0.014898538589477539 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006191730499267578 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.015093326568603516 nb_pixel_total : 1162 time to create 1 rle with old method : 0.0013887882232666016 time for calcul the mask position with numpy : 0.014992237091064453 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.0149688720703125 nb_pixel_total : 325 time to create 1 rle with old method : 0.00041103363037109375 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.014930009841918945 nb_pixel_total : 808 time to create 1 rle with old method : 0.0009469985961914062 time for calcul the mask position with numpy : 0.0148468017578125 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004639625549316406 time for calcul the mask position with numpy : 0.014878034591674805 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008084774017333984 time for calcul the mask position with numpy : 0.014869451522827148 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.014930009841918945 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.015540361404418945 nb_pixel_total : 228 time to create 1 rle with old method : 0.00028252601623535156 time for calcul the mask position with numpy : 0.014965534210205078 nb_pixel_total : 328 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.014941930770874023 nb_pixel_total : 370 time to create 1 rle with old method : 0.000446319580078125 time for calcul the mask position with numpy : 0.014937877655029297 nb_pixel_total : 16 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.014911890029907227 nb_pixel_total : 433 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.014901161193847656 nb_pixel_total : 902 time to create 1 rle with old method : 0.0010530948638916016 time for calcul the mask position with numpy : 0.014914274215698242 nb_pixel_total : 381 time to create 1 rle with old method : 0.00047135353088378906 time for calcul the mask position with numpy : 0.014967918395996094 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004203319549560547 time for calcul the mask position with numpy : 0.015400409698486328 nb_pixel_total : 682 time to create 1 rle with old method : 0.0008084774017333984 time for calcul the mask position with numpy : 0.01588273048400879 nb_pixel_total : 62 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.016989707946777344 nb_pixel_total : 2393 time to create 1 rle with old method : 0.002938508987426758 time for calcul the mask position with numpy : 0.01603841781616211 nb_pixel_total : 110 time to create 1 rle with old method : 0.00023794174194335938 time for calcul the mask position with numpy : 0.016087055206298828 nb_pixel_total : 106 time to create 1 rle with old method : 0.00017523765563964844 time for calcul the mask position with numpy : 0.016152381896972656 nb_pixel_total : 320 time to create 1 rle with old method : 0.00044083595275878906 time for calcul the mask position with numpy : 0.015807390213012695 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.015468597412109375 nb_pixel_total : 156 time to create 1 rle with old method : 0.00020122528076171875 time for calcul the mask position with numpy : 0.015037298202514648 nb_pixel_total : 6 time to create 1 rle with old method : 3.075599670410156e-05 time for calcul the mask position with numpy : 0.014879703521728516 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006153583526611328 time for calcul the mask position with numpy : 0.014977216720581055 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007836818695068359 time for calcul the mask position with numpy : 0.018093347549438477 nb_pixel_total : 573 time to create 1 rle with old method : 0.0006909370422363281 time for calcul the mask position with numpy : 0.014935493469238281 nb_pixel_total : 121 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.01702141761779785 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006947517395019531 time for calcul the mask position with numpy : 0.015858173370361328 nb_pixel_total : 721 time to create 1 rle with old method : 0.0008606910705566406 time for calcul the mask position with numpy : 0.014890432357788086 nb_pixel_total : 3877 time to create 1 rle with old method : 0.00442051887512207 time for calcul the mask position with numpy : 0.01811051368713379 nb_pixel_total : 16 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.01488351821899414 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.015159845352172852 nb_pixel_total : 179 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.015001535415649414 nb_pixel_total : 652 time to create 1 rle with old method : 0.0007843971252441406 time for calcul the mask position with numpy : 0.014945745468139648 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007243156433105469 time for calcul the mask position with numpy : 0.016591548919677734 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.017952442169189453 nb_pixel_total : 131 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.016458988189697266 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.017915010452270508 nb_pixel_total : 813 time to create 1 rle with old method : 0.0009663105010986328 time for calcul the mask position with numpy : 0.015352010726928711 nb_pixel_total : 933 time to create 1 rle with old method : 0.0011255741119384766 time for calcul the mask position with numpy : 0.01503133773803711 nb_pixel_total : 986 time to create 1 rle with old method : 0.0012362003326416016 time for calcul the mask position with numpy : 0.014894247055053711 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.01491856575012207 nb_pixel_total : 581 time to create 1 rle with old method : 0.0006923675537109375 time for calcul the mask position with numpy : 0.01653313636779785 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003597736358642578 time for calcul the mask position with numpy : 0.016498327255249023 nb_pixel_total : 1375 time to create 1 rle with old method : 0.001596212387084961 time for calcul the mask position with numpy : 0.014902591705322266 nb_pixel_total : 7252 time to create 1 rle with old method : 0.00831913948059082 time for calcul the mask position with numpy : 0.015247583389282227 nb_pixel_total : 266 time to create 1 rle with old method : 0.00035262107849121094 time for calcul the mask position with numpy : 0.015347480773925781 nb_pixel_total : 5411 time to create 1 rle with old method : 0.006107807159423828 time for calcul the mask position with numpy : 0.016315698623657227 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008332729339599609 time for calcul the mask position with numpy : 0.015247106552124023 nb_pixel_total : 1722 time to create 1 rle with old method : 0.0019788742065429688 time for calcul the mask position with numpy : 0.015198469161987305 nb_pixel_total : 1270 time to create 1 rle with old method : 0.001497507095336914 time for calcul the mask position with numpy : 0.015655517578125 nb_pixel_total : 134 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.01537322998046875 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006134510040283203 time for calcul the mask position with numpy : 0.015377521514892578 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.01534414291381836 nb_pixel_total : 2661 time to create 1 rle with old method : 0.003081798553466797 time for calcul the mask position with numpy : 0.015547752380371094 nb_pixel_total : 1403 time to create 1 rle with old method : 0.0016467571258544922 time for calcul the mask position with numpy : 0.015083789825439453 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011370182037353516 time for calcul the mask position with numpy : 0.01522374153137207 nb_pixel_total : 593 time to create 1 rle with old method : 0.000720977783203125 time for calcul the mask position with numpy : 0.014957427978515625 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.01784539222717285 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.01601576805114746 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0021436214447021484 time for calcul the mask position with numpy : 0.018700838088989258 nb_pixel_total : 179 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.018686294555664062 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006740093231201172 time for calcul the mask position with numpy : 0.017935514450073242 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0015382766723632812 time for calcul the mask position with numpy : 0.016538143157958984 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0016901493072509766 time for calcul the mask position with numpy : 0.01666259765625 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010371208190917969 time for calcul the mask position with numpy : 0.01578378677368164 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007197856903076172 time for calcul the mask position with numpy : 0.015155553817749023 nb_pixel_total : 1048 time to create 1 rle with old method : 0.001325845718383789 time for calcul the mask position with numpy : 0.015104532241821289 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.015079975128173828 nb_pixel_total : 1570 time to create 1 rle with old method : 0.0018923282623291016 time for calcul the mask position with numpy : 0.016196727752685547 nb_pixel_total : 724 time to create 1 rle with old method : 0.0010998249053955078 time for calcul the mask position with numpy : 0.017226457595825195 nb_pixel_total : 1002 time to create 1 rle with old method : 0.0011742115020751953 time for calcul the mask position with numpy : 0.015108823776245117 nb_pixel_total : 42 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.015069723129272461 nb_pixel_total : 680 time to create 1 rle with old method : 0.0008516311645507812 time for calcul the mask position with numpy : 0.0168612003326416 nb_pixel_total : 793 time to create 1 rle with old method : 0.0011875629425048828 time for calcul the mask position with numpy : 0.016344785690307617 nb_pixel_total : 1166 time to create 1 rle with old method : 0.001382589340209961 time for calcul the mask position with numpy : 0.015177011489868164 nb_pixel_total : 1862 time to create 1 rle with old method : 0.0021071434020996094 time for calcul the mask position with numpy : 0.01660299301147461 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0013613700866699219 time for calcul the mask position with numpy : 0.014945268630981445 nb_pixel_total : 2777 time to create 1 rle with old method : 0.003145933151245117 time for calcul the mask position with numpy : 0.014990806579589844 nb_pixel_total : 2349 time to create 1 rle with old method : 0.0027163028717041016 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003902912139892578 time for calcul the mask position with numpy : 0.014886140823364258 nb_pixel_total : 516 time to create 1 rle with old method : 0.0006272792816162109 time for calcul the mask position with numpy : 0.014893054962158203 nb_pixel_total : 328 time to create 1 rle with old method : 0.0005869865417480469 time for calcul the mask position with numpy : 0.014986515045166016 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006465911865234375 time for calcul the mask position with numpy : 0.014994621276855469 nb_pixel_total : 38 time to create 1 rle with old method : 9.72747802734375e-05 time for calcul the mask position with numpy : 0.014886140823364258 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0015528202056884766 time for calcul the mask position with numpy : 0.014885902404785156 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005860328674316406 time for calcul the mask position with numpy : 0.014885663986206055 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.014891624450683594 nb_pixel_total : 1738 time to create 1 rle with old method : 0.0020148754119873047 time for calcul the mask position with numpy : 0.017432451248168945 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0015263557434082031 time for calcul the mask position with numpy : 0.014927148818969727 nb_pixel_total : 912 time to create 1 rle with old method : 0.0010769367218017578 time for calcul the mask position with numpy : 0.014911890029907227 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006175041198730469 time for calcul the mask position with numpy : 0.014919757843017578 nb_pixel_total : 13 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.014917373657226562 nb_pixel_total : 671 time to create 1 rle with old method : 0.0007965564727783203 time for calcul the mask position with numpy : 0.014885902404785156 nb_pixel_total : 485 time to create 1 rle with old method : 0.000576019287109375 time for calcul the mask position with numpy : 0.014938116073608398 nb_pixel_total : 3434 time to create 1 rle with old method : 0.003907918930053711 time for calcul the mask position with numpy : 0.014896869659423828 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005598068237304688 time for calcul the mask position with numpy : 0.014904260635375977 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005962848663330078 time for calcul the mask position with numpy : 0.014897823333740234 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004215240478515625 time for calcul the mask position with numpy : 0.014890909194946289 nb_pixel_total : 754 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.015213966369628906 nb_pixel_total : 1244 time to create 1 rle with old method : 0.00177764892578125 time for calcul the mask position with numpy : 0.014930963516235352 nb_pixel_total : 824 time to create 1 rle with old method : 0.0010402202606201172 time for calcul the mask position with numpy : 0.014944076538085938 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0018954277038574219 time for calcul the mask position with numpy : 0.014946460723876953 nb_pixel_total : 5164 time to create 1 rle with old method : 0.00588679313659668 time for calcul the mask position with numpy : 0.014902591705322266 nb_pixel_total : 558 time to create 1 rle with old method : 0.0006597042083740234 time for calcul the mask position with numpy : 0.014892816543579102 nb_pixel_total : 2417 time to create 1 rle with old method : 0.002699613571166992 time for calcul the mask position with numpy : 0.014874458312988281 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004677772521972656 time for calcul the mask position with numpy : 0.014891386032104492 nb_pixel_total : 3130 time to create 1 rle with old method : 0.003592967987060547 time for calcul the mask position with numpy : 0.014923334121704102 nb_pixel_total : 1592 time to create 1 rle with old method : 0.001828908920288086 time for calcul the mask position with numpy : 0.015843868255615234 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.014913320541381836 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006580352783203125 time for calcul the mask position with numpy : 0.015174627304077148 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0018482208251953125 time for calcul the mask position with numpy : 0.01724410057067871 nb_pixel_total : 768 time to create 1 rle with old method : 0.0012619495391845703 time for calcul the mask position with numpy : 0.01709437370300293 nb_pixel_total : 213 time to create 1 rle with old method : 0.0004096031188964844 time for calcul the mask position with numpy : 0.0169980525970459 nb_pixel_total : 3983 time to create 1 rle with old method : 0.0063953399658203125 time for calcul the mask position with numpy : 0.016822099685668945 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002593994140625 time for calcul the mask position with numpy : 0.01495218276977539 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002503395080566406 time for calcul the mask position with numpy : 0.014860391616821289 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002262592315673828 time for calcul the mask position with numpy : 0.014783382415771484 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004706382751464844 time for calcul the mask position with numpy : 0.0147552490234375 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.014809608459472656 nb_pixel_total : 5 time to create 1 rle with old method : 2.0503997802734375e-05 time for calcul the mask position with numpy : 0.014843940734863281 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.014443397521972656 nb_pixel_total : 800 time to create 1 rle with old method : 0.0009527206420898438 time for calcul the mask position with numpy : 0.014450311660766602 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.016569852828979492 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006542205810546875 time for calcul the mask position with numpy : 0.01481008529663086 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004596710205078125 time for calcul the mask position with numpy : 0.014707803726196289 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003592967987060547 time for calcul the mask position with numpy : 0.014639854431152344 nb_pixel_total : 146 time to create 1 rle with old method : 0.00017714500427246094 time for calcul the mask position with numpy : 0.01476597785949707 nb_pixel_total : 280 time to create 1 rle with old method : 0.00034332275390625 time for calcul the mask position with numpy : 0.014734506607055664 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.014626026153564453 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005483627319335938 time for calcul the mask position with numpy : 0.01471257209777832 nb_pixel_total : 3154 time to create 1 rle with old method : 0.0036156177520751953 time for calcul the mask position with numpy : 0.014771699905395508 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0018572807312011719 time for calcul the mask position with numpy : 0.014922380447387695 nb_pixel_total : 13 time to create 1 rle with old method : 4.553794860839844e-05 time for calcul the mask position with numpy : 0.014934539794921875 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.015010595321655273 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.016533613204956055 nb_pixel_total : 951 time to create 1 rle with old method : 0.0011553764343261719 time for calcul the mask position with numpy : 0.014810562133789062 nb_pixel_total : 864 time to create 1 rle with old method : 0.0010688304901123047 time for calcul the mask position with numpy : 0.01490020751953125 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006341934204101562 time for calcul the mask position with numpy : 0.014815092086791992 nb_pixel_total : 811 time to create 1 rle with old method : 0.0009379386901855469 time for calcul the mask position with numpy : 0.014829635620117188 nb_pixel_total : 316 time to create 1 rle with old method : 0.00040841102600097656 time for calcul the mask position with numpy : 0.01467752456665039 nb_pixel_total : 388 time to create 1 rle with old method : 0.0004589557647705078 time for calcul the mask position with numpy : 0.014754056930541992 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005464553833007812 time for calcul the mask position with numpy : 0.015214681625366211 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.014973640441894531 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.014841079711914062 nb_pixel_total : 98 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.01473236083984375 nb_pixel_total : 218 time to create 1 rle with old method : 0.00028443336486816406 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.015613555908203125 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.01498723030090332 nb_pixel_total : 36 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.014819860458374023 nb_pixel_total : 10136 time to create 1 rle with old method : 0.011415481567382812 time for calcul the mask position with numpy : 0.014734029769897461 nb_pixel_total : 48 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.014763355255126953 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004439353942871094 time for calcul the mask position with numpy : 0.014658212661743164 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011439323425292969 time for calcul the mask position with numpy : 0.014904975891113281 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002849102020263672 time for calcul the mask position with numpy : 0.014971256256103516 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003535747528076172 time for calcul the mask position with numpy : 0.014979839324951172 nb_pixel_total : 103 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.014740943908691406 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.014777898788452148 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005388259887695312 time for calcul the mask position with numpy : 0.014790773391723633 nb_pixel_total : 187 time to create 1 rle with old method : 0.00023174285888671875 time for calcul the mask position with numpy : 0.015178203582763672 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002892017364501953 time for calcul the mask position with numpy : 0.014899253845214844 nb_pixel_total : 279 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.014819860458374023 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.0148162841796875 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005161762237548828 time for calcul the mask position with numpy : 0.014885187149047852 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005078315734863281 time for calcul the mask position with numpy : 0.014878273010253906 nb_pixel_total : 183 time to create 1 rle with old method : 0.00022935867309570312 time for calcul the mask position with numpy : 0.014700651168823242 nb_pixel_total : 491 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.014720439910888672 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0012400150299072266 time for calcul the mask position with numpy : 0.014858484268188477 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004067420959472656 time for calcul the mask position with numpy : 0.014818191528320312 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003573894500732422 time for calcul the mask position with numpy : 0.014733076095581055 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0014820098876953125 time for calcul the mask position with numpy : 0.014698982238769531 nb_pixel_total : 1826 time to create 1 rle with old method : 0.0021538734436035156 time for calcul the mask position with numpy : 0.015028715133666992 nb_pixel_total : 39 time to create 1 rle with old method : 9.870529174804688e-05 time for calcul the mask position with numpy : 0.01586437225341797 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010037422180175781 time for calcul the mask position with numpy : 0.014860153198242188 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007169246673583984 time for calcul the mask position with numpy : 0.014540910720825195 nb_pixel_total : 125 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.01508331298828125 nb_pixel_total : 953 time to create 1 rle with old method : 0.0011293888092041016 time for calcul the mask position with numpy : 0.015027761459350586 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006594657897949219 time for calcul the mask position with numpy : 0.015068769454956055 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.015120983123779297 nb_pixel_total : 2127 time to create 1 rle with old method : 0.002435922622680664 time for calcul the mask position with numpy : 0.015194416046142578 nb_pixel_total : 1880 time to create 1 rle with old method : 0.002203702926635742 time for calcul the mask position with numpy : 0.015139341354370117 nb_pixel_total : 856 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.015046834945678711 nb_pixel_total : 283 time to create 1 rle with old method : 0.00035953521728515625 time for calcul the mask position with numpy : 0.014954566955566406 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008680820465087891 time for calcul the mask position with numpy : 0.015304088592529297 nb_pixel_total : 1714 time to create 1 rle with old method : 0.002001523971557617 time for calcul the mask position with numpy : 0.015144586563110352 nb_pixel_total : 299 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.015060186386108398 nb_pixel_total : 27 time to create 1 rle with old method : 8.249282836914062e-05 time for calcul the mask position with numpy : 0.015045881271362305 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006356239318847656 time for calcul the mask position with numpy : 0.015122175216674805 nb_pixel_total : 21 time to create 1 rle with old method : 7.891654968261719e-05 time for calcul the mask position with numpy : 0.01504826545715332 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010294914245605469 time for calcul the mask position with numpy : 0.01868891716003418 nb_pixel_total : 554 time to create 1 rle with old method : 0.0008196830749511719 time for calcul the mask position with numpy : 0.01608109474182129 nb_pixel_total : 156 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.015169143676757812 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.015146970748901367 nb_pixel_total : 118 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.016678571701049805 nb_pixel_total : 1830 time to create 1 rle with old method : 0.0023956298828125 time for calcul the mask position with numpy : 0.018310070037841797 nb_pixel_total : 1275 time to create 1 rle with old method : 0.001856088638305664 time for calcul the mask position with numpy : 0.021049976348876953 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.015923023223876953 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006849765777587891 time for calcul the mask position with numpy : 0.018867969512939453 nb_pixel_total : 801 time to create 1 rle with old method : 0.0012664794921875 time for calcul the mask position with numpy : 0.021166563034057617 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004763603210449219 time for calcul the mask position with numpy : 0.015985965728759766 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009298324584960938 time for calcul the mask position with numpy : 0.01575469970703125 nb_pixel_total : 4739 time to create 1 rle with old method : 0.005712032318115234 time for calcul the mask position with numpy : 0.01601552963256836 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002067089080810547 time for calcul the mask position with numpy : 0.015141487121582031 nb_pixel_total : 1844 time to create 1 rle with old method : 0.002154111862182617 time for calcul the mask position with numpy : 0.015094518661499023 nb_pixel_total : 81 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.015108585357666016 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009524822235107422 time for calcul the mask position with numpy : 0.014963150024414062 nb_pixel_total : 323 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.015128135681152344 nb_pixel_total : 950 time to create 1 rle with old method : 0.0011456012725830078 time for calcul the mask position with numpy : 0.015268087387084961 nb_pixel_total : 1227 time to create 1 rle with old method : 0.0014677047729492188 time for calcul the mask position with numpy : 0.01657581329345703 nb_pixel_total : 305 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.017300844192504883 nb_pixel_total : 385 time to create 1 rle with old method : 0.0006871223449707031 time for calcul the mask position with numpy : 0.017309904098510742 nb_pixel_total : 998 time to create 1 rle with old method : 0.0016319751739501953 time for calcul the mask position with numpy : 0.017369508743286133 nb_pixel_total : 5 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.01726841926574707 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008299350738525391 time for calcul the mask position with numpy : 0.015197515487670898 nb_pixel_total : 4286 time to create 1 rle with old method : 0.004861116409301758 time for calcul the mask position with numpy : 0.015159130096435547 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003962516784667969 time for calcul the mask position with numpy : 0.01508641242980957 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003724098205566406 time for calcul the mask position with numpy : 0.015915632247924805 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009984970092773438 time for calcul the mask position with numpy : 0.018280506134033203 nb_pixel_total : 1451 time to create 1 rle with old method : 0.0019681453704833984 time for calcul the mask position with numpy : 0.01664113998413086 nb_pixel_total : 2479 time to create 1 rle with old method : 0.0028634071350097656 time for calcul the mask position with numpy : 0.01513051986694336 nb_pixel_total : 920 time to create 1 rle with old method : 0.0011000633239746094 time for calcul the mask position with numpy : 0.015180826187133789 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004584789276123047 time for calcul the mask position with numpy : 0.015107870101928711 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.015215158462524414 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0012505054473876953 time for calcul the mask position with numpy : 0.015266180038452148 nb_pixel_total : 3655 time to create 1 rle with old method : 0.004144430160522461 time for calcul the mask position with numpy : 0.015056848526000977 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005381107330322266 time for calcul the mask position with numpy : 0.015146017074584961 nb_pixel_total : 206 time to create 1 rle with old method : 0.00025963783264160156 time for calcul the mask position with numpy : 0.015173912048339844 nb_pixel_total : 4043 time to create 1 rle with old method : 0.004652738571166992 time for calcul the mask position with numpy : 0.0152130126953125 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.015208005905151367 nb_pixel_total : 271 time to create 1 rle with old method : 0.00036215782165527344 time for calcul the mask position with numpy : 0.015213489532470703 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005829334259033203 time for calcul the mask position with numpy : 0.015104293823242188 nb_pixel_total : 441 time to create 1 rle with old method : 0.000568389892578125 time for calcul the mask position with numpy : 0.015891075134277344 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009045600891113281 time for calcul the mask position with numpy : 0.01491689682006836 nb_pixel_total : 1681 time to create 1 rle with old method : 0.0019674301147460938 time for calcul the mask position with numpy : 0.015027523040771484 nb_pixel_total : 371 time to create 1 rle with old method : 0.00045561790466308594 time for calcul the mask position with numpy : 0.015294075012207031 nb_pixel_total : 653 time to create 1 rle with old method : 0.0008411407470703125 time for calcul the mask position with numpy : 0.014985322952270508 nb_pixel_total : 890 time to create 1 rle with old method : 0.0010197162628173828 time for calcul the mask position with numpy : 0.014985084533691406 nb_pixel_total : 119 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.014983654022216797 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.015038490295410156 nb_pixel_total : 89 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.014944076538085938 nb_pixel_total : 2186 time to create 1 rle with old method : 0.002496004104614258 time for calcul the mask position with numpy : 0.015032291412353516 nb_pixel_total : 1715 time to create 1 rle with old method : 0.0019919872283935547 time for calcul the mask position with numpy : 0.014985322952270508 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005345344543457031 time for calcul the mask position with numpy : 0.014982461929321289 nb_pixel_total : 2611 time to create 1 rle with old method : 0.0029723644256591797 time for calcul the mask position with numpy : 0.015086174011230469 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004029273986816406 time for calcul the mask position with numpy : 0.01492619514465332 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005466938018798828 time for calcul the mask position with numpy : 0.014895200729370117 nb_pixel_total : 329 time to create 1 rle with old method : 0.00042819976806640625 time for calcul the mask position with numpy : 0.014954090118408203 nb_pixel_total : 2070 time to create 1 rle with old method : 0.002298116683959961 time for calcul the mask position with numpy : 0.014871358871459961 nb_pixel_total : 171 time to create 1 rle with old method : 0.00023865699768066406 time for calcul the mask position with numpy : 0.0149383544921875 nb_pixel_total : 123 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.014922857284545898 nb_pixel_total : 784 time to create 1 rle with old method : 0.0009403228759765625 time for calcul the mask position with numpy : 0.01605987548828125 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004367828369140625 time for calcul the mask position with numpy : 0.014979124069213867 nb_pixel_total : 27 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.015381813049316406 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006008148193359375 time for calcul the mask position with numpy : 0.015280961990356445 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007598400115966797 time for calcul the mask position with numpy : 0.015137195587158203 nb_pixel_total : 216 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.01516103744506836 nb_pixel_total : 55 time to create 1 rle with old method : 9.679794311523438e-05 time for calcul the mask position with numpy : 0.015068292617797852 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005035400390625 time for calcul the mask position with numpy : 0.015037775039672852 nb_pixel_total : 78 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.015055656433105469 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.014927148818969727 nb_pixel_total : 150 time to create 1 rle with old method : 0.00019407272338867188 time for calcul the mask position with numpy : 0.01508331298828125 nb_pixel_total : 31854 time to create 1 rle with old method : 0.03471994400024414 time for calcul the mask position with numpy : 0.015135765075683594 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002682209014892578 time for calcul the mask position with numpy : 0.01502847671508789 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.015113592147827148 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003914833068847656 time for calcul the mask position with numpy : 0.017469167709350586 nb_pixel_total : 565 time to create 1 rle with old method : 0.0009377002716064453 time for calcul the mask position with numpy : 0.01741957664489746 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.017318010330200195 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005855560302734375 time for calcul the mask position with numpy : 0.017327308654785156 nb_pixel_total : 369 time to create 1 rle with old method : 0.0006172657012939453 time for calcul the mask position with numpy : 0.01566171646118164 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.01502084732055664 nb_pixel_total : 149 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.014937400817871094 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007026195526123047 time for calcul the mask position with numpy : 0.01500082015991211 nb_pixel_total : 291 time to create 1 rle with old method : 0.00037932395935058594 time for calcul the mask position with numpy : 0.014917135238647461 nb_pixel_total : 13 time to create 1 rle with old method : 2.5033950805664062e-05 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.01491856575012207 nb_pixel_total : 344 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.015005111694335938 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001850128173828125 time for calcul the mask position with numpy : 0.0179290771484375 nb_pixel_total : 344 time to create 1 rle with old method : 0.00040149688720703125 time for calcul the mask position with numpy : 0.015029430389404297 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005519390106201172 time for calcul the mask position with numpy : 0.01587986946105957 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0015254020690917969 time for calcul the mask position with numpy : 0.015211343765258789 nb_pixel_total : 193 time to create 1 rle with old method : 0.00023555755615234375 time for calcul the mask position with numpy : 0.015149831771850586 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.015034675598144531 nb_pixel_total : 360 time to create 1 rle with old method : 0.00044798851013183594 time for calcul the mask position with numpy : 0.01500248908996582 nb_pixel_total : 173 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.014999866485595703 nb_pixel_total : 162 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.015066146850585938 nb_pixel_total : 349 time to create 1 rle with old method : 0.00042247772216796875 time for calcul the mask position with numpy : 0.014970779418945312 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006387233734130859 time for calcul the mask position with numpy : 0.014921903610229492 nb_pixel_total : 238 time to create 1 rle with old method : 0.00034809112548828125 time for calcul the mask position with numpy : 0.014940023422241211 nb_pixel_total : 1590 time to create 1 rle with old method : 0.0019118785858154297 time for calcul the mask position with numpy : 0.014940500259399414 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0012536048889160156 time for calcul the mask position with numpy : 0.014964103698730469 nb_pixel_total : 472 time to create 1 rle with old method : 0.0007178783416748047 time for calcul the mask position with numpy : 0.014928579330444336 nb_pixel_total : 13528 time to create 1 rle with old method : 0.014900922775268555 time for calcul the mask position with numpy : 0.014918088912963867 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.01586627960205078 nb_pixel_total : 10848 time to create 1 rle with old method : 0.01174163818359375 time for calcul the mask position with numpy : 0.014936685562133789 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0015759468078613281 time for calcul the mask position with numpy : 0.014892816543579102 nb_pixel_total : 88 time to create 1 rle with old method : 0.00010657310485839844 time for calcul the mask position with numpy : 0.0148773193359375 nb_pixel_total : 97 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.014992952346801758 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007660388946533203 create new chi : 6.902731418609619 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.02048015594482422 batch 1 Loaded 381 chid ids of type : 4230 Number RLEs to save : 27802 TO DO : save crop sub photo not yet done ! save time : 1.5792338848114014 map_output_result : {1337287150: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 1 /1337287150.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012123584747314453 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.709684371948242 time spend to save output : 0.012410402297973633 total time spend for step 4 : 10.722094774246216 step5:crop_condition Thu Feb 13 08:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 381 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 235 About to insert : list_path_to_insert length 235 new photo from crops ! About to upload 235 photos upload in portfolio : 4869462 init cache_photo without model_param we have 235 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431273_2845708 we have uploaded 235 photos in the portfolio 4869462 time of upload the photos Elapsed time : 49.210917711257935 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 4869462 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431323_2845708 we have uploaded 39 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.772874593734741 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431333_2845708 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6166620254516602 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431334_2845708 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.8470237255096436 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431338_2845708 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.5109834671020508 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739431340_2845708 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.4727773666381836 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 296 /1337298818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337298999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337299191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 889 time used for this insertion : 0.051819562911987305 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.35498023033142 time spend to save output : 0.062247276306152344 total time spend for step 5 : 72.41722750663757 step6:thcl Thu Feb 13 08:22:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.0204010009765625 time to convert the images to numpy array : 0.09556746482849121 time to import caffe and check if the image exist : 0.013487100601196289 time to convert the images to numpy array : 0.10731816291809082 time to import caffe and check if the image exist : 0.029893159866333008 time to convert the images to numpy array : 0.10049843788146973 time to import caffe and check if the image exist : 0.04726743698120117 time to convert the images to numpy array : 0.08792805671691895 time to import caffe and check if the image exist : 0.032377004623413086 time to convert the images to numpy array : 0.10293436050415039 time to import caffe and check if the image exist : 0.017282724380493164 time to convert the images to numpy array : 0.11873984336853027 time to import caffe and check if the image exist : 0.02720475196838379 time to convert the images to numpy array : 0.11125588417053223 time to import caffe and check if the image exist : 0.04561328887939453 time to convert the images to numpy array : 0.09408855438232422 time to import caffe and check if the image exist : 0.029152393341064453 time to convert the images to numpy array : 0.11196351051330566 time to import caffe and check if the image exist : 0.045252323150634766 time to convert the images to numpy array : 0.09547996520996094 total time to convert the images to numpy array : 0.43566346168518066 list photo_ids error: [] list photo_ids correct : [1337298818, 1337298819, 1337298820, 1337298821, 1337298822, 1337298823, 1337298824, 1337298825, 1337298826, 1337298827, 1337298828, 1337298829, 1337298830, 1337298831, 1337298832, 1337298833, 1337298834, 1337298835, 1337298836, 1337298837, 1337298838, 1337298839, 1337298840, 1337298841, 1337298842, 1337298843, 1337298844, 1337298845, 1337298846, 1337298847, 1337299144, 1337299145, 1337299146, 1337299147, 1337299149, 1337299168, 1337299169, 1337299170, 1337299171, 1337299172, 1337299173, 1337299174, 1337299175, 1337299176, 1337299177, 1337299178, 1337299179, 1337299180, 1337299181, 1337299184, 1337299185, 1337299186, 1337299187, 1337299188, 1337299189, 1337299191, 1337298909, 1337298910, 1337298911, 1337298912, 1337298913, 1337298914, 1337298915, 1337298916, 1337298917, 1337298918, 1337298919, 1337298920, 1337298921, 1337298922, 1337298923, 1337298926, 1337298930, 1337298934, 1337298938, 1337298942, 1337298946, 1337298950, 1337298953, 1337298954, 1337298955, 1337298956, 1337298957, 1337298958, 1337298959, 1337298960, 1337298848, 1337298849, 1337298850, 1337298851, 1337298852, 1337298853, 1337298854, 1337298855, 1337298856, 1337298857, 1337298858, 1337298859, 1337298860, 1337298861, 1337298862, 1337298863, 1337298864, 1337298865, 1337298866, 1337298867, 1337298868, 1337298869, 1337298870, 1337298871, 1337298872, 1337298873, 1337298874, 1337298875, 1337298876, 1337298877, 1337299113, 1337299114, 1337299115, 1337299116, 1337299117, 1337299118, 1337299119, 1337299120, 1337299121, 1337299122, 1337299123, 1337299124, 1337299125, 1337299126, 1337299127, 1337299128, 1337299129, 1337299130, 1337299131, 1337299132, 1337299133, 1337299134, 1337299135, 1337299136, 1337299137, 1337299139, 1337299140, 1337299141, 1337299142, 1337299143, 1337299053, 1337299054, 1337299055, 1337299056, 1337299058, 1337299061, 1337299065, 1337299066, 1337299067, 1337299068, 1337299070, 1337299071, 1337299072, 1337299073, 1337299074, 1337299075, 1337299076, 1337299077, 1337299078, 1337299079, 1337299080, 1337299081, 1337299082, 1337299083, 1337299084, 1337299108, 1337299109, 1337299110, 1337299111, 1337299112, 1337298993, 1337298994, 1337298995, 1337298996, 1337298997, 1337298998, 1337298999, 1337299000, 1337299001, 1337299002, 1337299003, 1337299004, 1337299005, 1337299006, 1337299007, 1337299008, 1337299009, 1337299010, 1337299011, 1337299012, 1337299013, 1337299014, 1337299015, 1337299016, 1337299017, 1337299018, 1337299019, 1337299020, 1337299021, 1337299022, 1337298879, 1337298880, 1337298881, 1337298882, 1337298883, 1337298884, 1337298885, 1337298886, 1337298887, 1337298888, 1337298889, 1337298890, 1337298891, 1337298892, 1337298893, 1337298894, 1337298895, 1337298896, 1337298897, 1337298898, 1337298899, 1337298900, 1337298901, 1337298902, 1337298903, 1337298904, 1337298905, 1337298906, 1337298907, 1337298908, 1337299023, 1337299024, 1337299025, 1337299026, 1337299027, 1337299028, 1337299029, 1337299030, 1337299031, 1337299032, 1337299033, 1337299034, 1337299035, 1337299036, 1337299037, 1337299038, 1337299039, 1337299040, 1337299041, 1337299042, 1337299043, 1337299044, 1337299045, 1337299046, 1337299047, 1337299048, 1337299049, 1337299050, 1337299051, 1337299052, 1337298961, 1337298962, 1337298963, 1337298964, 1337298965, 1337298967, 1337298968, 1337298969, 1337298970, 1337298971, 1337298972, 1337298973, 1337298974, 1337298975, 1337298976, 1337298977, 1337298978, 1337298979, 1337298980, 1337298981, 1337298982, 1337298983, 1337298984, 1337298985, 1337298986, 1337298987, 1337298988, 1337298990, 1337298991, 1337298992] number of photos to traite : 296 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10111 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9892 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.8623499870300293 time used to do the prediction : 1.2233781814575195 save descriptor for thcl : 3237 time to traite the descriptors : 1.8600142002105713 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337298818 To insert : 1337298819 To insert : 1337298820 To insert : 1337298821 To insert : 1337298822 To insert : 1337298823 To insert : 1337298824 To insert : 1337298825 To insert : 1337298826 To insert : 1337298827 To insert : 1337298828 To insert : 1337298829 To insert : 1337298830 To insert : 1337298831 To insert : 1337298832 To insert : 1337298833 To insert : 1337298834 To insert : 1337298835 To insert : 1337298836 To insert : 1337298837 To insert : 1337298838 To insert : 1337298839 To insert : 1337298840 To insert : 1337298841 To insert : 1337298842 To insert : 1337298843 To insert : 1337298844 To insert : 1337298845 To insert : 1337298846 To insert : 1337298847 To insert : 1337299144 To insert : 1337299145 To insert : 1337299146 To insert : 1337299147 To insert : 1337299149 To insert : 1337299168 To insert : 1337299169 To insert : 1337299170 To insert : 1337299171 To insert : 1337299172 To insert : 1337299173 To insert : 1337299174 To insert : 1337299175 To insert : 1337299176 To insert : 1337299177 To insert : 1337299178 To insert : 1337299179 To insert : 1337299180 To insert : 1337299181 To insert : 1337299184 To insert : 1337299185 To insert : 1337299186 To insert : 1337299187 To insert : 1337299188 To insert : 1337299189 To insert : 1337299191 To insert : 1337298909 To insert : 1337298910 To insert : 1337298911 To insert : 1337298912 To insert : 1337298913 To insert : 1337298914 To insert : 1337298915 To insert : 1337298916 To insert : 1337298917 To insert : 1337298918 To insert : 1337298919 To insert : 1337298920 To insert : 1337298921 To insert : 1337298922 To insert : 1337298923 To insert : 1337298926 To insert : 1337298930 To insert : 1337298934 To insert : 1337298938 To insert : 1337298942 To insert : 1337298946 To insert : 1337298950 To insert : 1337298953 To insert : 1337298954 To insert : 1337298955 To insert : 1337298956 To insert : 1337298957 To insert : 1337298958 To insert : 1337298959 To insert : 1337298960 To insert : 1337298848 To insert : 1337298849 To insert : 1337298850 To insert : 1337298851 To insert : 1337298852 To insert : 1337298853 To insert : 1337298854 To insert : 1337298855 To insert : 1337298856 To insert : 1337298857 To insert : 1337298858 To insert : 1337298859 To insert : 1337298860 To insert : 1337298861 To insert : 1337298862 To insert : 1337298863 To insert : 1337298864 To insert : 1337298865 To insert : 1337298866 To insert : 1337298867 To insert : 1337298868 To insert : 1337298869 To insert : 1337298870 To insert : 1337298871 To insert : 1337298872 To insert : 1337298873 To insert : 1337298874 To insert : 1337298875 To insert : 1337298876 To insert : 1337298877 To insert : 1337299113 To insert : 1337299114 To insert : 1337299115 To insert : 1337299116 To insert : 1337299117 To insert : 1337299118 To insert : 1337299119 To insert : 1337299120 To insert : 1337299121 To insert : 1337299122 To insert : 1337299123 To insert : 1337299124 To insert : 1337299125 To insert : 1337299126 To insert : 1337299127 To insert : 1337299128 To insert : 1337299129 To insert : 1337299130 To insert : 1337299131 To insert : 1337299132 To insert : 1337299133 To insert : 1337299134 To insert : 1337299135 To insert : 1337299136 To insert : 1337299137 To insert : 1337299139 To insert : 1337299140 To insert : 1337299141 To insert : 1337299142 To insert : 1337299143 To insert : 1337299053 To insert : 1337299054 To insert : 1337299055 To insert : 1337299056 To insert : 1337299058 To insert : 1337299061 To insert : 1337299065 To insert : 1337299066 To insert : 1337299067 To insert : 1337299068 To insert : 1337299070 To insert : 1337299071 To insert : 1337299072 To insert : 1337299073 To insert : 1337299074 To insert : 1337299075 To insert : 1337299076 To insert : 1337299077 To insert : 1337299078 To insert : 1337299079 To insert : 1337299080 To insert : 1337299081 To insert : 1337299082 To insert : 1337299083 To insert : 1337299084 To insert : 1337299108 To insert : 1337299109 To insert : 1337299110 To insert : 1337299111 To insert : 1337299112 To insert : 1337298993 To insert : 1337298994 To insert : 1337298995 To insert : 1337298996 To insert : 1337298997 To insert : 1337298998 To insert : 1337298999 To insert : 1337299000 To insert : 1337299001 To insert : 1337299002 To insert : 1337299003 To insert : 1337299004 To insert : 1337299005 To insert : 1337299006 To insert : 1337299007 To insert : 1337299008 To insert : 1337299009 To insert : 1337299010 To insert : 1337299011 To insert : 1337299012 To insert : 1337299013 To insert : 1337299014 To insert : 1337299015 To insert : 1337299016 To insert : 1337299017 To insert : 1337299018 To insert : 1337299019 To insert : 1337299020 To insert : 1337299021 To insert : 1337299022 To insert : 1337298879 To insert : 1337298880 To insert : 1337298881 To insert : 1337298882 To insert : 1337298883 To insert : 1337298884 To insert : 1337298885 To insert : 1337298886 To insert : 1337298887 To insert : 1337298888 To insert : 1337298889 To insert : 1337298890 To insert : 1337298891 To insert : 1337298892 To insert : 1337298893 To insert : 1337298894 To insert : 1337298895 To insert : 1337298896 To insert : 1337298897 To insert : 1337298898 To insert : 1337298899 To insert : 1337298900 To insert : 1337298901 To insert : 1337298902 To insert : 1337298903 To insert : 1337298904 To insert : 1337298905 To insert : 1337298906 To insert : 1337298907 To insert : 1337298908 To insert : 1337299023 To insert : 1337299024 To insert : 1337299025 To insert : 1337299026 To insert : 1337299027 To insert : 1337299028 To insert : 1337299029 To insert : 1337299030 To insert : 1337299031 To insert : 1337299032 To insert : 1337299033 To insert : 1337299034 To insert : 1337299035 To insert : 1337299036 To insert : 1337299037 To insert : 1337299038 To insert : 1337299039 To insert : 1337299040 To insert : 1337299041 To insert : 1337299042 To insert : 1337299043 To insert : 1337299044 To insert : 1337299045 To insert : 1337299046 To insert : 1337299047 To insert : 1337299048 To insert : 1337299049 To insert : 1337299050 To insert : 1337299051 To insert : 1337299052 To insert : 1337298961 To insert : 1337298962 To insert : 1337298963 To insert : 1337298964 To insert : 1337298965 To insert : 1337298967 To insert : 1337298968 To insert : 1337298969 To insert : 1337298970 To insert : 1337298971 To insert : 1337298972 To insert : 1337298973 To insert : 1337298974 To insert : 1337298975 To insert : 1337298976 To insert : 1337298977 To insert : 1337298978 To insert : 1337298979 To insert : 1337298980 To insert : 1337298981 To insert : 1337298982 To insert : 1337298983 To insert : 1337298984 To insert : 1337298985 To insert : 1337298986 To insert : 1337298987 To insert : 1337298988 To insert : 1337298990 To insert : 1337298991 To insert : 1337298992 time to insert the descriptors : 56.332075357437134 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 455 time used for this insertion : 0.03217267990112305 save missing photos in datou_result : time spend for datou_step_exec : 65.80652046203613 time spend to save output : 0.12525558471679688 total time spend for step 6 : 65.93177604675293 step7:ventilate_hashtags_in_portfolio Thu Feb 13 08:23:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20501972 get user id for portfolio 20501972 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20501972 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pet_clair','pehd','PEHD','PET_fonce','papier','autre','metal','Papier','Tetrapak','carton','Carton','Film_plastique','refus','flou','PET_clair','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20501972 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pet_clair','pehd','PEHD','PET_fonce','papier','autre','metal','Papier','Tetrapak','carton','Carton','Film_plastique','refus','flou','PET_clair','pet_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20501972 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pet_clair','pehd','PEHD','PET_fonce','papier','autre','metal','Papier','Tetrapak','carton','Carton','Film_plastique','refus','flou','PET_clair','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20501972 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pet_clair','pehd','PEHD','PET_fonce','papier','autre','metal','Papier','Tetrapak','carton','Carton','Film_plastique','refus','flou','PET_clair','pet_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20503026,20503027,20503042,20503030,20503043,20503035,20503033,20503034,20503036,20503038,20503039,20503040,20503041?tags=environnement,mal_croppe,pet_clair,pehd,pet_fonce,papier,autre,metal,tetrapak,carton,film_plastique,refus,flou&datou_id_consolidate=4235&port_consolidate=20501972 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 1 /20501972. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012737274169921875 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7002954483032227 time spend to save output : 0.012995719909667969 total time spend for step 7 : 3.7132911682128906 step8:final Thu Feb 13 08:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337287150: ('0.7557882263951448',)} new output for save of step final : {1337287150: ('0.7557882263951448',)} [1337287150] Looping around the photos to save general results len do output : 1 /1337287150.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01146554946899414 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10616779327392578 time spend to save output : 0.01164102554321289 total time spend for step 8 : 0.11780881881713867 step9:velours_tree Thu Feb 13 08:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20503026,20503027,20503042,20503030,20503043,20503035,20503033,20503034,20503036,20503038,20503039,20503040,20503041 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503026 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503027 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503042 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503030 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503043 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503035 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503033 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503034 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503036 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503038 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503039 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503040 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20503041 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 296 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 5 1 5 3 5 3 1 1 1 1 1 5 5 0 0 5 5 3 1 5 5 3 3 1 1 1 3 5 1 3 5 3 5 0 0 0 0 3 3 5 2 0 3 5 5 3 3 5 3 2 1 2 5 3 1 3 0 1 5 3 2 2 3 1 3 5 0 3 2 3 3 1 5 3 2 2 5 3 3 0 0 3 0 0 2 0 0 5 3 5 1 3 5 5 5 2 2 5 3 3 5 0 0 5 5 1 5 2 0 5 5 3 0 5 0 0 0 1 1 5 0 0 2 3 1 0 4 5 5 0 2 0 5 2 2 1 3 0 0 5 0 0 0 3 0 0 5 5 5 2 3 5 5 0 3 2 1 3 3 3 3 3 5 3 3 3 0 1 5 5 0 1 5 0 4 4 0 1 2 0 0 2 2 1 2 0 1 5 1 5 3 3 0 1 3 0 3 3 5 3 0 4 4 2 3 1 4 1 4 2 3 1 4 1 1 5 3 5 5 4 1 4 0 1 2 1 1 1 1 1 3 1 2 1 1 1 1 1 2 1 5 1 2 1 3 1 1 5 4 5 5 0 4 1 1 1 3 3 1 3 1 3 1 3 2 5 1 1 5 0 1 1 1 2 0 0 1 1 4 5 1 4 1 0 4 1 1 1 1 1 0 1 1 2 2] Elapsed time: 0.07858777046203613 graph_id used : 78335 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20503026,20503027,20503042,20503030,20503043,20503035,20503033,20503034,20503036,20503038,20503039,20503040,20503041?tags=environnement,mal_croppe,pet_clair,pehd,pet_fonce,papier,autre,metal,tetrapak,carton,film_plastique,refus,flou&datou_id_consolidate=4235&port_consolidate=20501972&tree_id=78335 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 1 /20501972Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.011811017990112305 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.0154390335083 time spend to save output : 0.012221097946166992 total time spend for step 9 : 18.027660131454468 step10:send_mail_cod Thu Feb 13 08:23:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf 20503009 imagette205030091739431428 20503024 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205030241739431428 20503012 change filename to text .imagette205030121739431429 20503025 imagette205030251739431429 20503017 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205030171739431429 20503015 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205030151739431430 20503016 change filename to text .imagette205030161739431430 20503018 imagette205030181739431430 20503020 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205030201739431430 20503021 imagette205030211739431431 20503022 imagette205030221739431431 20503023 imagette205030231739431431 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20501972 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20503026,20503027,20503042,20503030,20503043,20503035,20503033,20503034,20503036,20503038,20503039,20503040,20503041?tags=environnement,mal_croppe,pet_clair,pehd,pet_fonce,papier,autre,metal,tetrapak,carton,film_plastique,refus,flou&datou_id_consolidate=4235&port_consolidate=20501972&tree_id=78335 your option no_mail is active, we will not send the real mail to your client args[1337287150] : ((1337287150, -8.191397740934221, 492609224), (1337287150, 0.20273577141107332, 2107752395), '0.7557882263951448') apple ((1337287150, -8.191397740934221, 492609224), (1337287150, 0.20273577141107332, 2107752395), '0.7557882263951448') We are sending mail with results at cod@fotonower.com refus_total : 0.7557882263951448 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20501972 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20501972','results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf','pdf','','0.14','0.7557882263951448') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.020650625228881836 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.9624295234680176 time spend to save output : 0.02085709571838379 total time spend for step 10 : 3.9832866191864014 step11:split_time_score Thu Feb 13 08:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13022025 20501972 Nombre de photos uploadées : 1 / 23040 (0%) 13022025 20501972 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 13022025 20501972 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.0002110004425048828 elapsed_time : insert_dashboard_record_day_entry 0.02702641487121582 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.7320862458592583 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20494576_13-02-2025_02_24_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20494576 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20494576 AND mptpi.`type`=4230 To do Qualite : 0.7264310720241793 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20494579_13-02-2025_02_06_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20494579 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20494579 AND mptpi.`type`=4230 To do Qualite : 0.7299822365685799 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20495174_13-02-2025_03_00_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20495174 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20495174 AND mptpi.`type`=4230 To do Qualite : 0.7655406163139977 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20496027_13-02-2025_04_00_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20496027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20496027 AND mptpi.`type`=4230 To do Qualite : 0.7600945025030146 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20496534_13-02-2025_05_18_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20496534 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20496534 AND mptpi.`type`=4230 To do Qualite : 0.7453883550976724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20497999_13-02-2025_06_18_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20497999 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20497999 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20499944 order by id desc limit 1 Qualite : 0.7557882263951448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20501972_13-02-2025_08_23_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20501972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20501972 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337287150] Looping around the photos to save general results len do output : 1 /20501972Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2581837') ('4234', '20501972', '1337287150', None, None, None, None, None, '2581837') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012128829956054688 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3889265060424805 time spend to save output : 0.01234889030456543 total time spend for step 11 : 1.401275396347046 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 43.83user 26.17system 3:29.71elapsed 33%CPU (0avgtext+0avgdata 2455784maxresident)k 946584inputs+17688outputs (3886major+4062821minor)pagefaults 0swaps