TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2709946'] with mtr_portfolio_ids : ['21917362'] and first list_photo_ids : [] new path : /proc/381571/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 2.0058655738830566 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 31 18:21:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1508 wait 20 seconds l 3637 free memory gpu now : 1508 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-31 18:21:53.385142: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-31 18:21:53.411144: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-31 18:21:53.413275: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6a08000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-31 18:21:53.413306: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-31 18:21:53.417398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-31 18:21:53.680491: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x31dffdd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-31 18:21:53.680557: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-31 18:21:53.681577: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:21:53.682117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:21:53.685589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:21:53.688819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:21:53.689243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:21:53.692695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:21:53.694162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:21:53.700873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:21:53.702178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:21:53.702265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:21:53.702982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-31 18:21:53.703001: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-31 18:21:53.703012: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-31 18:21:53.704161: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4825 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-31 18:21:54.013936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:21:54.014059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:21:54.014102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:21:54.014133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:21:54.014159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:21:54.014191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:21:54.014228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:21:54.014258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:21:54.015947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:21:54.017033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:21:54.017067: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:21:54.017082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:21:54.017108: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:21:54.017122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:21:54.017136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:21:54.017150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:21:54.017164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:21:54.018839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:21:54.019181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-31 18:21:54.019197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-31 18:21:54.019208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-31 18:21:54.020555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4825 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-31 18:22:07.243781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:22:07.454877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:22:08.966547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 382444 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 185 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5066 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.03015613555908203 nb_pixel_total : 290220 time to create 1 rle with new method : 0.026332855224609375 length of segment : 857 time for calcul the mask position with numpy : 0.001934051513671875 nb_pixel_total : 153123 time to create 1 rle with new method : 0.005315542221069336 length of segment : 464 time for calcul the mask position with numpy : 0.0019457340240478516 nb_pixel_total : 127188 time to create 1 rle with old method : 0.14380955696105957 length of segment : 449 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 6425 time to create 1 rle with old method : 0.007498741149902344 length of segment : 92 time for calcul the mask position with numpy : 0.0004706382751464844 nb_pixel_total : 29187 time to create 1 rle with old method : 0.03371024131774902 length of segment : 290 time for calcul the mask position with numpy : 0.0020172595977783203 nb_pixel_total : 89578 time to create 1 rle with old method : 0.10186600685119629 length of segment : 527 time for calcul the mask position with numpy : 0.0007615089416503906 nb_pixel_total : 48801 time to create 1 rle with old method : 0.05728578567504883 length of segment : 260 time for calcul the mask position with numpy : 0.0019214153289794922 nb_pixel_total : 141922 time to create 1 rle with old method : 0.16211652755737305 length of segment : 565 time for calcul the mask position with numpy : 0.002230405807495117 nb_pixel_total : 64835 time to create 1 rle with old method : 0.07975554466247559 length of segment : 557 time for calcul the mask position with numpy : 0.0031905174255371094 nb_pixel_total : 182449 time to create 1 rle with new method : 0.012109994888305664 length of segment : 549 time for calcul the mask position with numpy : 0.03716635704040527 nb_pixel_total : 1088041 time to create 1 rle with new method : 0.2686746120452881 length of segment : 1618 time for calcul the mask position with numpy : 0.0013878345489501953 nb_pixel_total : 84080 time to create 1 rle with old method : 0.09995245933532715 length of segment : 198 time for calcul the mask position with numpy : 0.006554126739501953 nb_pixel_total : 380902 time to create 1 rle with new method : 0.02442789077758789 length of segment : 813 time for calcul the mask position with numpy : 0.0004966259002685547 nb_pixel_total : 31904 time to create 1 rle with old method : 0.03641819953918457 length of segment : 271 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 13753 time to create 1 rle with old method : 0.015786409378051758 length of segment : 104 time for calcul the mask position with numpy : 0.0021660327911376953 nb_pixel_total : 190975 time to create 1 rle with new method : 0.005001068115234375 length of segment : 430 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 59092 time to create 1 rle with old method : 0.06586837768554688 length of segment : 374 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 30469 time to create 1 rle with old method : 0.03531670570373535 length of segment : 201 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 5276 time to create 1 rle with old method : 0.006417512893676758 length of segment : 81 time for calcul the mask position with numpy : 0.000782012939453125 nb_pixel_total : 62114 time to create 1 rle with old method : 0.0693669319152832 length of segment : 362 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 22048 time to create 1 rle with old method : 0.02581334114074707 length of segment : 288 time for calcul the mask position with numpy : 0.0021827220916748047 nb_pixel_total : 183294 time to create 1 rle with new method : 0.004588127136230469 length of segment : 395 time for calcul the mask position with numpy : 0.0009894371032714844 nb_pixel_total : 60870 time to create 1 rle with old method : 0.07537364959716797 length of segment : 340 time for calcul the mask position with numpy : 0.0006339550018310547 nb_pixel_total : 47179 time to create 1 rle with old method : 0.05412125587463379 length of segment : 300 time for calcul the mask position with numpy : 0.0010569095611572266 nb_pixel_total : 56727 time to create 1 rle with old method : 0.06594443321228027 length of segment : 344 time for calcul the mask position with numpy : 0.000675201416015625 nb_pixel_total : 41438 time to create 1 rle with old method : 0.049745798110961914 length of segment : 274 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 22434 time to create 1 rle with old method : 0.02939319610595703 length of segment : 161 time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 56184 time to create 1 rle with old method : 0.07024955749511719 length of segment : 373 time for calcul the mask position with numpy : 0.0010631084442138672 nb_pixel_total : 72189 time to create 1 rle with old method : 0.08401703834533691 length of segment : 424 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 5738 time to create 1 rle with old method : 0.00682830810546875 length of segment : 81 time for calcul the mask position with numpy : 0.0013005733489990234 nb_pixel_total : 36292 time to create 1 rle with old method : 0.044040679931640625 length of segment : 268 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2734 time to create 1 rle with old method : 0.003419160842895508 length of segment : 61 time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 4761 time to create 1 rle with old method : 0.00801396369934082 length of segment : 120 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 45544 time to create 1 rle with old method : 0.07088589668273926 length of segment : 231 time for calcul the mask position with numpy : 0.0017180442810058594 nb_pixel_total : 109606 time to create 1 rle with old method : 0.12436652183532715 length of segment : 495 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 8097 time to create 1 rle with old method : 0.009546041488647461 length of segment : 123 time for calcul the mask position with numpy : 0.0015871524810791016 nb_pixel_total : 78631 time to create 1 rle with old method : 0.09732294082641602 length of segment : 640 time for calcul the mask position with numpy : 0.0024712085723876953 nb_pixel_total : 174021 time to create 1 rle with new method : 0.005785942077636719 length of segment : 537 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 20551 time to create 1 rle with old method : 0.022883176803588867 length of segment : 140 time for calcul the mask position with numpy : 0.00104522705078125 nb_pixel_total : 59133 time to create 1 rle with old method : 0.06527495384216309 length of segment : 380 time for calcul the mask position with numpy : 0.003484964370727539 nb_pixel_total : 113214 time to create 1 rle with old method : 0.12466692924499512 length of segment : 553 time for calcul the mask position with numpy : 0.001337289810180664 nb_pixel_total : 63317 time to create 1 rle with old method : 0.07084417343139648 length of segment : 202 time for calcul the mask position with numpy : 0.001252889633178711 nb_pixel_total : 39543 time to create 1 rle with old method : 0.04374885559082031 length of segment : 179 time for calcul the mask position with numpy : 0.0017504692077636719 nb_pixel_total : 91912 time to create 1 rle with old method : 0.10072040557861328 length of segment : 327 time for calcul the mask position with numpy : 0.0006270408630371094 nb_pixel_total : 20086 time to create 1 rle with old method : 0.0237429141998291 length of segment : 181 time for calcul the mask position with numpy : 0.0027060508728027344 nb_pixel_total : 94653 time to create 1 rle with old method : 0.10990691184997559 length of segment : 562 time for calcul the mask position with numpy : 0.0005629062652587891 nb_pixel_total : 15363 time to create 1 rle with old method : 0.025397300720214844 length of segment : 151 time for calcul the mask position with numpy : 0.0004889965057373047 nb_pixel_total : 19483 time to create 1 rle with old method : 0.03702044486999512 length of segment : 95 time for calcul the mask position with numpy : 0.001566171646118164 nb_pixel_total : 51670 time to create 1 rle with old method : 0.08537650108337402 length of segment : 310 time for calcul the mask position with numpy : 0.004975795745849609 nb_pixel_total : 212533 time to create 1 rle with new method : 0.009724855422973633 length of segment : 540 time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 54618 time to create 1 rle with old method : 0.06608033180236816 length of segment : 244 time for calcul the mask position with numpy : 0.007807254791259766 nb_pixel_total : 402847 time to create 1 rle with new method : 0.014088869094848633 length of segment : 873 time for calcul the mask position with numpy : 0.0014598369598388672 nb_pixel_total : 43513 time to create 1 rle with old method : 0.050475358963012695 length of segment : 338 time for calcul the mask position with numpy : 0.0007760524749755859 nb_pixel_total : 33033 time to create 1 rle with old method : 0.039408206939697266 length of segment : 149 time for calcul the mask position with numpy : 0.005788564682006836 nb_pixel_total : 267394 time to create 1 rle with new method : 0.009206533432006836 length of segment : 607 time for calcul the mask position with numpy : 0.0009479522705078125 nb_pixel_total : 47940 time to create 1 rle with old method : 0.05646038055419922 length of segment : 418 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 19228 time to create 1 rle with old method : 0.02309274673461914 length of segment : 156 time for calcul the mask position with numpy : 0.011358976364135742 nb_pixel_total : 381932 time to create 1 rle with new method : 0.25362277030944824 length of segment : 780 time for calcul the mask position with numpy : 0.0011661052703857422 nb_pixel_total : 25730 time to create 1 rle with old method : 0.030311107635498047 length of segment : 227 time for calcul the mask position with numpy : 0.002938985824584961 nb_pixel_total : 123068 time to create 1 rle with old method : 0.14053106307983398 length of segment : 633 time for calcul the mask position with numpy : 0.0036242008209228516 nb_pixel_total : 200194 time to create 1 rle with new method : 0.006995677947998047 length of segment : 941 time for calcul the mask position with numpy : 0.00333404541015625 nb_pixel_total : 157597 time to create 1 rle with new method : 0.004776716232299805 length of segment : 611 time for calcul the mask position with numpy : 0.0036008358001708984 nb_pixel_total : 116034 time to create 1 rle with old method : 0.13452577590942383 length of segment : 318 time for calcul the mask position with numpy : 0.0009675025939941406 nb_pixel_total : 34673 time to create 1 rle with old method : 0.04031658172607422 length of segment : 326 time for calcul the mask position with numpy : 0.0020647048950195312 nb_pixel_total : 124963 time to create 1 rle with old method : 0.14344191551208496 length of segment : 321 time for calcul the mask position with numpy : 0.0006699562072753906 nb_pixel_total : 20977 time to create 1 rle with old method : 0.024937152862548828 length of segment : 181 time for calcul the mask position with numpy : 0.0026085376739501953 nb_pixel_total : 82463 time to create 1 rle with old method : 0.09695219993591309 length of segment : 573 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 7665 time to create 1 rle with old method : 0.009608268737792969 length of segment : 61 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 4297 time to create 1 rle with old method : 0.005452156066894531 length of segment : 143 time for calcul the mask position with numpy : 0.0015878677368164062 nb_pixel_total : 83204 time to create 1 rle with old method : 0.09927034378051758 length of segment : 257 time for calcul the mask position with numpy : 0.0008347034454345703 nb_pixel_total : 28097 time to create 1 rle with old method : 0.03333902359008789 length of segment : 185 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 25365 time to create 1 rle with old method : 0.029790878295898438 length of segment : 256 time for calcul the mask position with numpy : 0.7498223781585693 nb_pixel_total : 5695837 time to create 1 rle with new method : 0.9315426349639893 length of segment : 2751 time for calcul the mask position with numpy : 0.5526354312896729 nb_pixel_total : 3885301 time to create 1 rle with new method : 0.43387413024902344 length of segment : 2790 time for calcul the mask position with numpy : 0.0003094673156738281 nb_pixel_total : 18492 time to create 1 rle with old method : 0.021274566650390625 length of segment : 258 time for calcul the mask position with numpy : 0.17947936058044434 nb_pixel_total : 3375549 time to create 1 rle with new method : 0.6529669761657715 length of segment : 3257 time for calcul the mask position with numpy : 0.505291223526001 nb_pixel_total : 4768961 time to create 1 rle with new method : 0.7672314643859863 length of segment : 2607 time for calcul the mask position with numpy : 0.37378907203674316 nb_pixel_total : 3039951 time to create 1 rle with new method : 0.215836763381958 length of segment : 1855 time spent for convertir_results : 19.069481134414673 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 102.81415724754333 time spend to save output : 0.10516047477722168 total time spend for step 1 : 102.91931772232056 step2:mask_detect Mon Mar 31 18:23:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5064 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-31 18:23:16.053346: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-31 18:23:16.079117: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-31 18:23:16.080598: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f69f8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-31 18:23:16.080651: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-31 18:23:16.083345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-31 18:23:16.205924: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x32ae61b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-31 18:23:16.205976: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-31 18:23:16.206725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:23:16.207167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:23:16.209631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:23:16.212130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:23:16.212516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:23:16.215325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:23:16.216719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:23:16.222380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:23:16.223853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:23:16.223966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:23:16.224737: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-31 18:23:16.224755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-31 18:23:16.224766: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-31 18:23:16.226090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4612 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-31 18:23:16.337642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:23:16.337728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:23:16.337751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:23:16.337773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:23:16.337793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:23:16.337813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:23:16.337833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:23:16.337853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:23:16.339049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:23:16.340108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-31 18:23:16.340148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-31 18:23:16.340168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:23:16.340188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-31 18:23:16.340207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-31 18:23:16.340226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-31 18:23:16.340245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-31 18:23:16.340276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:23:16.341446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-31 18:23:16.341476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-31 18:23:16.341486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-31 18:23:16.341495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-31 18:23:16.342717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4612 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-31 18:23:30.759015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-31 18:23:30.953897: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-31 18:23:32.484464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 85 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 61 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 385970 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 404 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5285 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.009416818618774414 nb_pixel_total : 80761 time to create 1 rle with old method : 0.12395119667053223 length of segment : 318 time for calcul the mask position with numpy : 0.0048482418060302734 nb_pixel_total : 176198 time to create 1 rle with new method : 0.01444697380065918 length of segment : 429 time for calcul the mask position with numpy : 0.0020341873168945312 nb_pixel_total : 51215 time to create 1 rle with old method : 0.05969047546386719 length of segment : 364 time for calcul the mask position with numpy : 0.002429962158203125 nb_pixel_total : 82667 time to create 1 rle with old method : 0.10691070556640625 length of segment : 462 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 56297 time to create 1 rle with old method : 0.06366419792175293 length of segment : 177 time for calcul the mask position with numpy : 0.0017580986022949219 nb_pixel_total : 57481 time to create 1 rle with old method : 0.08544063568115234 length of segment : 573 time for calcul the mask position with numpy : 0.015989065170288086 nb_pixel_total : 731876 time to create 1 rle with new method : 0.055956363677978516 length of segment : 1127 time for calcul the mask position with numpy : 0.007860422134399414 nb_pixel_total : 238040 time to create 1 rle with new method : 0.015650272369384766 length of segment : 926 time for calcul the mask position with numpy : 0.003685474395751953 nb_pixel_total : 118528 time to create 1 rle with old method : 0.1344614028930664 length of segment : 479 time for calcul the mask position with numpy : 0.001466512680053711 nb_pixel_total : 53956 time to create 1 rle with old method : 0.062478065490722656 length of segment : 277 time for calcul the mask position with numpy : 0.006066083908081055 nb_pixel_total : 344058 time to create 1 rle with new method : 0.01576089859008789 length of segment : 907 time for calcul the mask position with numpy : 0.007297039031982422 nb_pixel_total : 216144 time to create 1 rle with new method : 0.014403104782104492 length of segment : 544 time for calcul the mask position with numpy : 0.00626683235168457 nb_pixel_total : 179057 time to create 1 rle with new method : 0.016592025756835938 length of segment : 521 time for calcul the mask position with numpy : 0.0067708492279052734 nb_pixel_total : 94879 time to create 1 rle with old method : 0.14690780639648438 length of segment : 361 time for calcul the mask position with numpy : 0.008414745330810547 nb_pixel_total : 127507 time to create 1 rle with old method : 0.2193748950958252 length of segment : 431 time for calcul the mask position with numpy : 0.014626741409301758 nb_pixel_total : 191205 time to create 1 rle with new method : 0.011953353881835938 length of segment : 646 time for calcul the mask position with numpy : 0.00578761100769043 nb_pixel_total : 158869 time to create 1 rle with new method : 0.011034250259399414 length of segment : 477 time for calcul the mask position with numpy : 0.009844064712524414 nb_pixel_total : 93913 time to create 1 rle with old method : 0.11412334442138672 length of segment : 380 time for calcul the mask position with numpy : 0.0024843215942382812 nb_pixel_total : 93492 time to create 1 rle with old method : 0.11620426177978516 length of segment : 322 time for calcul the mask position with numpy : 0.004788398742675781 nb_pixel_total : 251596 time to create 1 rle with new method : 0.01221013069152832 length of segment : 600 time for calcul the mask position with numpy : 0.01438450813293457 nb_pixel_total : 112706 time to create 1 rle with old method : 0.1496889591217041 length of segment : 339 time for calcul the mask position with numpy : 0.004763364791870117 nb_pixel_total : 101588 time to create 1 rle with old method : 0.12391281127929688 length of segment : 532 time for calcul the mask position with numpy : 0.021116018295288086 nb_pixel_total : 109437 time to create 1 rle with old method : 0.1244502067565918 length of segment : 449 time for calcul the mask position with numpy : 0.01734638214111328 nb_pixel_total : 251520 time to create 1 rle with new method : 0.017354965209960938 length of segment : 718 time for calcul the mask position with numpy : 0.002972126007080078 nb_pixel_total : 42083 time to create 1 rle with old method : 0.046156883239746094 length of segment : 335 time for calcul the mask position with numpy : 0.0018701553344726562 nb_pixel_total : 28790 time to create 1 rle with old method : 0.033225297927856445 length of segment : 307 time for calcul the mask position with numpy : 0.0036444664001464844 nb_pixel_total : 148979 time to create 1 rle with old method : 0.16538119316101074 length of segment : 541 time for calcul the mask position with numpy : 0.009835243225097656 nb_pixel_total : 262238 time to create 1 rle with new method : 0.020268917083740234 length of segment : 827 time for calcul the mask position with numpy : 0.0020647048950195312 nb_pixel_total : 111903 time to create 1 rle with old method : 0.1270601749420166 length of segment : 253 time for calcul the mask position with numpy : 0.0030956268310546875 nb_pixel_total : 47975 time to create 1 rle with old method : 0.09655237197875977 length of segment : 246 time for calcul the mask position with numpy : 0.0009300708770751953 nb_pixel_total : 32369 time to create 1 rle with old method : 0.040528059005737305 length of segment : 235 time for calcul the mask position with numpy : 0.005387783050537109 nb_pixel_total : 174509 time to create 1 rle with new method : 0.011826038360595703 length of segment : 717 time for calcul the mask position with numpy : 0.0012314319610595703 nb_pixel_total : 19009 time to create 1 rle with old method : 0.04477357864379883 length of segment : 155 time for calcul the mask position with numpy : 0.019387006759643555 nb_pixel_total : 568934 time to create 1 rle with new method : 0.03376650810241699 length of segment : 1180 time for calcul the mask position with numpy : 0.003786325454711914 nb_pixel_total : 64675 time to create 1 rle with old method : 0.07641005516052246 length of segment : 307 time for calcul the mask position with numpy : 0.00024700164794921875 nb_pixel_total : 6861 time to create 1 rle with old method : 0.008332490921020508 length of segment : 124 time for calcul the mask position with numpy : 0.0010459423065185547 nb_pixel_total : 16816 time to create 1 rle with old method : 0.019815683364868164 length of segment : 338 time for calcul the mask position with numpy : 0.016346454620361328 nb_pixel_total : 233174 time to create 1 rle with new method : 0.017678499221801758 length of segment : 712 time for calcul the mask position with numpy : 0.002218961715698242 nb_pixel_total : 14686 time to create 1 rle with old method : 0.017475366592407227 length of segment : 180 time for calcul the mask position with numpy : 0.0029299259185791016 nb_pixel_total : 136462 time to create 1 rle with old method : 0.18815970420837402 length of segment : 601 time for calcul the mask position with numpy : 0.002999544143676758 nb_pixel_total : 104812 time to create 1 rle with old method : 0.12275481224060059 length of segment : 410 time for calcul the mask position with numpy : 0.022214651107788086 nb_pixel_total : 957543 time to create 1 rle with new method : 0.09328389167785645 length of segment : 1146 time for calcul the mask position with numpy : 0.001224517822265625 nb_pixel_total : 54947 time to create 1 rle with old method : 0.061417341232299805 length of segment : 280 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 21358 time to create 1 rle with old method : 0.025725841522216797 length of segment : 125 time for calcul the mask position with numpy : 0.0057544708251953125 nb_pixel_total : 127771 time to create 1 rle with old method : 0.1472933292388916 length of segment : 814 time for calcul the mask position with numpy : 0.001285552978515625 nb_pixel_total : 38096 time to create 1 rle with old method : 0.04499983787536621 length of segment : 234 time for calcul the mask position with numpy : 0.004154205322265625 nb_pixel_total : 194681 time to create 1 rle with new method : 0.011994123458862305 length of segment : 659 time for calcul the mask position with numpy : 0.0009377002716064453 nb_pixel_total : 31228 time to create 1 rle with old method : 0.04126143455505371 length of segment : 246 time for calcul the mask position with numpy : 0.02232217788696289 nb_pixel_total : 900226 time to create 1 rle with new method : 0.11528992652893066 length of segment : 1580 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 15930 time to create 1 rle with old method : 0.019123315811157227 length of segment : 149 time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 58487 time to create 1 rle with old method : 0.08660769462585449 length of segment : 297 time for calcul the mask position with numpy : 0.005223512649536133 nb_pixel_total : 231948 time to create 1 rle with new method : 0.016257524490356445 length of segment : 797 time for calcul the mask position with numpy : 0.0022575855255126953 nb_pixel_total : 112941 time to create 1 rle with old method : 0.12926816940307617 length of segment : 341 time for calcul the mask position with numpy : 0.002485990524291992 nb_pixel_total : 113938 time to create 1 rle with old method : 0.13123798370361328 length of segment : 375 time for calcul the mask position with numpy : 0.00760340690612793 nb_pixel_total : 385466 time to create 1 rle with new method : 0.02638983726501465 length of segment : 1405 time for calcul the mask position with numpy : 0.00101470947265625 nb_pixel_total : 34546 time to create 1 rle with old method : 0.04019594192504883 length of segment : 361 time for calcul the mask position with numpy : 0.008523702621459961 nb_pixel_total : 302891 time to create 1 rle with new method : 0.02200627326965332 length of segment : 936 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 39024 time to create 1 rle with old method : 0.04414963722229004 length of segment : 273 time for calcul the mask position with numpy : 0.003382444381713867 nb_pixel_total : 218369 time to create 1 rle with new method : 0.009181499481201172 length of segment : 437 time for calcul the mask position with numpy : 0.024498462677001953 nb_pixel_total : 955956 time to create 1 rle with new method : 0.16050505638122559 length of segment : 1117 time for calcul the mask position with numpy : 0.002142190933227539 nb_pixel_total : 42486 time to create 1 rle with old method : 0.06992244720458984 length of segment : 238 time for calcul the mask position with numpy : 0.041738033294677734 nb_pixel_total : 1443084 time to create 1 rle with new method : 0.1590557098388672 length of segment : 2070 time for calcul the mask position with numpy : 0.0009868144989013672 nb_pixel_total : 40162 time to create 1 rle with old method : 0.04751229286193848 length of segment : 142 time for calcul the mask position with numpy : 0.0037894248962402344 nb_pixel_total : 193043 time to create 1 rle with new method : 0.010401725769042969 length of segment : 626 time for calcul the mask position with numpy : 0.0037908554077148438 nb_pixel_total : 153817 time to create 1 rle with new method : 0.012048006057739258 length of segment : 693 time for calcul the mask position with numpy : 0.007798433303833008 nb_pixel_total : 309741 time to create 1 rle with new method : 0.0251004695892334 length of segment : 947 time for calcul the mask position with numpy : 0.01697373390197754 nb_pixel_total : 204139 time to create 1 rle with new method : 0.3619246482849121 length of segment : 1691 time for calcul the mask position with numpy : 0.005480289459228516 nb_pixel_total : 158848 time to create 1 rle with new method : 0.0140380859375 length of segment : 476 time for calcul the mask position with numpy : 0.005290031433105469 nb_pixel_total : 142595 time to create 1 rle with old method : 0.17101693153381348 length of segment : 823 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 49008 time to create 1 rle with old method : 0.07487225532531738 length of segment : 244 time for calcul the mask position with numpy : 0.001031637191772461 nb_pixel_total : 39479 time to create 1 rle with old method : 0.04989171028137207 length of segment : 258 time for calcul the mask position with numpy : 0.00162506103515625 nb_pixel_total : 58056 time to create 1 rle with old method : 0.06763911247253418 length of segment : 595 time for calcul the mask position with numpy : 0.0014448165893554688 nb_pixel_total : 58825 time to create 1 rle with old method : 0.07135772705078125 length of segment : 409 time for calcul the mask position with numpy : 0.0015537738800048828 nb_pixel_total : 64086 time to create 1 rle with old method : 0.07466793060302734 length of segment : 369 time for calcul the mask position with numpy : 0.0035636425018310547 nb_pixel_total : 177393 time to create 1 rle with new method : 0.009672880172729492 length of segment : 503 time for calcul the mask position with numpy : 0.004714012145996094 nb_pixel_total : 213301 time to create 1 rle with new method : 0.011840343475341797 length of segment : 570 time for calcul the mask position with numpy : 0.01655864715576172 nb_pixel_total : 730156 time to create 1 rle with new method : 0.19647884368896484 length of segment : 1999 time for calcul the mask position with numpy : 0.0009014606475830078 nb_pixel_total : 36770 time to create 1 rle with old method : 0.04062342643737793 length of segment : 236 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 21852 time to create 1 rle with old method : 0.02493739128112793 length of segment : 172 time for calcul the mask position with numpy : 0.00074005126953125 nb_pixel_total : 30131 time to create 1 rle with old method : 0.03500080108642578 length of segment : 214 time for calcul the mask position with numpy : 0.004650115966796875 nb_pixel_total : 215763 time to create 1 rle with new method : 0.013209342956542969 length of segment : 691 time for calcul the mask position with numpy : 0.0022361278533935547 nb_pixel_total : 80026 time to create 1 rle with old method : 0.09098148345947266 length of segment : 367 time for calcul the mask position with numpy : 0.001786947250366211 nb_pixel_total : 68906 time to create 1 rle with old method : 0.07714533805847168 length of segment : 382 time for calcul the mask position with numpy : 0.0015950202941894531 nb_pixel_total : 49934 time to create 1 rle with old method : 0.05880093574523926 length of segment : 245 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 26974 time to create 1 rle with old method : 0.031952619552612305 length of segment : 390 time for calcul the mask position with numpy : 0.0038170814514160156 nb_pixel_total : 148891 time to create 1 rle with old method : 0.17438840866088867 length of segment : 404 time for calcul the mask position with numpy : 0.004004478454589844 nb_pixel_total : 202917 time to create 1 rle with new method : 0.009656190872192383 length of segment : 437 time for calcul the mask position with numpy : 0.001922607421875 nb_pixel_total : 92128 time to create 1 rle with old method : 0.10313057899475098 length of segment : 392 time for calcul the mask position with numpy : 0.007155179977416992 nb_pixel_total : 283650 time to create 1 rle with new method : 0.020833730697631836 length of segment : 1129 time for calcul the mask position with numpy : 0.003966569900512695 nb_pixel_total : 135644 time to create 1 rle with old method : 0.16323614120483398 length of segment : 483 time for calcul the mask position with numpy : 0.0014116764068603516 nb_pixel_total : 58387 time to create 1 rle with old method : 0.06972169876098633 length of segment : 414 time for calcul the mask position with numpy : 0.0038819313049316406 nb_pixel_total : 109858 time to create 1 rle with old method : 0.12901973724365234 length of segment : 561 time for calcul the mask position with numpy : 0.0046825408935546875 nb_pixel_total : 194348 time to create 1 rle with new method : 0.012914657592773438 length of segment : 672 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 46153 time to create 1 rle with old method : 0.05575060844421387 length of segment : 368 time for calcul the mask position with numpy : 0.002040386199951172 nb_pixel_total : 55878 time to create 1 rle with old method : 0.07723069190979004 length of segment : 291 time for calcul the mask position with numpy : 0.009153366088867188 nb_pixel_total : 361398 time to create 1 rle with new method : 0.029201507568359375 length of segment : 799 time for calcul the mask position with numpy : 0.0013318061828613281 nb_pixel_total : 40212 time to create 1 rle with old method : 0.04768204689025879 length of segment : 323 time for calcul the mask position with numpy : 0.0013785362243652344 nb_pixel_total : 75606 time to create 1 rle with old method : 0.11224865913391113 length of segment : 369 time for calcul the mask position with numpy : 0.005291938781738281 nb_pixel_total : 233635 time to create 1 rle with new method : 0.015979528427124023 length of segment : 913 time for calcul the mask position with numpy : 0.0023522377014160156 nb_pixel_total : 90851 time to create 1 rle with old method : 0.10527300834655762 length of segment : 355 time for calcul the mask position with numpy : 0.004436016082763672 nb_pixel_total : 178002 time to create 1 rle with new method : 0.012592077255249023 length of segment : 731 time for calcul the mask position with numpy : 0.012828588485717773 nb_pixel_total : 368362 time to create 1 rle with new method : 0.041568756103515625 length of segment : 1181 time for calcul the mask position with numpy : 0.0038847923278808594 nb_pixel_total : 172171 time to create 1 rle with new method : 0.012017011642456055 length of segment : 759 time for calcul the mask position with numpy : 0.0006680488586425781 nb_pixel_total : 21634 time to create 1 rle with old method : 0.025822162628173828 length of segment : 203 time for calcul the mask position with numpy : 0.0008306503295898438 nb_pixel_total : 27762 time to create 1 rle with old method : 0.03274226188659668 length of segment : 250 time for calcul the mask position with numpy : 0.005437135696411133 nb_pixel_total : 231227 time to create 1 rle with new method : 0.015984058380126953 length of segment : 677 time for calcul the mask position with numpy : 0.002747058868408203 nb_pixel_total : 109040 time to create 1 rle with old method : 0.12859201431274414 length of segment : 461 time for calcul the mask position with numpy : 0.010998010635375977 nb_pixel_total : 309887 time to create 1 rle with new method : 0.03841209411621094 length of segment : 847 time for calcul the mask position with numpy : 0.0040895938873291016 nb_pixel_total : 172789 time to create 1 rle with new method : 0.012099504470825195 length of segment : 776 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 42280 time to create 1 rle with old method : 0.04997754096984863 length of segment : 222 time for calcul the mask position with numpy : 0.017963409423828125 nb_pixel_total : 457407 time to create 1 rle with new method : 0.060164690017700195 length of segment : 1361 time for calcul the mask position with numpy : 0.007209300994873047 nb_pixel_total : 346169 time to create 1 rle with new method : 0.020847558975219727 length of segment : 1343 time for calcul the mask position with numpy : 0.0011315345764160156 nb_pixel_total : 46758 time to create 1 rle with old method : 0.052440643310546875 length of segment : 331 time for calcul the mask position with numpy : 0.0006098747253417969 nb_pixel_total : 15187 time to create 1 rle with old method : 0.01797938346862793 length of segment : 154 time for calcul the mask position with numpy : 0.0029020309448242188 nb_pixel_total : 138669 time to create 1 rle with old method : 0.15566086769104004 length of segment : 546 time for calcul the mask position with numpy : 0.0026807785034179688 nb_pixel_total : 124758 time to create 1 rle with old method : 0.13773179054260254 length of segment : 645 time for calcul the mask position with numpy : 0.021561145782470703 nb_pixel_total : 1014837 time to create 1 rle with new method : 0.09821939468383789 length of segment : 2254 time for calcul the mask position with numpy : 0.0019106864929199219 nb_pixel_total : 90126 time to create 1 rle with old method : 0.10315704345703125 length of segment : 440 time for calcul the mask position with numpy : 0.0060100555419921875 nb_pixel_total : 162038 time to create 1 rle with new method : 0.019492626190185547 length of segment : 1115 time for calcul the mask position with numpy : 0.005452394485473633 nb_pixel_total : 295954 time to create 1 rle with new method : 0.014871358871459961 length of segment : 643 time for calcul the mask position with numpy : 0.026095867156982422 nb_pixel_total : 877534 time to create 1 rle with new method : 0.3204338550567627 length of segment : 2590 time for calcul the mask position with numpy : 0.0006325244903564453 nb_pixel_total : 32420 time to create 1 rle with old method : 0.037926673889160156 length of segment : 254 time for calcul the mask position with numpy : 0.005169391632080078 nb_pixel_total : 236384 time to create 1 rle with new method : 0.015531301498413086 length of segment : 650 time for calcul the mask position with numpy : 0.0013842582702636719 nb_pixel_total : 56059 time to create 1 rle with old method : 0.0658419132232666 length of segment : 248 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 50524 time to create 1 rle with old method : 0.06190800666809082 length of segment : 235 time for calcul the mask position with numpy : 0.003591299057006836 nb_pixel_total : 100020 time to create 1 rle with old method : 0.11587643623352051 length of segment : 359 time for calcul the mask position with numpy : 0.0010139942169189453 nb_pixel_total : 53043 time to create 1 rle with old method : 0.06128191947937012 length of segment : 261 time for calcul the mask position with numpy : 0.0071048736572265625 nb_pixel_total : 259913 time to create 1 rle with new method : 0.023197174072265625 length of segment : 669 time for calcul the mask position with numpy : 0.004124164581298828 nb_pixel_total : 168048 time to create 1 rle with new method : 0.014831066131591797 length of segment : 809 time for calcul the mask position with numpy : 0.004942655563354492 nb_pixel_total : 220598 time to create 1 rle with new method : 0.016405344009399414 length of segment : 692 time for calcul the mask position with numpy : 0.0005524158477783203 nb_pixel_total : 6781 time to create 1 rle with old method : 0.008358955383300781 length of segment : 292 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 59607 time to create 1 rle with old method : 0.06916379928588867 length of segment : 353 time for calcul the mask position with numpy : 0.0017004013061523438 nb_pixel_total : 69026 time to create 1 rle with old method : 0.07957100868225098 length of segment : 529 time for calcul the mask position with numpy : 0.0032949447631835938 nb_pixel_total : 120027 time to create 1 rle with old method : 0.13412022590637207 length of segment : 601 time for calcul the mask position with numpy : 0.0025091171264648438 nb_pixel_total : 121611 time to create 1 rle with old method : 0.14112305641174316 length of segment : 439 time for calcul the mask position with numpy : 0.010831594467163086 nb_pixel_total : 363851 time to create 1 rle with new method : 0.04325151443481445 length of segment : 1016 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 42788 time to create 1 rle with old method : 0.05532479286193848 length of segment : 248 time for calcul the mask position with numpy : 0.001596212387084961 nb_pixel_total : 49436 time to create 1 rle with old method : 0.06341266632080078 length of segment : 369 time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 8305 time to create 1 rle with old method : 0.00982666015625 length of segment : 302 time for calcul the mask position with numpy : 0.0015249252319335938 nb_pixel_total : 54966 time to create 1 rle with old method : 0.06446003913879395 length of segment : 210 time for calcul the mask position with numpy : 0.01076364517211914 nb_pixel_total : 359272 time to create 1 rle with new method : 0.03951430320739746 length of segment : 837 time for calcul the mask position with numpy : 0.0237579345703125 nb_pixel_total : 454283 time to create 1 rle with new method : 0.4026014804840088 length of segment : 924 time for calcul the mask position with numpy : 0.001020193099975586 nb_pixel_total : 53344 time to create 1 rle with old method : 0.0616455078125 length of segment : 278 time for calcul the mask position with numpy : 0.003147125244140625 nb_pixel_total : 153128 time to create 1 rle with new method : 0.009800195693969727 length of segment : 691 time for calcul the mask position with numpy : 0.0008099079132080078 nb_pixel_total : 32247 time to create 1 rle with old method : 0.03772425651550293 length of segment : 216 time for calcul the mask position with numpy : 0.0028362274169921875 nb_pixel_total : 133595 time to create 1 rle with old method : 0.15501809120178223 length of segment : 567 time for calcul the mask position with numpy : 0.0022771358489990234 nb_pixel_total : 98383 time to create 1 rle with old method : 0.11118555068969727 length of segment : 395 time for calcul the mask position with numpy : 0.0024695396423339844 nb_pixel_total : 88635 time to create 1 rle with old method : 0.10179424285888672 length of segment : 449 time for calcul the mask position with numpy : 0.0033578872680664062 nb_pixel_total : 176120 time to create 1 rle with new method : 0.009534597396850586 length of segment : 547 time for calcul the mask position with numpy : 0.0060007572174072266 nb_pixel_total : 204620 time to create 1 rle with new method : 0.01903700828552246 length of segment : 758 time for calcul the mask position with numpy : 0.0014905929565429688 nb_pixel_total : 67437 time to create 1 rle with old method : 0.09943866729736328 length of segment : 468 time for calcul the mask position with numpy : 0.004690408706665039 nb_pixel_total : 201252 time to create 1 rle with new method : 0.015283346176147461 length of segment : 721 time for calcul the mask position with numpy : 0.0034253597259521484 nb_pixel_total : 172629 time to create 1 rle with new method : 0.010185480117797852 length of segment : 787 time for calcul the mask position with numpy : 0.000997304916381836 nb_pixel_total : 37593 time to create 1 rle with old method : 0.043740034103393555 length of segment : 230 time for calcul the mask position with numpy : 0.0021975040435791016 nb_pixel_total : 122593 time to create 1 rle with old method : 0.13758492469787598 length of segment : 493 time for calcul the mask position with numpy : 0.0010137557983398438 nb_pixel_total : 36306 time to create 1 rle with old method : 0.04136490821838379 length of segment : 233 time for calcul the mask position with numpy : 0.001990795135498047 nb_pixel_total : 85653 time to create 1 rle with old method : 0.09944772720336914 length of segment : 215 time for calcul the mask position with numpy : 0.002780914306640625 nb_pixel_total : 123690 time to create 1 rle with old method : 0.1433556079864502 length of segment : 422 time for calcul the mask position with numpy : 0.004881858825683594 nb_pixel_total : 212824 time to create 1 rle with new method : 0.014853239059448242 length of segment : 668 time for calcul the mask position with numpy : 0.0033333301544189453 nb_pixel_total : 120845 time to create 1 rle with old method : 0.1406254768371582 length of segment : 461 time for calcul the mask position with numpy : 0.003670215606689453 nb_pixel_total : 143467 time to create 1 rle with old method : 0.16747593879699707 length of segment : 625 time for calcul the mask position with numpy : 0.004070758819580078 nb_pixel_total : 203163 time to create 1 rle with new method : 0.009850025177001953 length of segment : 616 time for calcul the mask position with numpy : 0.0025238990783691406 nb_pixel_total : 111867 time to create 1 rle with old method : 0.13354778289794922 length of segment : 490 time for calcul the mask position with numpy : 0.0020830631256103516 nb_pixel_total : 91422 time to create 1 rle with old method : 0.10733556747436523 length of segment : 309 time for calcul the mask position with numpy : 0.0012960433959960938 nb_pixel_total : 45881 time to create 1 rle with old method : 0.05392098426818848 length of segment : 294 time for calcul the mask position with numpy : 0.0011544227600097656 nb_pixel_total : 53168 time to create 1 rle with old method : 0.0727694034576416 length of segment : 316 time for calcul the mask position with numpy : 0.00537419319152832 nb_pixel_total : 165347 time to create 1 rle with new method : 0.013828277587890625 length of segment : 542 time for calcul the mask position with numpy : 0.0016884803771972656 nb_pixel_total : 71273 time to create 1 rle with old method : 0.08136820793151855 length of segment : 433 time for calcul the mask position with numpy : 0.0006086826324462891 nb_pixel_total : 25677 time to create 1 rle with old method : 0.028634309768676758 length of segment : 192 time for calcul the mask position with numpy : 0.007872819900512695 nb_pixel_total : 316430 time to create 1 rle with new method : 0.022456884384155273 length of segment : 862 time for calcul the mask position with numpy : 0.0018715858459472656 nb_pixel_total : 50509 time to create 1 rle with old method : 0.06836271286010742 length of segment : 305 time for calcul the mask position with numpy : 0.005352020263671875 nb_pixel_total : 262103 time to create 1 rle with new method : 0.014394283294677734 length of segment : 993 time for calcul the mask position with numpy : 0.012464761734008789 nb_pixel_total : 402380 time to create 1 rle with new method : 0.040656328201293945 length of segment : 722 time for calcul the mask position with numpy : 0.0028619766235351562 nb_pixel_total : 129479 time to create 1 rle with old method : 0.15232586860656738 length of segment : 482 time for calcul the mask position with numpy : 0.0014085769653320312 nb_pixel_total : 64115 time to create 1 rle with old method : 0.07471990585327148 length of segment : 409 time for calcul the mask position with numpy : 0.004275083541870117 nb_pixel_total : 222666 time to create 1 rle with new method : 0.012987852096557617 length of segment : 502 time for calcul the mask position with numpy : 0.0020978450775146484 nb_pixel_total : 99116 time to create 1 rle with old method : 0.11113548278808594 length of segment : 726 time for calcul the mask position with numpy : 0.0005648136138916016 nb_pixel_total : 18990 time to create 1 rle with old method : 0.021950483322143555 length of segment : 202 time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 30536 time to create 1 rle with old method : 0.03473210334777832 length of segment : 194 time for calcul the mask position with numpy : 0.002370595932006836 nb_pixel_total : 130650 time to create 1 rle with old method : 0.14875006675720215 length of segment : 597 time for calcul the mask position with numpy : 0.0023419857025146484 nb_pixel_total : 102339 time to create 1 rle with old method : 0.11210155487060547 length of segment : 346 time for calcul the mask position with numpy : 0.006844520568847656 nb_pixel_total : 281453 time to create 1 rle with new method : 0.020497560501098633 length of segment : 1269 time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 36971 time to create 1 rle with old method : 0.04012489318847656 length of segment : 321 time for calcul the mask position with numpy : 0.002427339553833008 nb_pixel_total : 119786 time to create 1 rle with old method : 0.13324594497680664 length of segment : 459 time for calcul the mask position with numpy : 0.0004401206970214844 nb_pixel_total : 15269 time to create 1 rle with old method : 0.016718626022338867 length of segment : 188 time for calcul the mask position with numpy : 0.001275777816772461 nb_pixel_total : 28272 time to create 1 rle with old method : 0.03103780746459961 length of segment : 407 time for calcul the mask position with numpy : 0.0022513866424560547 nb_pixel_total : 104943 time to create 1 rle with old method : 0.11669254302978516 length of segment : 362 time for calcul the mask position with numpy : 0.0006814002990722656 nb_pixel_total : 16546 time to create 1 rle with old method : 0.02000904083251953 length of segment : 153 time for calcul the mask position with numpy : 0.020646333694458008 nb_pixel_total : 949948 time to create 1 rle with new method : 0.20274138450622559 length of segment : 1447 time for calcul the mask position with numpy : 0.009483814239501953 nb_pixel_total : 336170 time to create 1 rle with new method : 0.055084228515625 length of segment : 1630 time for calcul the mask position with numpy : 0.008059978485107422 nb_pixel_total : 387178 time to create 1 rle with new method : 0.024542570114135742 length of segment : 1346 time for calcul the mask position with numpy : 0.0009226799011230469 nb_pixel_total : 45485 time to create 1 rle with old method : 0.05187630653381348 length of segment : 344 time for calcul the mask position with numpy : 0.0010006427764892578 nb_pixel_total : 58001 time to create 1 rle with old method : 0.06570553779602051 length of segment : 251 time for calcul the mask position with numpy : 0.004014492034912109 nb_pixel_total : 155437 time to create 1 rle with new method : 0.011619806289672852 length of segment : 697 time for calcul the mask position with numpy : 0.0013744831085205078 nb_pixel_total : 61828 time to create 1 rle with old method : 0.06967949867248535 length of segment : 361 time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 45155 time to create 1 rle with old method : 0.05022406578063965 length of segment : 271 time for calcul the mask position with numpy : 0.0010449886322021484 nb_pixel_total : 51759 time to create 1 rle with old method : 0.05796384811401367 length of segment : 401 time for calcul the mask position with numpy : 0.0012917518615722656 nb_pixel_total : 48202 time to create 1 rle with old method : 0.05734682083129883 length of segment : 326 time for calcul the mask position with numpy : 0.0032911300659179688 nb_pixel_total : 156733 time to create 1 rle with new method : 0.01018214225769043 length of segment : 588 time for calcul the mask position with numpy : 0.0012722015380859375 nb_pixel_total : 52698 time to create 1 rle with old method : 0.0829770565032959 length of segment : 233 time for calcul the mask position with numpy : 0.0008592605590820312 nb_pixel_total : 37455 time to create 1 rle with old method : 0.04434084892272949 length of segment : 200 time for calcul the mask position with numpy : 0.00208282470703125 nb_pixel_total : 101523 time to create 1 rle with old method : 0.1193091869354248 length of segment : 484 time for calcul the mask position with numpy : 0.0008971691131591797 nb_pixel_total : 32361 time to create 1 rle with old method : 0.03724098205566406 length of segment : 248 time for calcul the mask position with numpy : 0.0044803619384765625 nb_pixel_total : 242765 time to create 1 rle with new method : 0.01224827766418457 length of segment : 597 time for calcul the mask position with numpy : 0.0014328956604003906 nb_pixel_total : 42143 time to create 1 rle with old method : 0.047565460205078125 length of segment : 616 time for calcul the mask position with numpy : 0.0007684230804443359 nb_pixel_total : 39487 time to create 1 rle with old method : 0.045493125915527344 length of segment : 210 time for calcul the mask position with numpy : 0.0044023990631103516 nb_pixel_total : 184011 time to create 1 rle with new method : 0.014333486557006836 length of segment : 458 time for calcul the mask position with numpy : 0.00929117202758789 nb_pixel_total : 404907 time to create 1 rle with new method : 0.021827220916748047 length of segment : 571 time for calcul the mask position with numpy : 0.0038194656372070312 nb_pixel_total : 169557 time to create 1 rle with new method : 0.009596109390258789 length of segment : 415 time for calcul the mask position with numpy : 0.019805908203125 nb_pixel_total : 634714 time to create 1 rle with new method : 0.29862236976623535 length of segment : 1229 time for calcul the mask position with numpy : 0.001119852066040039 nb_pixel_total : 53338 time to create 1 rle with old method : 0.05806303024291992 length of segment : 251 time for calcul the mask position with numpy : 0.003125429153442383 nb_pixel_total : 162532 time to create 1 rle with new method : 0.008685111999511719 length of segment : 478 time for calcul the mask position with numpy : 0.002598285675048828 nb_pixel_total : 114135 time to create 1 rle with old method : 0.14801454544067383 length of segment : 511 time for calcul the mask position with numpy : 0.001622915267944336 nb_pixel_total : 71434 time to create 1 rle with old method : 0.07857942581176758 length of segment : 378 time for calcul the mask position with numpy : 0.019013166427612305 nb_pixel_total : 1030707 time to create 1 rle with new method : 0.5671579837799072 length of segment : 1503 time for calcul the mask position with numpy : 0.0027010440826416016 nb_pixel_total : 123231 time to create 1 rle with old method : 0.13881301879882812 length of segment : 562 time for calcul the mask position with numpy : 0.0027244091033935547 nb_pixel_total : 161056 time to create 1 rle with new method : 0.0070343017578125 length of segment : 388 time for calcul the mask position with numpy : 0.0026547908782958984 nb_pixel_total : 116310 time to create 1 rle with old method : 0.12375593185424805 length of segment : 378 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 42999 time to create 1 rle with old method : 0.04763221740722656 length of segment : 274 time for calcul the mask position with numpy : 0.0015671253204345703 nb_pixel_total : 77582 time to create 1 rle with old method : 0.0892033576965332 length of segment : 435 time for calcul the mask position with numpy : 0.0030879974365234375 nb_pixel_total : 160698 time to create 1 rle with new method : 0.008692026138305664 length of segment : 588 time for calcul the mask position with numpy : 0.0023262500762939453 nb_pixel_total : 99797 time to create 1 rle with old method : 0.11250519752502441 length of segment : 348 time for calcul the mask position with numpy : 0.006954193115234375 nb_pixel_total : 401240 time to create 1 rle with new method : 0.027017593383789062 length of segment : 599 time for calcul the mask position with numpy : 0.0021843910217285156 nb_pixel_total : 130586 time to create 1 rle with old method : 0.14729070663452148 length of segment : 469 time for calcul the mask position with numpy : 0.002434253692626953 nb_pixel_total : 110121 time to create 1 rle with old method : 0.11926412582397461 length of segment : 525 time for calcul the mask position with numpy : 0.0020775794982910156 nb_pixel_total : 120207 time to create 1 rle with old method : 0.1321573257446289 length of segment : 482 time for calcul the mask position with numpy : 0.0177156925201416 nb_pixel_total : 931327 time to create 1 rle with new method : 0.49385952949523926 length of segment : 1404 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 43003 time to create 1 rle with old method : 0.04827475547790527 length of segment : 161 time for calcul the mask position with numpy : 0.008828401565551758 nb_pixel_total : 638451 time to create 1 rle with new method : 0.0373072624206543 length of segment : 997 time for calcul the mask position with numpy : 0.0017595291137695312 nb_pixel_total : 139129 time to create 1 rle with old method : 0.15603995323181152 length of segment : 468 time for calcul the mask position with numpy : 0.003100872039794922 nb_pixel_total : 225159 time to create 1 rle with new method : 0.007841348648071289 length of segment : 497 time for calcul the mask position with numpy : 0.0005919933319091797 nb_pixel_total : 49159 time to create 1 rle with old method : 0.05593681335449219 length of segment : 268 time for calcul the mask position with numpy : 0.0053288936614990234 nb_pixel_total : 406429 time to create 1 rle with new method : 0.012346029281616211 length of segment : 967 time for calcul the mask position with numpy : 0.0005221366882324219 nb_pixel_total : 30933 time to create 1 rle with old method : 0.03565239906311035 length of segment : 261 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 49674 time to create 1 rle with old method : 0.0571439266204834 length of segment : 208 time for calcul the mask position with numpy : 0.0017731189727783203 nb_pixel_total : 130219 time to create 1 rle with old method : 0.1441032886505127 length of segment : 472 time for calcul the mask position with numpy : 0.0015659332275390625 nb_pixel_total : 99578 time to create 1 rle with old method : 0.11720633506774902 length of segment : 395 time for calcul the mask position with numpy : 0.004326820373535156 nb_pixel_total : 216321 time to create 1 rle with new method : 0.011007547378540039 length of segment : 739 time for calcul the mask position with numpy : 0.026595592498779297 nb_pixel_total : 1938799 time to create 1 rle with new method : 0.5414128303527832 length of segment : 1776 time for calcul the mask position with numpy : 0.001956939697265625 nb_pixel_total : 129167 time to create 1 rle with old method : 0.1506638526916504 length of segment : 447 time for calcul the mask position with numpy : 0.017139434814453125 nb_pixel_total : 1142215 time to create 1 rle with new method : 0.09009623527526855 length of segment : 1719 time for calcul the mask position with numpy : 0.015274763107299805 nb_pixel_total : 913910 time to create 1 rle with new method : 0.0928354263305664 length of segment : 1579 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 61907 time to create 1 rle with old method : 0.08551216125488281 length of segment : 301 time for calcul the mask position with numpy : 0.0039403438568115234 nb_pixel_total : 231714 time to create 1 rle with new method : 0.012584209442138672 length of segment : 789 time for calcul the mask position with numpy : 0.008667945861816406 nb_pixel_total : 589944 time to create 1 rle with new method : 0.2552332878112793 length of segment : 1265 time for calcul the mask position with numpy : 0.013226747512817383 nb_pixel_total : 850485 time to create 1 rle with new method : 0.06345129013061523 length of segment : 1335 time for calcul the mask position with numpy : 0.01629471778869629 nb_pixel_total : 1036945 time to create 1 rle with new method : 0.1807713508605957 length of segment : 1123 time for calcul the mask position with numpy : 0.0016639232635498047 nb_pixel_total : 124048 time to create 1 rle with old method : 0.15350556373596191 length of segment : 419 time for calcul the mask position with numpy : 0.0015840530395507812 nb_pixel_total : 114649 time to create 1 rle with old method : 0.13196706771850586 length of segment : 409 length of segment : 0 time for calcul the mask position with numpy : 0.001340627670288086 nb_pixel_total : 68965 time to create 1 rle with old method : 0.07770895957946777 length of segment : 417 time for calcul the mask position with numpy : 0.0010559558868408203 nb_pixel_total : 47591 time to create 1 rle with old method : 0.053832292556762695 length of segment : 270 time for calcul the mask position with numpy : 0.0007693767547607422 nb_pixel_total : 35156 time to create 1 rle with old method : 0.03941154479980469 length of segment : 168 time for calcul the mask position with numpy : 0.007979631423950195 nb_pixel_total : 495232 time to create 1 rle with new method : 0.029648542404174805 length of segment : 615 time for calcul the mask position with numpy : 0.0010890960693359375 nb_pixel_total : 57452 time to create 1 rle with old method : 0.06452393531799316 length of segment : 330 time for calcul the mask position with numpy : 0.002926349639892578 nb_pixel_total : 114745 time to create 1 rle with old method : 0.13285017013549805 length of segment : 256 time for calcul the mask position with numpy : 0.0013124942779541016 nb_pixel_total : 39178 time to create 1 rle with old method : 0.04590725898742676 length of segment : 218 time for calcul the mask position with numpy : 0.0032575130462646484 nb_pixel_total : 132555 time to create 1 rle with old method : 0.15015673637390137 length of segment : 510 time for calcul the mask position with numpy : 0.002294778823852539 nb_pixel_total : 90383 time to create 1 rle with old method : 0.10326147079467773 length of segment : 350 time for calcul the mask position with numpy : 0.0014176368713378906 nb_pixel_total : 42031 time to create 1 rle with old method : 0.048697710037231445 length of segment : 249 time for calcul the mask position with numpy : 0.0056955814361572266 nb_pixel_total : 280743 time to create 1 rle with new method : 0.01716303825378418 length of segment : 964 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 30196 time to create 1 rle with old method : 0.03351449966430664 length of segment : 222 time for calcul the mask position with numpy : 0.0029463768005371094 nb_pixel_total : 121645 time to create 1 rle with old method : 0.15593910217285156 length of segment : 521 time for calcul the mask position with numpy : 0.0030951499938964844 nb_pixel_total : 119285 time to create 1 rle with old method : 0.13553357124328613 length of segment : 563 time for calcul the mask position with numpy : 0.0012233257293701172 nb_pixel_total : 53211 time to create 1 rle with old method : 0.0616300106048584 length of segment : 261 time for calcul the mask position with numpy : 0.0028934478759765625 nb_pixel_total : 152265 time to create 1 rle with new method : 0.007602214813232422 length of segment : 406 time for calcul the mask position with numpy : 0.0012767314910888672 nb_pixel_total : 34063 time to create 1 rle with old method : 0.04080510139465332 length of segment : 336 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 16914 time to create 1 rle with old method : 0.019939184188842773 length of segment : 209 time for calcul the mask position with numpy : 0.0008394718170166016 nb_pixel_total : 19837 time to create 1 rle with old method : 0.023302078247070312 length of segment : 161 time for calcul the mask position with numpy : 0.004746198654174805 nb_pixel_total : 159798 time to create 1 rle with new method : 0.013892650604248047 length of segment : 532 time for calcul the mask position with numpy : 0.001008749008178711 nb_pixel_total : 34049 time to create 1 rle with old method : 0.0392155647277832 length of segment : 206 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 59493 time to create 1 rle with old method : 0.06727218627929688 length of segment : 361 time for calcul the mask position with numpy : 0.00494837760925293 nb_pixel_total : 239323 time to create 1 rle with new method : 0.013596296310424805 length of segment : 480 time for calcul the mask position with numpy : 0.0009262561798095703 nb_pixel_total : 41903 time to create 1 rle with old method : 0.04535412788391113 length of segment : 292 time for calcul the mask position with numpy : 0.0075643062591552734 nb_pixel_total : 299007 time to create 1 rle with new method : 0.019226789474487305 length of segment : 653 time for calcul the mask position with numpy : 0.0035042762756347656 nb_pixel_total : 186450 time to create 1 rle with new method : 0.00854349136352539 length of segment : 577 time for calcul the mask position with numpy : 0.0011360645294189453 nb_pixel_total : 40391 time to create 1 rle with old method : 0.046552181243896484 length of segment : 153 time for calcul the mask position with numpy : 0.0008342266082763672 nb_pixel_total : 47149 time to create 1 rle with old method : 0.05383110046386719 length of segment : 237 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 47508 time to create 1 rle with old method : 0.0541529655456543 length of segment : 303 time for calcul the mask position with numpy : 0.0038881301879882812 nb_pixel_total : 227009 time to create 1 rle with new method : 0.009715795516967773 length of segment : 618 time for calcul the mask position with numpy : 0.010725975036621094 nb_pixel_total : 521562 time to create 1 rle with new method : 0.04348325729370117 length of segment : 653 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 55133 time to create 1 rle with old method : 0.06317138671875 length of segment : 310 time for calcul the mask position with numpy : 0.005831003189086914 nb_pixel_total : 296830 time to create 1 rle with new method : 0.016093015670776367 length of segment : 928 time for calcul the mask position with numpy : 0.0012693405151367188 nb_pixel_total : 50898 time to create 1 rle with old method : 0.057386159896850586 length of segment : 300 time for calcul the mask position with numpy : 0.0017910003662109375 nb_pixel_total : 72394 time to create 1 rle with old method : 0.08513593673706055 length of segment : 243 time for calcul the mask position with numpy : 0.008161306381225586 nb_pixel_total : 263280 time to create 1 rle with new method : 0.021962642669677734 length of segment : 606 time for calcul the mask position with numpy : 0.0032181739807128906 nb_pixel_total : 167916 time to create 1 rle with new method : 0.007906436920166016 length of segment : 562 time for calcul the mask position with numpy : 0.018904447555541992 nb_pixel_total : 732854 time to create 1 rle with new method : 0.1576676368713379 length of segment : 1217 time for calcul the mask position with numpy : 0.002276182174682617 nb_pixel_total : 96185 time to create 1 rle with old method : 0.11343002319335938 length of segment : 421 time for calcul the mask position with numpy : 0.002981424331665039 nb_pixel_total : 104764 time to create 1 rle with old method : 0.1211397647857666 length of segment : 485 time for calcul the mask position with numpy : 0.002796173095703125 nb_pixel_total : 66106 time to create 1 rle with old method : 0.07993912696838379 length of segment : 627 time for calcul the mask position with numpy : 0.0015330314636230469 nb_pixel_total : 54090 time to create 1 rle with old method : 0.08481812477111816 length of segment : 168 time for calcul the mask position with numpy : 0.0016765594482421875 nb_pixel_total : 82095 time to create 1 rle with old method : 0.09580230712890625 length of segment : 481 time for calcul the mask position with numpy : 0.0026977062225341797 nb_pixel_total : 165443 time to create 1 rle with new method : 0.007059812545776367 length of segment : 456 time for calcul the mask position with numpy : 0.0016872882843017578 nb_pixel_total : 56496 time to create 1 rle with old method : 0.06627631187438965 length of segment : 279 time for calcul the mask position with numpy : 0.0006079673767089844 nb_pixel_total : 19329 time to create 1 rle with old method : 0.022768259048461914 length of segment : 202 time for calcul the mask position with numpy : 0.005253791809082031 nb_pixel_total : 253780 time to create 1 rle with new method : 0.012663125991821289 length of segment : 561 time for calcul the mask position with numpy : 0.0012018680572509766 nb_pixel_total : 63043 time to create 1 rle with old method : 0.07120561599731445 length of segment : 326 time for calcul the mask position with numpy : 0.002608776092529297 nb_pixel_total : 115804 time to create 1 rle with old method : 0.1300654411315918 length of segment : 539 time for calcul the mask position with numpy : 0.006888628005981445 nb_pixel_total : 245237 time to create 1 rle with new method : 0.02755451202392578 length of segment : 1121 time for calcul the mask position with numpy : 0.001567840576171875 nb_pixel_total : 62188 time to create 1 rle with old method : 0.07127761840820312 length of segment : 319 time for calcul the mask position with numpy : 0.0011472702026367188 nb_pixel_total : 66793 time to create 1 rle with old method : 0.07607865333557129 length of segment : 290 time for calcul the mask position with numpy : 0.009721040725708008 nb_pixel_total : 461825 time to create 1 rle with new method : 0.2249593734741211 length of segment : 1262 time for calcul the mask position with numpy : 0.000942230224609375 nb_pixel_total : 45099 time to create 1 rle with old method : 0.052393198013305664 length of segment : 175 time for calcul the mask position with numpy : 0.0010814666748046875 nb_pixel_total : 56418 time to create 1 rle with old method : 0.06403851509094238 length of segment : 556 time for calcul the mask position with numpy : 0.0017461776733398438 nb_pixel_total : 86690 time to create 1 rle with old method : 0.09749341011047363 length of segment : 343 time for calcul the mask position with numpy : 0.0036211013793945312 nb_pixel_total : 172883 time to create 1 rle with new method : 0.010545015335083008 length of segment : 546 time for calcul the mask position with numpy : 0.0033583641052246094 nb_pixel_total : 153837 time to create 1 rle with new method : 0.0097808837890625 length of segment : 449 time for calcul the mask position with numpy : 0.0024504661560058594 nb_pixel_total : 140963 time to create 1 rle with old method : 0.18471193313598633 length of segment : 607 time for calcul the mask position with numpy : 0.0008709430694580078 nb_pixel_total : 44808 time to create 1 rle with old method : 0.05182909965515137 length of segment : 261 time for calcul the mask position with numpy : 0.0014195442199707031 nb_pixel_total : 70497 time to create 1 rle with old method : 0.08001947402954102 length of segment : 292 time for calcul the mask position with numpy : 0.004890918731689453 nb_pixel_total : 155374 time to create 1 rle with new method : 0.014581918716430664 length of segment : 671 time for calcul the mask position with numpy : 0.001562356948852539 nb_pixel_total : 72901 time to create 1 rle with old method : 0.08380913734436035 length of segment : 308 time for calcul the mask position with numpy : 0.00474095344543457 nb_pixel_total : 269788 time to create 1 rle with new method : 0.012977123260498047 length of segment : 770 time for calcul the mask position with numpy : 0.0015175342559814453 nb_pixel_total : 51827 time to create 1 rle with old method : 0.05949878692626953 length of segment : 252 time for calcul the mask position with numpy : 0.0014650821685791016 nb_pixel_total : 77025 time to create 1 rle with old method : 0.08433365821838379 length of segment : 457 time for calcul the mask position with numpy : 0.0011458396911621094 nb_pixel_total : 55725 time to create 1 rle with old method : 0.06335210800170898 length of segment : 249 time for calcul the mask position with numpy : 0.003467082977294922 nb_pixel_total : 208520 time to create 1 rle with new method : 0.009695053100585938 length of segment : 506 time for calcul the mask position with numpy : 0.0021736621856689453 nb_pixel_total : 108873 time to create 1 rle with old method : 0.12984275817871094 length of segment : 355 time for calcul the mask position with numpy : 0.0011527538299560547 nb_pixel_total : 60113 time to create 1 rle with old method : 0.06809258460998535 length of segment : 251 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 67741 time to create 1 rle with old method : 0.07732462882995605 length of segment : 302 time for calcul the mask position with numpy : 0.016603469848632812 nb_pixel_total : 811305 time to create 1 rle with new method : 0.0666048526763916 length of segment : 1437 time for calcul the mask position with numpy : 0.0021812915802001953 nb_pixel_total : 58186 time to create 1 rle with old method : 0.06587886810302734 length of segment : 456 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 43517 time to create 1 rle with old method : 0.04961752891540527 length of segment : 259 time for calcul the mask position with numpy : 0.001123189926147461 nb_pixel_total : 47022 time to create 1 rle with old method : 0.05350446701049805 length of segment : 233 time for calcul the mask position with numpy : 0.00957798957824707 nb_pixel_total : 230751 time to create 1 rle with new method : 0.010050773620605469 length of segment : 420 time for calcul the mask position with numpy : 0.00116729736328125 nb_pixel_total : 54316 time to create 1 rle with old method : 0.061432600021362305 length of segment : 198 time for calcul the mask position with numpy : 0.0016417503356933594 nb_pixel_total : 68004 time to create 1 rle with old method : 0.07831883430480957 length of segment : 231 time for calcul the mask position with numpy : 0.0034151077270507812 nb_pixel_total : 165208 time to create 1 rle with new method : 0.009206533432006836 length of segment : 792 time for calcul the mask position with numpy : 0.0012922286987304688 nb_pixel_total : 17108 time to create 1 rle with old method : 0.019833087921142578 length of segment : 173 time for calcul the mask position with numpy : 0.019014596939086914 nb_pixel_total : 889829 time to create 1 rle with new method : 0.25900936126708984 length of segment : 1244 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 43159 time to create 1 rle with old method : 0.0463407039642334 length of segment : 276 time for calcul the mask position with numpy : 0.004814624786376953 nb_pixel_total : 237423 time to create 1 rle with new method : 0.009852170944213867 length of segment : 413 time for calcul the mask position with numpy : 0.0029649734497070312 nb_pixel_total : 159860 time to create 1 rle with new method : 0.007279157638549805 length of segment : 718 time for calcul the mask position with numpy : 0.026363611221313477 nb_pixel_total : 401565 time to create 1 rle with new method : 0.12118315696716309 length of segment : 1170 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 33613 time to create 1 rle with old method : 0.039484262466430664 length of segment : 214 time for calcul the mask position with numpy : 0.0012638568878173828 nb_pixel_total : 65199 time to create 1 rle with old method : 0.07557201385498047 length of segment : 325 time for calcul the mask position with numpy : 0.0026154518127441406 nb_pixel_total : 129929 time to create 1 rle with old method : 0.1509227752685547 length of segment : 691 time for calcul the mask position with numpy : 0.0073926448822021484 nb_pixel_total : 396361 time to create 1 rle with new method : 0.017515897750854492 length of segment : 777 time for calcul the mask position with numpy : 0.005020856857299805 nb_pixel_total : 141141 time to create 1 rle with old method : 0.18507647514343262 length of segment : 455 time for calcul the mask position with numpy : 0.011397838592529297 nb_pixel_total : 364290 time to create 1 rle with new method : 0.01590442657470703 length of segment : 608 time for calcul the mask position with numpy : 0.0015435218811035156 nb_pixel_total : 24292 time to create 1 rle with old method : 0.029149532318115234 length of segment : 218 time for calcul the mask position with numpy : 0.0077953338623046875 nb_pixel_total : 235763 time to create 1 rle with new method : 0.016912221908569336 length of segment : 796 time for calcul the mask position with numpy : 0.0013103485107421875 nb_pixel_total : 23351 time to create 1 rle with old method : 0.034157514572143555 length of segment : 137 time for calcul the mask position with numpy : 0.02115035057067871 nb_pixel_total : 731725 time to create 1 rle with new method : 0.11787748336791992 length of segment : 1315 time for calcul the mask position with numpy : 0.0044040679931640625 nb_pixel_total : 219603 time to create 1 rle with new method : 0.012812376022338867 length of segment : 588 time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 52544 time to create 1 rle with old method : 0.06105327606201172 length of segment : 204 time for calcul the mask position with numpy : 0.0005972385406494141 nb_pixel_total : 13234 time to create 1 rle with old method : 0.01588296890258789 length of segment : 232 time for calcul the mask position with numpy : 0.0008149147033691406 nb_pixel_total : 37753 time to create 1 rle with old method : 0.04485917091369629 length of segment : 189 time for calcul the mask position with numpy : 0.0007321834564208984 nb_pixel_total : 36318 time to create 1 rle with old method : 0.04166102409362793 length of segment : 393 time for calcul the mask position with numpy : 0.0012676715850830078 nb_pixel_total : 61031 time to create 1 rle with old method : 0.06980443000793457 length of segment : 267 time for calcul the mask position with numpy : 0.0033702850341796875 nb_pixel_total : 183067 time to create 1 rle with new method : 0.009532451629638672 length of segment : 504 time for calcul the mask position with numpy : 0.0010635852813720703 nb_pixel_total : 30097 time to create 1 rle with old method : 0.04021716117858887 length of segment : 166 time for calcul the mask position with numpy : 0.0054454803466796875 nb_pixel_total : 206856 time to create 1 rle with new method : 0.018985748291015625 length of segment : 660 time for calcul the mask position with numpy : 0.0021643638610839844 nb_pixel_total : 81036 time to create 1 rle with old method : 0.09378457069396973 length of segment : 343 time for calcul the mask position with numpy : 0.0014722347259521484 nb_pixel_total : 72893 time to create 1 rle with old method : 0.08699965476989746 length of segment : 240 time for calcul the mask position with numpy : 0.0014164447784423828 nb_pixel_total : 50109 time to create 1 rle with old method : 0.05877351760864258 length of segment : 333 time for calcul the mask position with numpy : 0.002284526824951172 nb_pixel_total : 118622 time to create 1 rle with old method : 0.1299757957458496 length of segment : 389 time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 19210 time to create 1 rle with old method : 0.022278308868408203 length of segment : 283 time for calcul the mask position with numpy : 0.0012502670288085938 nb_pixel_total : 51104 time to create 1 rle with old method : 0.057706594467163086 length of segment : 221 time for calcul the mask position with numpy : 0.016669511795043945 nb_pixel_total : 474895 time to create 1 rle with new method : 0.26133060455322266 length of segment : 1204 time for calcul the mask position with numpy : 0.07412338256835938 nb_pixel_total : 1408057 time to create 1 rle with new method : 0.17116498947143555 length of segment : 1399 time for calcul the mask position with numpy : 0.0010631084442138672 nb_pixel_total : 36151 time to create 1 rle with old method : 0.042516231536865234 length of segment : 378 time for calcul the mask position with numpy : 0.0007970333099365234 nb_pixel_total : 34099 time to create 1 rle with old method : 0.040808677673339844 length of segment : 206 time for calcul the mask position with numpy : 0.0023927688598632812 nb_pixel_total : 94554 time to create 1 rle with old method : 0.13236379623413086 length of segment : 444 time for calcul the mask position with numpy : 0.007756233215332031 nb_pixel_total : 169384 time to create 1 rle with new method : 0.025330305099487305 length of segment : 560 time for calcul the mask position with numpy : 0.0020952224731445312 nb_pixel_total : 70238 time to create 1 rle with old method : 0.10415220260620117 length of segment : 406 time for calcul the mask position with numpy : 0.002899646759033203 nb_pixel_total : 107565 time to create 1 rle with old method : 0.1383826732635498 length of segment : 844 time for calcul the mask position with numpy : 0.0016617774963378906 nb_pixel_total : 61619 time to create 1 rle with old method : 0.09462308883666992 length of segment : 334 time for calcul the mask position with numpy : 0.0033092498779296875 nb_pixel_total : 182335 time to create 1 rle with new method : 0.008090734481811523 length of segment : 223 time for calcul the mask position with numpy : 0.0018606185913085938 nb_pixel_total : 92614 time to create 1 rle with old method : 0.10661554336547852 length of segment : 481 time for calcul the mask position with numpy : 0.003954410552978516 nb_pixel_total : 218530 time to create 1 rle with new method : 0.0337071418762207 length of segment : 754 time for calcul the mask position with numpy : 0.0038475990295410156 nb_pixel_total : 234180 time to create 1 rle with new method : 0.01008152961730957 length of segment : 413 time for calcul the mask position with numpy : 0.0027532577514648438 nb_pixel_total : 171283 time to create 1 rle with new method : 0.0070667266845703125 length of segment : 341 time for calcul the mask position with numpy : 0.0015842914581298828 nb_pixel_total : 72507 time to create 1 rle with old method : 0.0812375545501709 length of segment : 650 time for calcul the mask position with numpy : 0.0008313655853271484 nb_pixel_total : 11466 time to create 1 rle with old method : 0.013490915298461914 length of segment : 418 time for calcul the mask position with numpy : 0.0058746337890625 nb_pixel_total : 233888 time to create 1 rle with new method : 0.020175695419311523 length of segment : 977 time for calcul the mask position with numpy : 0.0009002685546875 nb_pixel_total : 48299 time to create 1 rle with old method : 0.05500078201293945 length of segment : 350 time for calcul the mask position with numpy : 0.0014503002166748047 nb_pixel_total : 59551 time to create 1 rle with old method : 0.06899023056030273 length of segment : 250 time for calcul the mask position with numpy : 0.0012392997741699219 nb_pixel_total : 43270 time to create 1 rle with old method : 0.04929161071777344 length of segment : 278 time for calcul the mask position with numpy : 0.7591550350189209 nb_pixel_total : 6201598 time to create 1 rle with new method : 1.3005852699279785 length of segment : 3887 time for calcul the mask position with numpy : 0.019491910934448242 nb_pixel_total : 1126218 time to create 1 rle with new method : 0.25307607650756836 length of segment : 1404 time for calcul the mask position with numpy : 0.0004775524139404297 nb_pixel_total : 23486 time to create 1 rle with old method : 0.03816652297973633 length of segment : 238 time for calcul the mask position with numpy : 0.0029044151306152344 nb_pixel_total : 229405 time to create 1 rle with new method : 0.00758051872253418 length of segment : 526 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 75980 time to create 1 rle with old method : 0.08580279350280762 length of segment : 406 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 76591 time to create 1 rle with old method : 0.0871877670288086 length of segment : 427 time for calcul the mask position with numpy : 0.0009162425994873047 nb_pixel_total : 2728 time to create 1 rle with old method : 0.0034427642822265625 length of segment : 104 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 53741 time to create 1 rle with old method : 0.06247758865356445 length of segment : 419 time spent for convertir_results : 73.31258249282837 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 466 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 203.0294201374054 time spend to save output : 0.2499370574951172 total time spend for step 2 : 203.2793571949005 step3:blur_detection Mon Mar 31 18:26:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 2131.668913242164 (4160, 3120) 1471.8244681023398 (4160, 3120) 3579.8207992912 (4160, 3120) 411.1733793574086 (4160, 3120) 2719.520518365121 (4160, 3120) 1672.29025140936 (4160, 3120) 207.7517335790882 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.012610912322998047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.011994123458862305 save missing photos in datou_result : time spend for datou_step_exec : 4.3859686851501465 time spend to save output : 0.029118776321411133 total time spend for step 3 : 4.415087461471558 step4:brightness Mon Mar 31 18:26:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1743438088_381571_1349044441_b3d1b0cd22f97821450f6238062c43b8.jpg treat image : temp/1743438088_381571_1349044437_74e32855c84eaffd1a22f7c569fae00a.jpg treat image : temp/1743438088_381571_1349044433_2bccc50c3509f86acbdd992a58c6bb0e.jpg treat image : temp/1743438088_381571_1349044428_be1e3c5dd8d645c54b57039fc17dbb78.jpg treat image : temp/1743438088_381571_1349044402_c9bf94741e056b55c042230e2ff346aa.jpg treat image : temp/1743438088_381571_1349044400_ddcc764ba2786b0a65d0f09cc330f35b.jpg treat image : temp/1743438088_381571_1349044398_dd6c197a09c3866e6fde88260c176cdf.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.011748790740966797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.011998176574707031 save missing photos in datou_result : time spend for datou_step_exec : 12.451866865158081 time spend to save output : 0.02899765968322754 total time spend for step 4 : 12.480864524841309 step5:rle_unique_nms_with_priority Mon Mar 31 18:26:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 466 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 85 nb_hashtags : 11 time to prepare the origin masks : 71.38939690589905 time for calcul the mask position with numpy : 0.5387029647827148 nb_pixel_total : 2873280 time to create 1 rle with new method : 2.3165183067321777 time for calcul the mask position with numpy : 0.053813934326171875 nb_pixel_total : 37226 time to create 1 rle with old method : 0.04385876655578613 time for calcul the mask position with numpy : 0.05482292175292969 nb_pixel_total : 148598 time to create 1 rle with old method : 0.1714954376220703 time for calcul the mask position with numpy : 0.05231451988220215 nb_pixel_total : 58167 time to create 1 rle with old method : 0.06548547744750977 time for calcul the mask position with numpy : 0.05123162269592285 nb_pixel_total : 55982 time to create 1 rle with old method : 0.06406211853027344 time for calcul the mask position with numpy : 0.05710172653198242 nb_pixel_total : 53696 time to create 1 rle with old method : 0.06786417961120605 time for calcul the mask position with numpy : 0.05316638946533203 nb_pixel_total : 80360 time to create 1 rle with old method : 0.09111261367797852 time for calcul the mask position with numpy : 0.05314302444458008 nb_pixel_total : 51140 time to create 1 rle with old method : 0.05827927589416504 time for calcul the mask position with numpy : 0.05197882652282715 nb_pixel_total : 101066 time to create 1 rle with old method : 0.11255621910095215 time for calcul the mask position with numpy : 0.052371978759765625 nb_pixel_total : 3103 time to create 1 rle with old method : 0.003935337066650391 time for calcul the mask position with numpy : 0.052468299865722656 nb_pixel_total : 118064 time to create 1 rle with old method : 0.13575983047485352 time for calcul the mask position with numpy : 0.054886579513549805 nb_pixel_total : 44901 time to create 1 rle with old method : 0.05212593078613281 time for calcul the mask position with numpy : 0.054407596588134766 nb_pixel_total : 230895 time to create 1 rle with new method : 1.7890191078186035 time for calcul the mask position with numpy : 0.053855180740356445 nb_pixel_total : 175825 time to create 1 rle with new method : 1.3136742115020752 time for calcul the mask position with numpy : 0.05520009994506836 nb_pixel_total : 31366 time to create 1 rle with old method : 0.03631138801574707 time for calcul the mask position with numpy : 0.05278801918029785 nb_pixel_total : 31111 time to create 1 rle with old method : 0.038126230239868164 time for calcul the mask position with numpy : 0.05267477035522461 nb_pixel_total : 38551 time to create 1 rle with old method : 0.04462170600891113 time for calcul the mask position with numpy : 0.05337262153625488 nb_pixel_total : 1151 time to create 1 rle with old method : 0.001667022705078125 time for calcul the mask position with numpy : 0.0530393123626709 nb_pixel_total : 152608 time to create 1 rle with new method : 3.934870719909668 time for calcul the mask position with numpy : 0.05655097961425781 nb_pixel_total : 344056 time to create 1 rle with new method : 2.7697560787200928 time for calcul the mask position with numpy : 0.05366325378417969 nb_pixel_total : 6794 time to create 1 rle with old method : 0.007959842681884766 time for calcul the mask position with numpy : 0.053330183029174805 nb_pixel_total : 15400 time to create 1 rle with old method : 0.019076108932495117 time for calcul the mask position with numpy : 0.07103753089904785 nb_pixel_total : 954280 time to create 1 rle with new method : 1.5096378326416016 time for calcul the mask position with numpy : 0.052892208099365234 nb_pixel_total : 238325 time to create 1 rle with new method : 1.517634391784668 time for calcul the mask position with numpy : 0.059046030044555664 nb_pixel_total : 6369 time to create 1 rle with old method : 0.007442474365234375 time for calcul the mask position with numpy : 0.05276894569396973 nb_pixel_total : 18940 time to create 1 rle with old method : 0.021966218948364258 time for calcul the mask position with numpy : 0.05307579040527344 nb_pixel_total : 83112 time to create 1 rle with old method : 0.09456872940063477 time for calcul the mask position with numpy : 0.05318331718444824 nb_pixel_total : 136359 time to create 1 rle with old method : 0.15328502655029297 time for calcul the mask position with numpy : 0.05222606658935547 nb_pixel_total : 1704 time to create 1 rle with old method : 0.002041339874267578 time for calcul the mask position with numpy : 0.052247047424316406 nb_pixel_total : 15953 time to create 1 rle with old method : 0.01857471466064453 time for calcul the mask position with numpy : 0.054273128509521484 nb_pixel_total : 70218 time to create 1 rle with old method : 0.07845091819763184 time for calcul the mask position with numpy : 0.05350160598754883 nb_pixel_total : 63857 time to create 1 rle with old method : 0.07357597351074219 time for calcul the mask position with numpy : 0.05393528938293457 nb_pixel_total : 174360 time to create 1 rle with new method : 2.7265853881835938 time for calcul the mask position with numpy : 0.056906938552856445 nb_pixel_total : 215549 time to create 1 rle with new method : 1.6062028408050537 time for calcul the mask position with numpy : 0.052260637283325195 nb_pixel_total : 18191 time to create 1 rle with old method : 0.020870685577392578 time for calcul the mask position with numpy : 0.05893969535827637 nb_pixel_total : 567900 time to create 1 rle with new method : 1.7018532752990723 time for calcul the mask position with numpy : 0.05349850654602051 nb_pixel_total : 7658 time to create 1 rle with old method : 0.03236031532287598 time for calcul the mask position with numpy : 0.05426216125488281 nb_pixel_total : 94724 time to create 1 rle with old method : 0.1098470687866211 time for calcul the mask position with numpy : 0.05389404296875 nb_pixel_total : 8548 time to create 1 rle with old method : 0.010819435119628906 time for calcul the mask position with numpy : 0.05381345748901367 nb_pixel_total : 16410 time to create 1 rle with old method : 0.019791841506958008 time for calcul the mask position with numpy : 0.056151628494262695 nb_pixel_total : 290435 time to create 1 rle with new method : 1.1401336193084717 time for calcul the mask position with numpy : 0.0539553165435791 nb_pixel_total : 127028 time to create 1 rle with old method : 0.14634466171264648 time for calcul the mask position with numpy : 0.05602550506591797 nb_pixel_total : 4592 time to create 1 rle with old method : 0.005718708038330078 time for calcul the mask position with numpy : 0.05360889434814453 nb_pixel_total : 126519 time to create 1 rle with old method : 0.1425480842590332 time for calcul the mask position with numpy : 0.07231259346008301 nb_pixel_total : 1329301 time to create 1 rle with new method : 1.0535399913787842 time for calcul the mask position with numpy : 0.0525364875793457 nb_pixel_total : 41919 time to create 1 rle with old method : 0.04651379585266113 time for calcul the mask position with numpy : 0.054029226303100586 nb_pixel_total : 127064 time to create 1 rle with old method : 0.1507561206817627 time for calcul the mask position with numpy : 0.05748391151428223 nb_pixel_total : 216839 time to create 1 rle with new method : 2.0479447841644287 time for calcul the mask position with numpy : 0.052523136138916016 nb_pixel_total : 14655 time to create 1 rle with old method : 0.01660776138305664 time for calcul the mask position with numpy : 0.05535626411437988 nb_pixel_total : 28756 time to create 1 rle with old method : 0.03160214424133301 time for calcul the mask position with numpy : 0.051979780197143555 nb_pixel_total : 9419 time to create 1 rle with old method : 0.011801958084106445 time for calcul the mask position with numpy : 0.052970170974731445 nb_pixel_total : 1098 time to create 1 rle with old method : 0.00164794921875 time for calcul the mask position with numpy : 0.053377628326416016 nb_pixel_total : 112500 time to create 1 rle with old method : 0.14485406875610352 time for calcul the mask position with numpy : 0.059001922607421875 nb_pixel_total : 11360 time to create 1 rle with old method : 0.01351618766784668 time for calcul the mask position with numpy : 0.05291152000427246 nb_pixel_total : 47861 time to create 1 rle with old method : 0.053583621978759766 time for calcul the mask position with numpy : 0.05308032035827637 nb_pixel_total : 93828 time to create 1 rle with old method : 0.10858368873596191 time for calcul the mask position with numpy : 0.05404067039489746 nb_pixel_total : 109156 time to create 1 rle with old method : 0.12483882904052734 time for calcul the mask position with numpy : 0.05287933349609375 nb_pixel_total : 3584 time to create 1 rle with old method : 0.004454135894775391 time for calcul the mask position with numpy : 0.05382490158081055 nb_pixel_total : 48121 time to create 1 rle with old method : 0.055069684982299805 time for calcul the mask position with numpy : 0.051537275314331055 nb_pixel_total : 21275 time to create 1 rle with old method : 0.026053190231323242 time for calcul the mask position with numpy : 0.050579071044921875 nb_pixel_total : 3674 time to create 1 rle with old method : 0.004568576812744141 time for calcul the mask position with numpy : 0.05247640609741211 nb_pixel_total : 32557 time to create 1 rle with old method : 0.036858320236206055 time for calcul the mask position with numpy : 0.05232691764831543 nb_pixel_total : 191047 time to create 1 rle with new method : 1.1395633220672607 time for calcul the mask position with numpy : 0.05271410942077637 nb_pixel_total : 16757 time to create 1 rle with old method : 0.018924713134765625 time for calcul the mask position with numpy : 0.053244590759277344 nb_pixel_total : 64585 time to create 1 rle with old method : 0.0728006362915039 time for calcul the mask position with numpy : 0.05252695083618164 nb_pixel_total : 158382 time to create 1 rle with new method : 1.4789683818817139 time for calcul the mask position with numpy : 0.057279109954833984 nb_pixel_total : 29184 time to create 1 rle with old method : 0.04684591293334961 time for calcul the mask position with numpy : 0.06968975067138672 nb_pixel_total : 729675 time to create 1 rle with new method : 0.9938993453979492 time for calcul the mask position with numpy : 0.06080961227416992 nb_pixel_total : 178539 time to create 1 rle with new method : 0.6998908519744873 time for calcul the mask position with numpy : 0.056677818298339844 nb_pixel_total : 232802 time to create 1 rle with new method : 2.2240588665008545 time for calcul the mask position with numpy : 0.0534820556640625 nb_pixel_total : 104557 time to create 1 rle with old method : 0.1189887523651123 time for calcul the mask position with numpy : 0.05347251892089844 nb_pixel_total : 2818 time to create 1 rle with old method : 0.0034034252166748047 time for calcul the mask position with numpy : 0.05462455749511719 nb_pixel_total : 232802 time to create 1 rle with new method : 0.9384262561798096 time for calcul the mask position with numpy : 0.05616879463195801 nb_pixel_total : 57367 time to create 1 rle with old method : 0.06982779502868652 time for calcul the mask position with numpy : 0.05716395378112793 nb_pixel_total : 2804 time to create 1 rle with old method : 0.003574848175048828 time for calcul the mask position with numpy : 0.06689834594726562 nb_pixel_total : 4923 time to create 1 rle with old method : 0.006018638610839844 time for calcul the mask position with numpy : 0.053505659103393555 nb_pixel_total : 14491 time to create 1 rle with old method : 0.017135143280029297 time for calcul the mask position with numpy : 0.05511832237243652 nb_pixel_total : 244685 time to create 1 rle with new method : 1.2299447059631348 time for calcul the mask position with numpy : 0.05361509323120117 nb_pixel_total : 141810 time to create 1 rle with old method : 0.16193699836730957 time for calcul the mask position with numpy : 0.054231882095336914 nb_pixel_total : 54496 time to create 1 rle with old method : 0.06526350975036621 time for calcul the mask position with numpy : 0.05361461639404297 nb_pixel_total : 15888 time to create 1 rle with old method : 0.01857733726501465 time for calcul the mask position with numpy : 0.054711103439331055 nb_pixel_total : 152926 time to create 1 rle with new method : 1.510225772857666 time for calcul the mask position with numpy : 0.05361676216125488 nb_pixel_total : 12845 time to create 1 rle with old method : 0.015373706817626953 time for calcul the mask position with numpy : 0.055306196212768555 nb_pixel_total : 93329 time to create 1 rle with old method : 0.11699652671813965 time for calcul the mask position with numpy : 0.06110119819641113 nb_pixel_total : 57506 time to create 1 rle with old method : 0.0668022632598877 time for calcul the mask position with numpy : 0.05376029014587402 nb_pixel_total : 37644 time to create 1 rle with old method : 0.044217586517333984 create new chi : 45.40964388847351 time to delete rle : 0.025896549224853516 batch 1 Loaded 86 chid ids of type : 4855 Number RLEs to save : 74776 TO DO : save crop sub photo not yet done ! save time : 4.653611898422241 nb_obj : 96 nb_hashtags : 12 time to prepare the origin masks : 79.8956606388092 time for calcul the mask position with numpy : 0.21743512153625488 nb_pixel_total : 3271146 time to create 1 rle with new method : 1.4982290267944336 time for calcul the mask position with numpy : 0.053334712982177734 nb_pixel_total : 42126 time to create 1 rle with old method : 0.050260305404663086 time for calcul the mask position with numpy : 0.05430912971496582 nb_pixel_total : 79758 time to create 1 rle with old method : 0.09163308143615723 time for calcul the mask position with numpy : 0.05935502052307129 nb_pixel_total : 352585 time to create 1 rle with new method : 1.1340351104736328 time for calcul the mask position with numpy : 0.052551984786987305 nb_pixel_total : 55546 time to create 1 rle with old method : 0.0642857551574707 time for calcul the mask position with numpy : 0.05605745315551758 nb_pixel_total : 21154 time to create 1 rle with old method : 0.024612903594970703 time for calcul the mask position with numpy : 0.05630183219909668 nb_pixel_total : 345566 time to create 1 rle with new method : 1.6041505336761475 time for calcul the mask position with numpy : 0.05306124687194824 nb_pixel_total : 16388 time to create 1 rle with old method : 0.019548892974853516 time for calcul the mask position with numpy : 0.054121971130371094 nb_pixel_total : 148613 time to create 1 rle with old method : 0.17367959022521973 time for calcul the mask position with numpy : 0.0555112361907959 nb_pixel_total : 54237 time to create 1 rle with old method : 0.06469058990478516 time for calcul the mask position with numpy : 0.054511070251464844 nb_pixel_total : 283715 time to create 1 rle with new method : 1.1134223937988281 time for calcul the mask position with numpy : 0.053853750228881836 nb_pixel_total : 230876 time to create 1 rle with new method : 1.6323509216308594 time for calcul the mask position with numpy : 0.05249333381652832 nb_pixel_total : 114908 time to create 1 rle with old method : 0.13260293006896973 time for calcul the mask position with numpy : 0.052861690521240234 nb_pixel_total : 7912 time to create 1 rle with old method : 0.009207010269165039 time for calcul the mask position with numpy : 0.05297493934631348 nb_pixel_total : 99702 time to create 1 rle with old method : 0.11373138427734375 time for calcul the mask position with numpy : 0.05299878120422363 nb_pixel_total : 980 time to create 1 rle with old method : 0.0013430118560791016 time for calcul the mask position with numpy : 0.05711483955383301 nb_pixel_total : 55931 time to create 1 rle with old method : 0.07630753517150879 time for calcul the mask position with numpy : 0.05442547798156738 nb_pixel_total : 133011 time to create 1 rle with old method : 0.150862455368042 time for calcul the mask position with numpy : 0.05632281303405762 nb_pixel_total : 380266 time to create 1 rle with new method : 0.935528039932251 time for calcul the mask position with numpy : 0.05330085754394531 nb_pixel_total : 29237 time to create 1 rle with old method : 0.035993337631225586 time for calcul the mask position with numpy : 0.05290079116821289 nb_pixel_total : 5213 time to create 1 rle with old method : 0.006091117858886719 time for calcul the mask position with numpy : 0.0545659065246582 nb_pixel_total : 215253 time to create 1 rle with new method : 1.712069034576416 time for calcul the mask position with numpy : 0.07146286964416504 nb_pixel_total : 135361 time to create 1 rle with old method : 0.22803711891174316 time for calcul the mask position with numpy : 0.05881500244140625 nb_pixel_total : 14713 time to create 1 rle with old method : 0.017567873001098633 time for calcul the mask position with numpy : 0.054329633712768555 nb_pixel_total : 68764 time to create 1 rle with old method : 0.07938146591186523 time for calcul the mask position with numpy : 0.05368351936340332 nb_pixel_total : 31874 time to create 1 rle with old method : 0.03723597526550293 time for calcul the mask position with numpy : 0.060209035873413086 nb_pixel_total : 4323 time to create 1 rle with old method : 0.0071544647216796875 time for calcul the mask position with numpy : 0.061411142349243164 nb_pixel_total : 36649 time to create 1 rle with old method : 0.04290604591369629 time for calcul the mask position with numpy : 0.05469799041748047 nb_pixel_total : 14589 time to create 1 rle with old method : 0.018636465072631836 time for calcul the mask position with numpy : 0.054671287536621094 nb_pixel_total : 269086 time to create 1 rle with new method : 0.7257235050201416 time for calcul the mask position with numpy : 0.05376434326171875 nb_pixel_total : 13668 time to create 1 rle with old method : 0.01601243019104004 time for calcul the mask position with numpy : 0.05350685119628906 nb_pixel_total : 10706 time to create 1 rle with old method : 0.012687444686889648 time for calcul the mask position with numpy : 0.061402320861816406 nb_pixel_total : 202674 time to create 1 rle with new method : 0.9442579746246338 time for calcul the mask position with numpy : 0.05728912353515625 nb_pixel_total : 90612 time to create 1 rle with old method : 0.1038808822631836 time for calcul the mask position with numpy : 0.0592646598815918 nb_pixel_total : 49790 time to create 1 rle with old method : 0.0587306022644043 time for calcul the mask position with numpy : 0.05385541915893555 nb_pixel_total : 18863 time to create 1 rle with old method : 0.02242112159729004 time for calcul the mask position with numpy : 0.05624651908874512 nb_pixel_total : 368149 time to create 1 rle with new method : 1.2176480293273926 time for calcul the mask position with numpy : 0.05539584159851074 nb_pixel_total : 21583 time to create 1 rle with old method : 0.025104999542236328 time for calcul the mask position with numpy : 0.05295920372009277 nb_pixel_total : 233883 time to create 1 rle with new method : 1.0260298252105713 time for calcul the mask position with numpy : 0.05327129364013672 nb_pixel_total : 1293 time to create 1 rle with old method : 0.00164031982421875 time for calcul the mask position with numpy : 0.054041385650634766 nb_pixel_total : 2328 time to create 1 rle with old method : 0.004545927047729492 time for calcul the mask position with numpy : 0.06089425086975098 nb_pixel_total : 46691 time to create 1 rle with old method : 0.058310508728027344 time for calcul the mask position with numpy : 0.05336952209472656 nb_pixel_total : 66938 time to create 1 rle with old method : 0.07547116279602051 time for calcul the mask position with numpy : 0.0550847053527832 nb_pixel_total : 26883 time to create 1 rle with old method : 0.030796527862548828 time for calcul the mask position with numpy : 0.053554534912109375 nb_pixel_total : 58247 time to create 1 rle with old method : 0.07044029235839844 time for calcul the mask position with numpy : 0.053476810455322266 nb_pixel_total : 7476 time to create 1 rle with old method : 0.012475252151489258 time for calcul the mask position with numpy : 0.06055927276611328 nb_pixel_total : 3797 time to create 1 rle with old method : 0.004685878753662109 time for calcul the mask position with numpy : 0.05348658561706543 nb_pixel_total : 59011 time to create 1 rle with old method : 0.06937599182128906 time for calcul the mask position with numpy : 0.053800106048583984 nb_pixel_total : 1454 time to create 1 rle with old method : 0.0021021366119384766 time for calcul the mask position with numpy : 0.0537111759185791 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0015685558319091797 time for calcul the mask position with numpy : 0.05545544624328613 nb_pixel_total : 165479 time to create 1 rle with new method : 1.4213392734527588 time for calcul the mask position with numpy : 0.05746626853942871 nb_pixel_total : 109858 time to create 1 rle with old method : 0.1304011344909668 time for calcul the mask position with numpy : 0.056905269622802734 nb_pixel_total : 110787 time to create 1 rle with old method : 0.12999415397644043 time for calcul the mask position with numpy : 0.05695223808288574 nb_pixel_total : 360888 time to create 1 rle with new method : 0.9417290687561035 time for calcul the mask position with numpy : 0.052840471267700195 nb_pixel_total : 31292 time to create 1 rle with old method : 0.03629708290100098 time for calcul the mask position with numpy : 0.05245256423950195 nb_pixel_total : 4684 time to create 1 rle with old method : 0.006009817123413086 time for calcul the mask position with numpy : 0.053815364837646484 nb_pixel_total : 68888 time to create 1 rle with old method : 0.10329651832580566 time for calcul the mask position with numpy : 0.05757713317871094 nb_pixel_total : 438063 time to create 1 rle with new method : 0.6977717876434326 time for calcul the mask position with numpy : 0.05577874183654785 nb_pixel_total : 183326 time to create 1 rle with new method : 1.144193172454834 time for calcul the mask position with numpy : 0.052704572677612305 nb_pixel_total : 9307 time to create 1 rle with old method : 0.011241912841796875 time for calcul the mask position with numpy : 0.0534515380859375 nb_pixel_total : 40128 time to create 1 rle with old method : 0.04561328887939453 time for calcul the mask position with numpy : 0.05278468132019043 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002607583999633789 time for calcul the mask position with numpy : 0.052826881408691406 nb_pixel_total : 52999 time to create 1 rle with old method : 0.061011552810668945 time for calcul the mask position with numpy : 0.05432844161987305 nb_pixel_total : 173902 time to create 1 rle with new method : 1.3311495780944824 time for calcul the mask position with numpy : 0.052608489990234375 nb_pixel_total : 75066 time to create 1 rle with old method : 0.08473753929138184 time for calcul the mask position with numpy : 0.05403900146484375 nb_pixel_total : 19738 time to create 1 rle with old method : 0.03193807601928711 time for calcul the mask position with numpy : 0.06155967712402344 nb_pixel_total : 213069 time to create 1 rle with new method : 1.1552605628967285 time for calcul the mask position with numpy : 0.05514717102050781 nb_pixel_total : 142422 time to create 1 rle with old method : 0.1631453037261963 time for calcul the mask position with numpy : 0.0562434196472168 nb_pixel_total : 189679 time to create 1 rle with new method : 1.2280704975128174 time for calcul the mask position with numpy : 0.0537257194519043 nb_pixel_total : 14535 time to create 1 rle with old method : 0.017818689346313477 time for calcul the mask position with numpy : 0.06684088706970215 nb_pixel_total : 669611 time to create 1 rle with new method : 2.299140691757202 time for calcul the mask position with numpy : 0.05533313751220703 nb_pixel_total : 410955 time to create 1 rle with new method : 1.0461230278015137 time for calcul the mask position with numpy : 0.054435014724731445 nb_pixel_total : 182365 time to create 1 rle with new method : 1.499079704284668 time for calcul the mask position with numpy : 0.05402517318725586 nb_pixel_total : 16725 time to create 1 rle with old method : 0.019796133041381836 time for calcul the mask position with numpy : 0.053739070892333984 nb_pixel_total : 5092 time to create 1 rle with old method : 0.006129026412963867 time for calcul the mask position with numpy : 0.054505109786987305 nb_pixel_total : 176910 time to create 1 rle with new method : 1.2365994453430176 time for calcul the mask position with numpy : 0.05804872512817383 nb_pixel_total : 424938 time to create 1 rle with new method : 1.0639598369598389 time for calcul the mask position with numpy : 0.0561215877532959 nb_pixel_total : 21561 time to create 1 rle with old method : 0.025017976760864258 time for calcul the mask position with numpy : 0.0570828914642334 nb_pixel_total : 21766 time to create 1 rle with old method : 0.03619742393493652 time for calcul the mask position with numpy : 0.06642270088195801 nb_pixel_total : 41650 time to create 1 rle with old method : 0.052317142486572266 time for calcul the mask position with numpy : 0.05568742752075195 nb_pixel_total : 17612 time to create 1 rle with old method : 0.021121978759765625 time for calcul the mask position with numpy : 0.054978132247924805 nb_pixel_total : 33 time to create 1 rle with old method : 9.655952453613281e-05 time for calcul the mask position with numpy : 0.05327939987182617 nb_pixel_total : 99934 time to create 1 rle with old method : 0.13033604621887207 time for calcul the mask position with numpy : 0.0638887882232666 nb_pixel_total : 138007 time to create 1 rle with old method : 0.1565561294555664 time for calcul the mask position with numpy : 0.05319857597351074 nb_pixel_total : 27634 time to create 1 rle with old method : 0.03302812576293945 time for calcul the mask position with numpy : 0.053231239318847656 nb_pixel_total : 70403 time to create 1 rle with old method : 0.08020448684692383 time for calcul the mask position with numpy : 0.05170726776123047 nb_pixel_total : 41 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.053290605545043945 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0017020702362060547 time for calcul the mask position with numpy : 0.05208873748779297 nb_pixel_total : 37523 time to create 1 rle with old method : 0.04232525825500488 time for calcul the mask position with numpy : 0.051345109939575195 nb_pixel_total : 5850 time to create 1 rle with old method : 0.0066831111907958984 time for calcul the mask position with numpy : 0.05168938636779785 nb_pixel_total : 146974 time to create 1 rle with old method : 0.16737747192382812 time for calcul the mask position with numpy : 0.051953792572021484 nb_pixel_total : 91880 time to create 1 rle with old method : 0.10363197326660156 time for calcul the mask position with numpy : 0.050998687744140625 nb_pixel_total : 10518 time to create 1 rle with old method : 0.011957645416259766 time for calcul the mask position with numpy : 0.05114603042602539 nb_pixel_total : 30036 time to create 1 rle with old method : 0.03387808799743652 time for calcul the mask position with numpy : 0.052611351013183594 nb_pixel_total : 30362 time to create 1 rle with old method : 0.03403306007385254 time for calcul the mask position with numpy : 0.05134153366088867 nb_pixel_total : 5013 time to create 1 rle with old method : 0.006205320358276367 time for calcul the mask position with numpy : 0.05137062072753906 nb_pixel_total : 83965 time to create 1 rle with old method : 0.09212851524353027 create new chi : 39.101465940475464 time to delete rle : 0.006368875503540039 batch 1 Loaded 97 chid ids of type : 4855 Number RLEs to save : 80482 TO DO : save crop sub photo not yet done ! save time : 13.007916688919067 nb_obj : 86 nb_hashtags : 11 time to prepare the origin masks : 76.7007462978363 time for calcul the mask position with numpy : 1.2232608795166016 nb_pixel_total : 4819020 time to create 1 rle with new method : 1.7306411266326904 time for calcul the mask position with numpy : 0.05477476119995117 nb_pixel_total : 102176 time to create 1 rle with old method : 0.11701178550720215 time for calcul the mask position with numpy : 0.05670738220214844 nb_pixel_total : 261612 time to create 1 rle with new method : 1.3332328796386719 time for calcul the mask position with numpy : 0.05457496643066406 nb_pixel_total : 90858 time to create 1 rle with old method : 0.10428166389465332 time for calcul the mask position with numpy : 0.05384969711303711 nb_pixel_total : 5672 time to create 1 rle with old method : 0.00669550895690918 time for calcul the mask position with numpy : 0.05637502670288086 nb_pixel_total : 130158 time to create 1 rle with old method : 0.15073084831237793 time for calcul the mask position with numpy : 0.061118364334106445 nb_pixel_total : 120557 time to create 1 rle with old method : 0.1398618221282959 time for calcul the mask position with numpy : 0.05363035202026367 nb_pixel_total : 3704 time to create 1 rle with old method : 0.0047054290771484375 time for calcul the mask position with numpy : 0.05692243576049805 nb_pixel_total : 238657 time to create 1 rle with new method : 1.1490180492401123 time for calcul the mask position with numpy : 0.053266286849975586 nb_pixel_total : 1913 time to create 1 rle with old method : 0.002398967742919922 time for calcul the mask position with numpy : 0.05318737030029297 nb_pixel_total : 47748 time to create 1 rle with old method : 0.05657958984375 time for calcul the mask position with numpy : 0.05407905578613281 nb_pixel_total : 237071 time to create 1 rle with new method : 1.152393102645874 time for calcul the mask position with numpy : 0.05384206771850586 nb_pixel_total : 71116 time to create 1 rle with old method : 0.08215856552124023 time for calcul the mask position with numpy : 0.053801774978637695 nb_pixel_total : 56877 time to create 1 rle with old method : 0.5367007255554199 time for calcul the mask position with numpy : 0.05354595184326172 nb_pixel_total : 15236 time to create 1 rle with old method : 0.0178678035736084 time for calcul the mask position with numpy : 0.05512857437133789 nb_pixel_total : 965 time to create 1 rle with old method : 0.0013837814331054688 time for calcul the mask position with numpy : 0.05985522270202637 nb_pixel_total : 2540 time to create 1 rle with old method : 0.00422358512878418 time for calcul the mask position with numpy : 0.059896230697631836 nb_pixel_total : 57865 time to create 1 rle with old method : 0.06643915176391602 time for calcul the mask position with numpy : 0.05345487594604492 nb_pixel_total : 46623 time to create 1 rle with old method : 0.05353903770446777 time for calcul the mask position with numpy : 0.052576303482055664 nb_pixel_total : 39412 time to create 1 rle with old method : 0.04406929016113281 time for calcul the mask position with numpy : 0.05298042297363281 nb_pixel_total : 61078 time to create 1 rle with old method : 0.06935262680053711 time for calcul the mask position with numpy : 0.054145097732543945 nb_pixel_total : 242240 time to create 1 rle with new method : 1.1762773990631104 time for calcul the mask position with numpy : 0.05351829528808594 nb_pixel_total : 5608 time to create 1 rle with old method : 0.006930828094482422 time for calcul the mask position with numpy : 0.05374956130981445 nb_pixel_total : 27053 time to create 1 rle with old method : 0.033225059509277344 time for calcul the mask position with numpy : 0.053984642028808594 nb_pixel_total : 53205 time to create 1 rle with old method : 0.06183147430419922 time for calcul the mask position with numpy : 0.053484201431274414 nb_pixel_total : 11579 time to create 1 rle with old method : 0.013417243957519531 time for calcul the mask position with numpy : 0.05280756950378418 nb_pixel_total : 15449 time to create 1 rle with old method : 0.01833057403564453 time for calcul the mask position with numpy : 0.055639028549194336 nb_pixel_total : 366182 time to create 1 rle with new method : 1.2223749160766602 time for calcul the mask position with numpy : 0.0531010627746582 nb_pixel_total : 41449 time to create 1 rle with old method : 0.04903411865234375 time for calcul the mask position with numpy : 0.052834272384643555 nb_pixel_total : 2355 time to create 1 rle with old method : 0.003033876419067383 time for calcul the mask position with numpy : 0.05352783203125 nb_pixel_total : 45045 time to create 1 rle with old method : 0.05253195762634277 time for calcul the mask position with numpy : 0.056113481521606445 nb_pixel_total : 548342 time to create 1 rle with new method : 0.8908343315124512 time for calcul the mask position with numpy : 0.05442237854003906 nb_pixel_total : 14810 time to create 1 rle with old method : 0.017650842666625977 time for calcul the mask position with numpy : 0.05243325233459473 nb_pixel_total : 22335 time to create 1 rle with old method : 0.02515554428100586 time for calcul the mask position with numpy : 0.05202531814575195 nb_pixel_total : 4491 time to create 1 rle with old method : 0.005418062210083008 time for calcul the mask position with numpy : 0.05319023132324219 nb_pixel_total : 2721 time to create 1 rle with old method : 0.003157377243041992 time for calcul the mask position with numpy : 0.05379080772399902 nb_pixel_total : 47137 time to create 1 rle with old method : 0.0551295280456543 time for calcul the mask position with numpy : 0.052591800689697266 nb_pixel_total : 401380 time to create 1 rle with new method : 0.984306812286377 time for calcul the mask position with numpy : 0.05378603935241699 nb_pixel_total : 28171 time to create 1 rle with old method : 0.03675723075866699 time for calcul the mask position with numpy : 0.053748130798339844 nb_pixel_total : 52484 time to create 1 rle with old method : 0.06005144119262695 time for calcul the mask position with numpy : 0.053072214126586914 nb_pixel_total : 61770 time to create 1 rle with old method : 0.07375383377075195 time for calcul the mask position with numpy : 0.05546426773071289 nb_pixel_total : 42000 time to create 1 rle with old method : 0.048543453216552734 time for calcul the mask position with numpy : 0.05243420600891113 nb_pixel_total : 25608 time to create 1 rle with old method : 0.03093409538269043 time for calcul the mask position with numpy : 0.06064200401306152 nb_pixel_total : 32278 time to create 1 rle with old method : 0.046838998794555664 time for calcul the mask position with numpy : 0.055802345275878906 nb_pixel_total : 296 time to create 1 rle with old method : 0.0008530616760253906 time for calcul the mask position with numpy : 0.060357093811035156 nb_pixel_total : 21767 time to create 1 rle with old method : 0.02686619758605957 time for calcul the mask position with numpy : 0.054808855056762695 nb_pixel_total : 45858 time to create 1 rle with old method : 0.053436279296875 time for calcul the mask position with numpy : 0.05349421501159668 nb_pixel_total : 101421 time to create 1 rle with old method : 0.11562824249267578 time for calcul the mask position with numpy : 0.05386042594909668 nb_pixel_total : 111729 time to create 1 rle with old method : 0.12877392768859863 time for calcul the mask position with numpy : 0.0528254508972168 nb_pixel_total : 50542 time to create 1 rle with old method : 0.05736804008483887 time for calcul the mask position with numpy : 0.05282187461853027 nb_pixel_total : 48113 time to create 1 rle with old method : 0.05463528633117676 time for calcul the mask position with numpy : 0.05300545692443848 nb_pixel_total : 18909 time to create 1 rle with old method : 0.023731470108032227 time for calcul the mask position with numpy : 0.05394172668457031 nb_pixel_total : 164900 time to create 1 rle with new method : 1.1133973598480225 time for calcul the mask position with numpy : 0.05375313758850098 nb_pixel_total : 20509 time to create 1 rle with old method : 0.02393364906311035 time for calcul the mask position with numpy : 0.05762004852294922 nb_pixel_total : 52909 time to create 1 rle with old method : 0.060418128967285156 time for calcul the mask position with numpy : 0.05564403533935547 nb_pixel_total : 99517 time to create 1 rle with old method : 0.11813664436340332 time for calcul the mask position with numpy : 0.059841156005859375 nb_pixel_total : 129338 time to create 1 rle with old method : 0.16652297973632812 time for calcul the mask position with numpy : 0.0559849739074707 nb_pixel_total : 5547 time to create 1 rle with old method : 0.0070953369140625 time for calcul the mask position with numpy : 0.053038597106933594 nb_pixel_total : 23322 time to create 1 rle with old method : 0.026621103286743164 time for calcul the mask position with numpy : 0.05531644821166992 nb_pixel_total : 168996 time to create 1 rle with new method : 0.7991564273834229 time for calcul the mask position with numpy : 0.053269147872924805 nb_pixel_total : 202601 time to create 1 rle with new method : 1.083380937576294 time for calcul the mask position with numpy : 0.05343270301818848 nb_pixel_total : 45376 time to create 1 rle with old method : 0.051459550857543945 time for calcul the mask position with numpy : 0.05286812782287598 nb_pixel_total : 4818 time to create 1 rle with old method : 0.0059392452239990234 time for calcul the mask position with numpy : 0.05332517623901367 nb_pixel_total : 133279 time to create 1 rle with old method : 0.17295408248901367 time for calcul the mask position with numpy : 0.05449938774108887 nb_pixel_total : 85493 time to create 1 rle with old method : 0.09793734550476074 time for calcul the mask position with numpy : 0.06639313697814941 nb_pixel_total : 947066 time to create 1 rle with new method : 1.4625060558319092 time for calcul the mask position with numpy : 0.05451512336730957 nb_pixel_total : 143255 time to create 1 rle with old method : 0.16775846481323242 time for calcul the mask position with numpy : 0.05241084098815918 nb_pixel_total : 8001 time to create 1 rle with old method : 0.009391546249389648 time for calcul the mask position with numpy : 0.05246400833129883 nb_pixel_total : 44990 time to create 1 rle with old method : 0.05190920829772949 time for calcul the mask position with numpy : 0.053688764572143555 nb_pixel_total : 151246 time to create 1 rle with new method : 1.3124682903289795 time for calcul the mask position with numpy : 0.053418636322021484 nb_pixel_total : 36049 time to create 1 rle with old method : 0.04196310043334961 time for calcul the mask position with numpy : 0.05313682556152344 nb_pixel_total : 72087 time to create 1 rle with old method : 0.08183693885803223 time for calcul the mask position with numpy : 0.05279803276062012 nb_pixel_total : 5450 time to create 1 rle with old method : 0.006873369216918945 time for calcul the mask position with numpy : 0.055625200271606445 nb_pixel_total : 317920 time to create 1 rle with new method : 1.0292887687683105 time for calcul the mask position with numpy : 0.05330181121826172 nb_pixel_total : 1801 time to create 1 rle with old method : 0.0027832984924316406 time for calcul the mask position with numpy : 0.055092811584472656 nb_pixel_total : 64003 time to create 1 rle with old method : 0.0731513500213623 time for calcul the mask position with numpy : 0.054996490478515625 nb_pixel_total : 371001 time to create 1 rle with new method : 0.9347400665283203 time for calcul the mask position with numpy : 0.0577998161315918 nb_pixel_total : 152302 time to create 1 rle with new method : 1.1741752624511719 time for calcul the mask position with numpy : 0.06130862236022949 nb_pixel_total : 2910 time to create 1 rle with old method : 0.003839254379272461 time for calcul the mask position with numpy : 0.05395984649658203 nb_pixel_total : 71477 time to create 1 rle with old method : 0.08286261558532715 time for calcul the mask position with numpy : 0.05754899978637695 nb_pixel_total : 98990 time to create 1 rle with old method : 0.11893343925476074 time for calcul the mask position with numpy : 0.0537717342376709 nb_pixel_total : 26331 time to create 1 rle with old method : 0.03072524070739746 time for calcul the mask position with numpy : 0.054065704345703125 nb_pixel_total : 222094 time to create 1 rle with new method : 1.0510988235473633 time for calcul the mask position with numpy : 0.052730560302734375 nb_pixel_total : 119200 time to create 1 rle with old method : 0.13243460655212402 time for calcul the mask position with numpy : 0.05408048629760742 nb_pixel_total : 70794 time to create 1 rle with old method : 0.08039641380310059 time for calcul the mask position with numpy : 0.052446603775024414 nb_pixel_total : 9937 time to create 1 rle with old method : 0.011397838592529297 time for calcul the mask position with numpy : 0.05174970626831055 nb_pixel_total : 2506 time to create 1 rle with old method : 0.0028896331787109375 create new chi : 30.52286672592163 time to delete rle : 0.005701541900634766 batch 1 Loaded 87 chid ids of type : 4855 Number RLEs to save : 68660 TO DO : save crop sub photo not yet done ! save time : 4.390251636505127 nb_obj : 30 nb_hashtags : 7 time to prepare the origin masks : 32.75840353965759 time for calcul the mask position with numpy : 0.7332768440246582 nb_pixel_total : 7635977 time to create 1 rle with new method : 1.3437182903289795 time for calcul the mask position with numpy : 0.05454540252685547 nb_pixel_total : 30907 time to create 1 rle with old method : 0.03510141372680664 time for calcul the mask position with numpy : 0.05462026596069336 nb_pixel_total : 130117 time to create 1 rle with old method : 0.14618134498596191 time for calcul the mask position with numpy : 0.054833412170410156 nb_pixel_total : 61656 time to create 1 rle with old method : 0.07207918167114258 time for calcul the mask position with numpy : 0.05501723289489746 nb_pixel_total : 98082 time to create 1 rle with old method : 0.1106877326965332 time for calcul the mask position with numpy : 0.0528109073638916 nb_pixel_total : 39257 time to create 1 rle with old method : 0.043444156646728516 time for calcul the mask position with numpy : 0.05324864387512207 nb_pixel_total : 15306 time to create 1 rle with old method : 0.017218828201293945 time for calcul the mask position with numpy : 0.08237528800964355 nb_pixel_total : 831535 time to create 1 rle with new method : 1.249950885772705 time for calcul the mask position with numpy : 0.05430269241333008 nb_pixel_total : 49133 time to create 1 rle with old method : 0.05404305458068848 time for calcul the mask position with numpy : 0.05354452133178711 nb_pixel_total : 19407 time to create 1 rle with old method : 0.022443056106567383 time for calcul the mask position with numpy : 0.0637669563293457 nb_pixel_total : 159204 time to create 1 rle with new method : 1.0896592140197754 time for calcul the mask position with numpy : 0.05296683311462402 nb_pixel_total : 23750 time to create 1 rle with old method : 0.0263671875 time for calcul the mask position with numpy : 0.053179025650024414 nb_pixel_total : 122542 time to create 1 rle with old method : 0.13435792922973633 time for calcul the mask position with numpy : 0.0514216423034668 nb_pixel_total : 42924 time to create 1 rle with old method : 0.04654335975646973 time for calcul the mask position with numpy : 0.05510759353637695 nb_pixel_total : 213425 time to create 1 rle with new method : 1.4566984176635742 time for calcul the mask position with numpy : 0.05182647705078125 nb_pixel_total : 63045 time to create 1 rle with old method : 0.06836271286010742 time for calcul the mask position with numpy : 0.2066035270690918 nb_pixel_total : 1547593 time to create 1 rle with new method : 3.145529270172119 time for calcul the mask position with numpy : 0.051737070083618164 nb_pixel_total : 14565 time to create 1 rle with old method : 0.01661539077758789 time for calcul the mask position with numpy : 0.05499458312988281 nb_pixel_total : 223884 time to create 1 rle with new method : 1.1750147342681885 time for calcul the mask position with numpy : 0.0534062385559082 nb_pixel_total : 163332 time to create 1 rle with new method : 1.9977245330810547 time for calcul the mask position with numpy : 0.05429863929748535 nb_pixel_total : 10287 time to create 1 rle with old method : 0.011940479278564453 time for calcul the mask position with numpy : 0.06017351150512695 nb_pixel_total : 127785 time to create 1 rle with old method : 0.14100217819213867 time for calcul the mask position with numpy : 0.05392169952392578 nb_pixel_total : 93303 time to create 1 rle with old method : 0.10585474967956543 time for calcul the mask position with numpy : 0.054784536361694336 nb_pixel_total : 87151 time to create 1 rle with old method : 0.09965300559997559 time for calcul the mask position with numpy : 0.05323982238769531 nb_pixel_total : 70916 time to create 1 rle with old method : 0.08076286315917969 time for calcul the mask position with numpy : 0.05442690849304199 nb_pixel_total : 478 time to create 1 rle with old method : 0.0008256435394287109 time for calcul the mask position with numpy : 0.06377768516540527 nb_pixel_total : 649255 time to create 1 rle with new method : 1.2485637664794922 time for calcul the mask position with numpy : 0.05539131164550781 nb_pixel_total : 406059 time to create 1 rle with new method : 0.6303505897521973 time for calcul the mask position with numpy : 0.05221438407897949 nb_pixel_total : 20029 time to create 1 rle with old method : 0.021468400955200195 time for calcul the mask position with numpy : 0.05124711990356445 nb_pixel_total : 27305 time to create 1 rle with old method : 0.02983713150024414 time for calcul the mask position with numpy : 0.051955461502075195 nb_pixel_total : 991 time to create 1 rle with old method : 0.0014684200286865234 create new chi : 17.673097372055054 time to delete rle : 0.0034303665161132812 batch 1 Loaded 31 chid ids of type : 4855 Number RLEs to save : 27043 TO DO : save crop sub photo not yet done ! save time : 1.511699914932251 nb_obj : 81 nb_hashtags : 9 time to prepare the origin masks : 71.02230834960938 time for calcul the mask position with numpy : 0.9234330654144287 nb_pixel_total : 5262064 time to create 1 rle with new method : 1.1195082664489746 time for calcul the mask position with numpy : 0.05511474609375 nb_pixel_total : 85488 time to create 1 rle with old method : 0.09792947769165039 time for calcul the mask position with numpy : 0.05400824546813965 nb_pixel_total : 6073 time to create 1 rle with old method : 0.0074498653411865234 time for calcul the mask position with numpy : 0.058068037033081055 nb_pixel_total : 298323 time to create 1 rle with new method : 1.8941268920898438 time for calcul the mask position with numpy : 0.062253713607788086 nb_pixel_total : 266550 time to create 1 rle with new method : 0.8182127475738525 time for calcul the mask position with numpy : 0.05391645431518555 nb_pixel_total : 44626 time to create 1 rle with old method : 0.05165505409240723 time for calcul the mask position with numpy : 0.05369853973388672 nb_pixel_total : 57422 time to create 1 rle with old method : 0.06756043434143066 time for calcul the mask position with numpy : 0.05328035354614258 nb_pixel_total : 7729 time to create 1 rle with old method : 0.009117841720581055 time for calcul the mask position with numpy : 0.05360579490661621 nb_pixel_total : 59315 time to create 1 rle with old method : 0.06958723068237305 time for calcul the mask position with numpy : 0.05374312400817871 nb_pixel_total : 50827 time to create 1 rle with old method : 0.06224822998046875 time for calcul the mask position with numpy : 0.06708717346191406 nb_pixel_total : 40065 time to create 1 rle with old method : 0.054319143295288086 time for calcul the mask position with numpy : 0.058837175369262695 nb_pixel_total : 55503 time to create 1 rle with old method : 0.06431078910827637 time for calcul the mask position with numpy : 0.055168867111206055 nb_pixel_total : 167627 time to create 1 rle with new method : 1.3456933498382568 time for calcul the mask position with numpy : 0.05259561538696289 nb_pixel_total : 211769 time to create 1 rle with new method : 1.1991918087005615 time for calcul the mask position with numpy : 0.05385875701904297 nb_pixel_total : 72147 time to create 1 rle with old method : 0.08253097534179688 time for calcul the mask position with numpy : 0.05249524116516113 nb_pixel_total : 114571 time to create 1 rle with old method : 0.12917065620422363 time for calcul the mask position with numpy : 0.052925825119018555 nb_pixel_total : 53111 time to create 1 rle with old method : 0.06013035774230957 time for calcul the mask position with numpy : 0.05185985565185547 nb_pixel_total : 33983 time to create 1 rle with old method : 0.038019657135009766 time for calcul the mask position with numpy : 0.05154156684875488 nb_pixel_total : 67782 time to create 1 rle with old method : 0.07607245445251465 time for calcul the mask position with numpy : 0.051717519760131836 nb_pixel_total : 82005 time to create 1 rle with old method : 0.09257793426513672 time for calcul the mask position with numpy : 0.05276155471801758 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007712841033935547 time for calcul the mask position with numpy : 0.05248618125915527 nb_pixel_total : 110353 time to create 1 rle with old method : 0.1244816780090332 time for calcul the mask position with numpy : 0.05281877517700195 nb_pixel_total : 30065 time to create 1 rle with old method : 0.0349574089050293 time for calcul the mask position with numpy : 0.05382680892944336 nb_pixel_total : 152126 time to create 1 rle with new method : 1.5486805438995361 time for calcul the mask position with numpy : 0.05279803276062012 nb_pixel_total : 262124 time to create 1 rle with new method : 1.409672737121582 time for calcul the mask position with numpy : 0.053800344467163086 nb_pixel_total : 39029 time to create 1 rle with old method : 0.04358935356140137 time for calcul the mask position with numpy : 0.052518367767333984 nb_pixel_total : 18062 time to create 1 rle with old method : 0.020755529403686523 time for calcul the mask position with numpy : 0.054791927337646484 nb_pixel_total : 44883 time to create 1 rle with old method : 0.04945492744445801 time for calcul the mask position with numpy : 0.05233430862426758 nb_pixel_total : 41818 time to create 1 rle with old method : 0.047376155853271484 time for calcul the mask position with numpy : 0.05258297920227051 nb_pixel_total : 132100 time to create 1 rle with old method : 0.14862275123596191 time for calcul the mask position with numpy : 0.050779104232788086 nb_pixel_total : 66674 time to create 1 rle with old method : 0.07631182670593262 time for calcul the mask position with numpy : 0.054229736328125 nb_pixel_total : 121491 time to create 1 rle with old method : 0.13972067832946777 time for calcul the mask position with numpy : 0.05345654487609863 nb_pixel_total : 118757 time to create 1 rle with old method : 0.13818120956420898 time for calcul the mask position with numpy : 0.053682804107666016 nb_pixel_total : 32813 time to create 1 rle with old method : 0.0378422737121582 time for calcul the mask position with numpy : 0.05231618881225586 nb_pixel_total : 33529 time to create 1 rle with old method : 0.038256168365478516 time for calcul the mask position with numpy : 0.05293536186218262 nb_pixel_total : 18425 time to create 1 rle with old method : 0.021136760711669922 time for calcul the mask position with numpy : 0.05266237258911133 nb_pixel_total : 155072 time to create 1 rle with new method : 1.06068754196167 time for calcul the mask position with numpy : 0.05232119560241699 nb_pixel_total : 56402 time to create 1 rle with old method : 0.06383466720581055 time for calcul the mask position with numpy : 0.052312612533569336 nb_pixel_total : 114245 time to create 1 rle with old method : 0.1267225742340088 time for calcul the mask position with numpy : 0.052301883697509766 nb_pixel_total : 736 time to create 1 rle with old method : 0.0011458396911621094 time for calcul the mask position with numpy : 0.05188632011413574 nb_pixel_total : 140329 time to create 1 rle with old method : 0.16284728050231934 time for calcul the mask position with numpy : 0.054107666015625 nb_pixel_total : 55138 time to create 1 rle with old method : 0.06427168846130371 time for calcul the mask position with numpy : 0.05311274528503418 nb_pixel_total : 55446 time to create 1 rle with old method : 0.06313443183898926 time for calcul the mask position with numpy : 0.05425071716308594 nb_pixel_total : 280899 time to create 1 rle with new method : 2.0498363971710205 time for calcul the mask position with numpy : 0.05304121971130371 nb_pixel_total : 51620 time to create 1 rle with old method : 0.06038188934326172 time for calcul the mask position with numpy : 0.05559515953063965 nb_pixel_total : 238745 time to create 1 rle with new method : 1.5084407329559326 time for calcul the mask position with numpy : 0.056099653244018555 nb_pixel_total : 47466 time to create 1 rle with old method : 0.05580496788024902 time for calcul the mask position with numpy : 0.05373358726501465 nb_pixel_total : 54502 time to create 1 rle with old method : 0.06294512748718262 time for calcul the mask position with numpy : 0.05326724052429199 nb_pixel_total : 1624 time to create 1 rle with old method : 0.0021767616271972656 time for calcul the mask position with numpy : 0.05455899238586426 nb_pixel_total : 90404 time to create 1 rle with old method : 0.10529708862304688 time for calcul the mask position with numpy : 0.054325103759765625 nb_pixel_total : 146332 time to create 1 rle with old method : 0.17676448822021484 time for calcul the mask position with numpy : 0.055580854415893555 nb_pixel_total : 47528 time to create 1 rle with old method : 0.07172560691833496 time for calcul the mask position with numpy : 0.0636289119720459 nb_pixel_total : 520558 time to create 1 rle with new method : 2.1310667991638184 time for calcul the mask position with numpy : 0.056250572204589844 nb_pixel_total : 43418 time to create 1 rle with old method : 0.0522615909576416 time for calcul the mask position with numpy : 0.0560917854309082 nb_pixel_total : 63431 time to create 1 rle with old method : 0.0743570327758789 time for calcul the mask position with numpy : 0.05654311180114746 nb_pixel_total : 68825 time to create 1 rle with old method : 0.07953953742980957 time for calcul the mask position with numpy : 0.06074118614196777 nb_pixel_total : 402934 time to create 1 rle with new method : 1.5556342601776123 time for calcul the mask position with numpy : 0.05343055725097656 nb_pixel_total : 1246 time to create 1 rle with old method : 0.0018467903137207031 time for calcul the mask position with numpy : 0.05346417427062988 nb_pixel_total : 847 time to create 1 rle with old method : 0.001046895980834961 time for calcul the mask position with numpy : 0.05535626411437988 nb_pixel_total : 6373 time to create 1 rle with old method : 0.0073490142822265625 time for calcul the mask position with numpy : 0.053423166275024414 nb_pixel_total : 41899 time to create 1 rle with old method : 0.04882478713989258 time for calcul the mask position with numpy : 0.05286431312561035 nb_pixel_total : 2795 time to create 1 rle with old method : 0.0036468505859375 time for calcul the mask position with numpy : 0.05333733558654785 nb_pixel_total : 70255 time to create 1 rle with old method : 0.08289551734924316 time for calcul the mask position with numpy : 0.05292487144470215 nb_pixel_total : 34946 time to create 1 rle with old method : 0.03980612754821777 time for calcul the mask position with numpy : 0.0543363094329834 nb_pixel_total : 240617 time to create 1 rle with new method : 1.175649642944336 time for calcul the mask position with numpy : 0.05386614799499512 nb_pixel_total : 126618 time to create 1 rle with old method : 0.14401721954345703 time for calcul the mask position with numpy : 0.05206727981567383 nb_pixel_total : 60475 time to create 1 rle with old method : 0.06880331039428711 time for calcul the mask position with numpy : 0.05641531944274902 nb_pixel_total : 20111 time to create 1 rle with old method : 0.02318859100341797 time for calcul the mask position with numpy : 0.05211305618286133 nb_pixel_total : 32643 time to create 1 rle with old method : 0.04078197479248047 time for calcul the mask position with numpy : 0.052652835845947266 nb_pixel_total : 16844 time to create 1 rle with old method : 0.019597530364990234 time for calcul the mask position with numpy : 0.05719804763793945 nb_pixel_total : 130841 time to create 1 rle with old method : 0.16728758811950684 time for calcul the mask position with numpy : 0.06158089637756348 nb_pixel_total : 296162 time to create 1 rle with new method : 1.188032865524292 time for calcul the mask position with numpy : 0.05336356163024902 nb_pixel_total : 28975 time to create 1 rle with old method : 0.0344088077545166 time for calcul the mask position with numpy : 0.05487370491027832 nb_pixel_total : 13178 time to create 1 rle with old method : 0.01557159423828125 time for calcul the mask position with numpy : 0.05432629585266113 nb_pixel_total : 94327 time to create 1 rle with old method : 0.10802054405212402 time for calcul the mask position with numpy : 0.05684089660644531 nb_pixel_total : 19735 time to create 1 rle with old method : 0.03166317939758301 time for calcul the mask position with numpy : 0.05813479423522949 nb_pixel_total : 1038 time to create 1 rle with old method : 0.001430511474609375 time for calcul the mask position with numpy : 0.05488133430480957 nb_pixel_total : 186257 time to create 1 rle with new method : 1.7709429264068604 time for calcul the mask position with numpy : 0.053478240966796875 nb_pixel_total : 6 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.058850765228271484 nb_pixel_total : 496857 time to create 1 rle with new method : 1.090787649154663 time for calcul the mask position with numpy : 0.05318760871887207 nb_pixel_total : 53727 time to create 1 rle with old method : 0.07401299476623535 time for calcul the mask position with numpy : 0.054350852966308594 nb_pixel_total : 107026 time to create 1 rle with old method : 0.12271785736083984 create new chi : 33.08835792541504 time to delete rle : 0.008002758026123047 batch 1 Loaded 82 chid ids of type : 4855 Number RLEs to save : 60038 TO DO : save crop sub photo not yet done ! save time : 3.3804891109466553 nb_obj : 72 nb_hashtags : 8 time to prepare the origin masks : 75.41642475128174 time for calcul the mask position with numpy : 0.26955270767211914 nb_pixel_total : 4331405 time to create 1 rle with new method : 1.8541502952575684 time for calcul the mask position with numpy : 0.053156375885009766 nb_pixel_total : 54123 time to create 1 rle with old method : 0.06099247932434082 time for calcul the mask position with numpy : 0.05348920822143555 nb_pixel_total : 50894 time to create 1 rle with old method : 0.057683706283569336 time for calcul the mask position with numpy : 0.052889347076416016 nb_pixel_total : 7652 time to create 1 rle with old method : 0.008849859237670898 time for calcul the mask position with numpy : 0.052324771881103516 nb_pixel_total : 23255 time to create 1 rle with old method : 0.02680492401123047 time for calcul the mask position with numpy : 0.05237913131713867 nb_pixel_total : 29973 time to create 1 rle with old method : 0.03432726860046387 time for calcul the mask position with numpy : 0.051564693450927734 nb_pixel_total : 16998 time to create 1 rle with old method : 0.019933223724365234 time for calcul the mask position with numpy : 0.05865669250488281 nb_pixel_total : 232377 time to create 1 rle with new method : 1.1304659843444824 time for calcul the mask position with numpy : 0.05379056930541992 nb_pixel_total : 31913 time to create 1 rle with old method : 0.03671455383300781 time for calcul the mask position with numpy : 0.05552196502685547 nb_pixel_total : 8261 time to create 1 rle with old method : 0.009799718856811523 time for calcul the mask position with numpy : 0.06374382972717285 nb_pixel_total : 342452 time to create 1 rle with new method : 1.033994197845459 time for calcul the mask position with numpy : 0.05382728576660156 nb_pixel_total : 8296 time to create 1 rle with old method : 0.009810924530029297 time for calcul the mask position with numpy : 0.05827951431274414 nb_pixel_total : 400446 time to create 1 rle with new method : 0.797982931137085 time for calcul the mask position with numpy : 0.052504777908325195 nb_pixel_total : 20935 time to create 1 rle with old method : 0.024210214614868164 time for calcul the mask position with numpy : 0.0525360107421875 nb_pixel_total : 12485 time to create 1 rle with old method : 0.014423131942749023 time for calcul the mask position with numpy : 0.053070783615112305 nb_pixel_total : 17768 time to create 1 rle with old method : 0.023366451263427734 time for calcul the mask position with numpy : 0.06282401084899902 nb_pixel_total : 230275 time to create 1 rle with new method : 0.8355991840362549 time for calcul the mask position with numpy : 0.0541682243347168 nb_pixel_total : 140828 time to create 1 rle with old method : 0.16144943237304688 time for calcul the mask position with numpy : 0.05636096000671387 nb_pixel_total : 363608 time to create 1 rle with new method : 0.9932701587677002 time for calcul the mask position with numpy : 0.059035301208496094 nb_pixel_total : 22518 time to create 1 rle with old method : 0.02638721466064453 time for calcul the mask position with numpy : 0.0536346435546875 nb_pixel_total : 2462 time to create 1 rle with old method : 0.0030143260955810547 time for calcul the mask position with numpy : 0.053648948669433594 nb_pixel_total : 4242 time to create 1 rle with old method : 0.00494074821472168 time for calcul the mask position with numpy : 0.05388784408569336 nb_pixel_total : 56505 time to create 1 rle with old method : 0.06544661521911621 time for calcul the mask position with numpy : 0.05475950241088867 nb_pixel_total : 134241 time to create 1 rle with old method : 0.1506638526916504 time for calcul the mask position with numpy : 0.05448102951049805 nb_pixel_total : 236945 time to create 1 rle with new method : 0.8078000545501709 time for calcul the mask position with numpy : 0.07044649124145508 nb_pixel_total : 733001 time to create 1 rle with new method : 0.8494186401367188 time for calcul the mask position with numpy : 0.051654815673828125 nb_pixel_total : 33528 time to create 1 rle with old method : 0.03763008117675781 time for calcul the mask position with numpy : 0.05341386795043945 nb_pixel_total : 94504 time to create 1 rle with old method : 0.10972094535827637 time for calcul the mask position with numpy : 0.055027008056640625 nb_pixel_total : 130177 time to create 1 rle with old method : 0.15081501007080078 time for calcul the mask position with numpy : 0.05356240272521973 nb_pixel_total : 12785 time to create 1 rle with old method : 0.01520991325378418 time for calcul the mask position with numpy : 0.05609941482543945 nb_pixel_total : 57618 time to create 1 rle with old method : 0.06926560401916504 time for calcul the mask position with numpy : 0.055045127868652344 nb_pixel_total : 24609 time to create 1 rle with old method : 0.0288848876953125 time for calcul the mask position with numpy : 0.05394721031188965 nb_pixel_total : 18276 time to create 1 rle with old method : 0.02188730239868164 time for calcul the mask position with numpy : 0.054811954498291016 nb_pixel_total : 157443 time to create 1 rle with new method : 1.4298455715179443 time for calcul the mask position with numpy : 0.05475926399230957 nb_pixel_total : 73955 time to create 1 rle with old method : 0.08461141586303711 time for calcul the mask position with numpy : 0.05544686317443848 nb_pixel_total : 390 time to create 1 rle with old method : 0.0007433891296386719 time for calcul the mask position with numpy : 0.05438876152038574 nb_pixel_total : 8041 time to create 1 rle with old method : 0.009794950485229492 time for calcul the mask position with numpy : 0.053937673568725586 nb_pixel_total : 35375 time to create 1 rle with old method : 0.04108166694641113 time for calcul the mask position with numpy : 0.06277656555175781 nb_pixel_total : 810160 time to create 1 rle with new method : 1.257643222808838 time for calcul the mask position with numpy : 0.05421280860900879 nb_pixel_total : 37095 time to create 1 rle with old method : 0.04130244255065918 time for calcul the mask position with numpy : 0.05174541473388672 nb_pixel_total : 3088 time to create 1 rle with old method : 0.003693103790283203 time for calcul the mask position with numpy : 0.05404782295227051 nb_pixel_total : 7200 time to create 1 rle with old method : 0.009254932403564453 time for calcul the mask position with numpy : 0.0532536506652832 nb_pixel_total : 6225 time to create 1 rle with old method : 0.007505178451538086 time for calcul the mask position with numpy : 0.05567622184753418 nb_pixel_total : 219142 time to create 1 rle with new method : 0.5525784492492676 time for calcul the mask position with numpy : 0.05478072166442871 nb_pixel_total : 139924 time to create 1 rle with old method : 0.15795040130615234 time for calcul the mask position with numpy : 0.05310320854187012 nb_pixel_total : 65005 time to create 1 rle with old method : 0.07409191131591797 time for calcul the mask position with numpy : 0.05385136604309082 nb_pixel_total : 36026 time to create 1 rle with old method : 0.04332780838012695 time for calcul the mask position with numpy : 0.06481242179870605 nb_pixel_total : 849229 time to create 1 rle with new method : 2.2561304569244385 time for calcul the mask position with numpy : 0.05481910705566406 nb_pixel_total : 4573 time to create 1 rle with old method : 0.005525350570678711 time for calcul the mask position with numpy : 0.05408740043640137 nb_pixel_total : 50236 time to create 1 rle with old method : 0.05707526206970215 time for calcul the mask position with numpy : 0.05539393424987793 nb_pixel_total : 46915 time to create 1 rle with old method : 0.06312942504882812 time for calcul the mask position with numpy : 0.07450175285339355 nb_pixel_total : 59826 time to create 1 rle with old method : 0.06946396827697754 time for calcul the mask position with numpy : 0.062497854232788086 nb_pixel_total : 43091 time to create 1 rle with old method : 0.06650757789611816 time for calcul the mask position with numpy : 0.06713342666625977 nb_pixel_total : 72372 time to create 1 rle with old method : 0.09807300567626953 time for calcul the mask position with numpy : 0.05427718162536621 nb_pixel_total : 51864 time to create 1 rle with old method : 0.060216665267944336 time for calcul the mask position with numpy : 0.054090261459350586 nb_pixel_total : 1702 time to create 1 rle with old method : 0.0021560192108154297 time for calcul the mask position with numpy : 0.05433392524719238 nb_pixel_total : 67647 time to create 1 rle with old method : 0.07982015609741211 time for calcul the mask position with numpy : 0.05691170692443848 nb_pixel_total : 101493 time to create 1 rle with old method : 0.11597228050231934 time for calcul the mask position with numpy : 0.05333876609802246 nb_pixel_total : 82897 time to create 1 rle with old method : 0.09667062759399414 time for calcul the mask position with numpy : 0.05353879928588867 nb_pixel_total : 52399 time to create 1 rle with old method : 0.06004834175109863 time for calcul the mask position with numpy : 0.053876399993896484 nb_pixel_total : 60043 time to create 1 rle with old method : 0.06879520416259766 time for calcul the mask position with numpy : 0.053395748138427734 nb_pixel_total : 8096 time to create 1 rle with old method : 0.009771585464477539 time for calcul the mask position with numpy : 0.061382293701171875 nb_pixel_total : 851679 time to create 1 rle with new method : 0.5638153553009033 time for calcul the mask position with numpy : 0.05432581901550293 nb_pixel_total : 115744 time to create 1 rle with old method : 0.13064050674438477 time for calcul the mask position with numpy : 0.056581974029541016 nb_pixel_total : 27982 time to create 1 rle with old method : 0.033188581466674805 time for calcul the mask position with numpy : 0.05387592315673828 nb_pixel_total : 54100 time to create 1 rle with old method : 0.0633845329284668 time for calcul the mask position with numpy : 0.05526995658874512 nb_pixel_total : 165255 time to create 1 rle with new method : 0.6403789520263672 time for calcul the mask position with numpy : 0.057216644287109375 nb_pixel_total : 396101 time to create 1 rle with new method : 1.46889328956604 time for calcul the mask position with numpy : 0.05606961250305176 nb_pixel_total : 170723 time to create 1 rle with new method : 1.3033628463745117 time for calcul the mask position with numpy : 0.06343460083007812 nb_pixel_total : 1772 time to create 1 rle with old method : 0.0022993087768554688 time for calcul the mask position with numpy : 0.056738853454589844 nb_pixel_total : 78152 time to create 1 rle with old method : 0.0897672176361084 time for calcul the mask position with numpy : 0.053572893142700195 nb_pixel_total : 13194 time to create 1 rle with old method : 0.015547752380371094 time for calcul the mask position with numpy : 0.053945064544677734 nb_pixel_total : 67691 time to create 1 rle with old method : 0.07791614532470703 create new chi : 25.689050674438477 time to delete rle : 0.007227659225463867 batch 1 Loaded 73 chid ids of type : 4855 Number RLEs to save : 54482 TO DO : save crop sub photo not yet done ! save time : 15.017685651779175 nb_obj : 13 nb_hashtags : 5 time to prepare the origin masks : 20.08982253074646 time for calcul the mask position with numpy : 0.1185004711151123 nb_pixel_total : 1508877 time to create 1 rle with new method : 0.6026859283447266 time for calcul the mask position with numpy : 0.04807305335998535 nb_pixel_total : 26284 time to create 1 rle with old method : 0.03045034408569336 time for calcul the mask position with numpy : 0.05705714225769043 nb_pixel_total : 2701 time to create 1 rle with old method : 0.003255128860473633 time for calcul the mask position with numpy : 0.07868003845214844 nb_pixel_total : 35599 time to create 1 rle with old method : 0.04288792610168457 time for calcul the mask position with numpy : 0.07477831840515137 nb_pixel_total : 803 time to create 1 rle with old method : 0.0010273456573486328 time for calcul the mask position with numpy : 0.07990264892578125 nb_pixel_total : 937145 time to create 1 rle with new method : 2.4395925998687744 time for calcul the mask position with numpy : 0.05168581008911133 nb_pixel_total : 75798 time to create 1 rle with old method : 0.08251023292541504 time for calcul the mask position with numpy : 0.04937744140625 nb_pixel_total : 4910 time to create 1 rle with old method : 0.0055389404296875 time for calcul the mask position with numpy : 0.041197776794433594 nb_pixel_total : 23440 time to create 1 rle with old method : 0.026406288146972656 time for calcul the mask position with numpy : 0.04457592964172363 nb_pixel_total : 18476 time to create 1 rle with old method : 0.020276784896850586 time for calcul the mask position with numpy : 0.24463772773742676 nb_pixel_total : 3112054 time to create 1 rle with new method : 0.9023463726043701 time for calcul the mask position with numpy : 0.054718017578125 nb_pixel_total : 719977 time to create 1 rle with new method : 0.6110095977783203 time for calcul the mask position with numpy : 0.051811933517456055 nb_pixel_total : 314947 time to create 1 rle with new method : 0.6950006484985352 time for calcul the mask position with numpy : 0.5340423583984375 nb_pixel_total : 6198189 time to create 1 rle with new method : 0.6263198852539062 create new chi : 7.895400762557983 time to delete rle : 0.0019271373748779297 batch 1 Loaded 14 chid ids of type : 4855 Number RLEs to save : 22202 TO DO : save crop sub photo not yet done ! save time : 1.2482993602752686 map_output_result : {1349044441: (0.44118541283193263, 'Should be the crop_list due to order', 0.322049456340282), 1349044437: (0.44118541283193263, 'Should be the crop_list due to order', 0.4289663312342077), 1349044433: (0.44118541283193263, 'Should be the crop_list due to order', 0.21126474749724633), 1349044428: (0.44118541283193263, 'Should be the crop_list due to order', 0.4355172898454734), 1349044402: (0.44118541283193263, 'Should be the crop_list due to order', 0.272307139255251), 1349044400: (0.44118541283193263, 'Should be the crop_list due to order', 0.4351001820135912), 1349044398: (0.44118541283193263, 'Should be the crop_list due to order', 0.9830927436374771)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 7 /1349044441.Didn't retrieve data . /1349044437.Didn't retrieve data . /1349044433.Didn't retrieve data . /1349044428.Didn't retrieve data . /1349044402.Didn't retrieve data . /1349044400.Didn't retrieve data . /1349044398.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.014377593994140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 672.8547072410583 time spend to save output : 0.014953374862670898 total time spend for step 5 : 672.869660615921 step6:crop_condition Mon Mar 31 18:38:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 470 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3015255 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439143_381571 we have uploaded 51 photos in the portfolio 3015255 time of upload the photos Elapsed time : 19.195592403411865 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 113 About to insert : list_path_to_insert length 113 new photo from crops ! About to upload 113 photos upload in portfolio : 3015255 init cache_photo without model_param we have 113 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439231_381571 we have uploaded 113 photos in the portfolio 3015255 time of upload the photos Elapsed time : 46.10354542732239 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439289_381571 we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.129169940948486 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3015255 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439312_381571 we have uploaded 15 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.87543511390686 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439321_381571 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6698262691497803 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439327_381571 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.457068681716919 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3015255 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439353_381571 we have uploaded 23 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.647645711898804 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439365_381571 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7621569633483887 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : encombrant begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3015255 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439424_381571 we have uploaded 46 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.96989917755127 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439444_381571 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.306443691253662 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3015255 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439455_381571 we have uploaded 21 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.338044881820679 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743439602_381571 we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.84725022315979 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 344 /1349056296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349056788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349057301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1039 time used for this insertion : 0.5481357574462891 save_final save missing photos in datou_result : time spend for datou_step_exec : 529.5274019241333 time spend to save output : 1.0122854709625244 total time spend for step 6 : 530.5396873950958 step7:ventilate_hashtags_in_portfolio Mon Mar 31 18:46:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21917362 get user id for portfolio 21917362 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21917362 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21917362 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21917362 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21917362 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21919200,21919201,21919202,21919203,21919204,21919209,21919211,21919212,21919213,21919214,21919215,21919216,21919218,21919219,21919220,21919221,21919222,21919223,21919224,21919225?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21917362 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 1 /21917362. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01379084587097168 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.5031838417053223 time spend to save output : 0.014087677001953125 total time spend for step 7 : 2.5172715187072754 step8:final Mon Mar 31 18:46:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1349044441: ('0.3900467084808232',), 1349044437: ('0.3900467084808232',), 1349044433: ('0.3900467084808232',), 1349044428: ('0.3900467084808232',), 1349044402: ('0.3900467084808232',), 1349044400: ('0.3900467084808232',), 1349044398: ('0.3900467084808232',)} new output for save of step final : {1349044441: ('0.3900467084808232',), 1349044437: ('0.3900467084808232',), 1349044433: ('0.3900467084808232',), 1349044428: ('0.3900467084808232',), 1349044402: ('0.3900467084808232',), 1349044400: ('0.3900467084808232',), 1349044398: ('0.3900467084808232',)} [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 7 /1349044441.Didn't retrieve data . /1349044437.Didn't retrieve data . /1349044433.Didn't retrieve data . /1349044428.Didn't retrieve data . /1349044402.Didn't retrieve data . /1349044400.Didn't retrieve data . /1349044398.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013946056365966797 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1088719367980957 time spend to save output : 0.014345645904541016 total time spend for step 8 : 0.12321758270263672 step9:velours_tree Mon Mar 31 18:46:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1036076545715332 time spend to save output : 3.600120544433594e-05 total time spend for step 9 : 0.10364365577697754 step10:send_mail_cod Mon Mar 31 18:46:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21917362_31-03-2025_18_46_59.pdf 21919174 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191741743439619 21919175 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191751743439621 21919176 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191761743439623 21919177 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191771743439625 21919178 change filename to text .imagette219191781743439629 21919179 change filename to text .change filename to text .change filename to text .change filename to text .imagette219191791743439629 21919180 imagette219191801743439630 21919181 imagette219191811743439630 21919182 imagette219191821743439630 21919183 imagette219191831743439630 21919184 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191841743439630 21919185 change filename to text .change filename to text .imagette219191851743439632 21919186 imagette219191861743439632 21919187 imagette219191871743439632 21919188 imagette219191881743439632 21919189 imagette219191891743439632 21919190 imagette219191901743439632 21919191 change filename to text .change filename to text .imagette219191911743439632 21919192 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191921743439632 21919194 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette219191941743439633 21919195 imagette219191951743439636 21919196 imagette219191961743439636 21919197 imagette219191971743439636 21919198 imagette219191981743439636 21919199 imagette219191991743439636 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21917362 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21919200,21919201,21919202,21919203,21919204,21919209,21919211,21919212,21919213,21919214,21919215,21919216,21919218,21919219,21919220,21919221,21919222,21919223,21919224,21919225?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21917362 your option no_mail is active, we will not send the real mail to your client args[1349044441] : ((1349044441, 2131.668913242164, 492609224), (1349044441, -0.33872600000751224, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044437] : ((1349044437, 1471.8244681023398, 2107751945), (1349044437, -0.30398673860193837, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044433] : ((1349044433, 3579.8207992912, 492609224), (1349044433, -0.1319912697196815, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044428] : ((1349044428, 411.1733793574086, 492688767), (1349044428, -0.2346079969108766, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044402] : ((1349044402, 2719.520518365121, 492609224), (1349044402, -0.2244665755170298, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044400] : ((1349044400, 1672.29025140936, 2107751945), (1349044400, -0.15246413586604685, 496442774), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1349044398] : ((1349044398, 207.7517335790882, 492688767), (1349044398, -0.5959035670613504, 501862349), '0.3900467084808232') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.3900467084808232 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21917362_31-03-2025_18_46_59.pdf results_Auto_P21917362_31-03-2025_18_46_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21917362_31-03-2025_18_46_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21917362','results_Auto_P21917362_31-03-2025_18_46_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21917362_31-03-2025_18_46_59.pdf','pdf','','3.46','0.3900467084808232') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.013566732406616211 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.0038800239563 time spend to save output : 0.013981103897094727 total time spend for step 10 : 21.017861127853394 step11:split_time_score Mon Mar 31 18:47:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('29', 1), ('31', 4), ('32', 2)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04032025 21917362 Nombre de photos uploadées : 7 / 23040 (0%) 04032025 21917362 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 04032025 21917362 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.000446319580078125 elapsed_time : insert_dashboard_record_day_entry 0.02432560920715332 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21917357 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21917360 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21917361 order by id desc limit 1 Qualite : 0.3900467084808232 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21917362_31-03-2025_18_46_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21917362 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21917362 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04032025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1349044441, 1349044437, 1349044433, 1349044428, 1349044402, 1349044400, 1349044398] Looping around the photos to save general results len do output : 1 /21917362Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044441', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044437', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044433', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044428', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044402', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044400', None, None, None, None, None, '2709946') ('4741', None, None, None, None, None, None, None, '2709946') ('4741', '21917362', '1349044398', None, None, None, None, None, '2709946') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013801097869873047 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.768280029296875 time spend to save output : 0.013960838317871094 total time spend for step 11 : 2.782240867614746 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 901.78user 488.49system 25:58.14elapsed 89%CPU (0avgtext+0avgdata 9217892maxresident)k 2121720inputs+930696outputs (48745major+74401906minor)pagefaults 0swaps