python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 771234 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2797353'] with mtr_portfolio_ids : ['22713611'] and first list_photo_ids : [] new path : /proc/771234/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.423863649368286 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 6 12:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2638 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 12:41:36.354804: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 12:41:36.383293: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 12:41:36.385648: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7e60000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 12:41:36.385723: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 12:41:36.389803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 12:41:36.565361: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x205d0610 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 12:41:36.565409: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 12:41:36.566420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:41:36.566814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:41:36.578348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:41:36.580642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:41:36.581009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:41:36.588680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:41:36.590636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:41:36.606716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:41:36.608213: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:41:36.608302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:41:36.609015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 12:41:36.609042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 12:41:36.609054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 12:41:36.610212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2186 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 12:41:37.038302: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:41:37.038433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:41:37.038458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:41:37.038484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:41:37.038514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:41:37.038536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:41:37.038555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:41:37.038574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:41:37.039650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:41:37.040920: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:41:37.041010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:41:37.041044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:41:37.041068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:41:37.041104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:41:37.041127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:41:37.041148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:41:37.041170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:41:37.042181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:41:37.042215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 12:41:37.042226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 12:41:37.042236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 12:41:37.043342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2186 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 12:41:50.563370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:41:50.758959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:41:52.343652: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.343736: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.350507: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.350564: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.404600: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.404709: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.447676: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.447742: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.495166: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:41:52.495243: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 97.41250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.13750 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 771434 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 27 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2896 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.6700446605682373 nb_pixel_total : 3266074 time to create 1 rle with new method : 1.0432548522949219 length of segment : 1233 time for calcul the mask position with numpy : 0.5777137279510498 nb_pixel_total : 5160995 time to create 1 rle with new method : 1.4870080947875977 length of segment : 4448 time for calcul the mask position with numpy : 0.12024521827697754 nb_pixel_total : 2738775 time to create 1 rle with new method : 0.5794277191162109 length of segment : 1115 time for calcul the mask position with numpy : 0.5032351016998291 nb_pixel_total : 4048595 time to create 1 rle with new method : 0.7007389068603516 length of segment : 1503 time for calcul the mask position with numpy : 0.5639925003051758 nb_pixel_total : 5258359 time to create 1 rle with new method : 2.1056058406829834 length of segment : 4986 time for calcul the mask position with numpy : 0.015796422958374023 nb_pixel_total : 823278 time to create 1 rle with new method : 0.07932829856872559 length of segment : 1855 time for calcul the mask position with numpy : 0.3574986457824707 nb_pixel_total : 3382618 time to create 1 rle with new method : 0.8179712295532227 length of segment : 1187 time for calcul the mask position with numpy : 0.41435909271240234 nb_pixel_total : 2882577 time to create 1 rle with new method : 0.5486106872558594 length of segment : 4351 time for calcul the mask position with numpy : 0.1746206283569336 nb_pixel_total : 2999826 time to create 1 rle with new method : 0.6750650405883789 length of segment : 1554 time for calcul the mask position with numpy : 0.010822534561157227 nb_pixel_total : 289739 time to create 1 rle with new method : 0.030672311782836914 length of segment : 682 time for calcul the mask position with numpy : 0.00796365737915039 nb_pixel_total : 29679 time to create 1 rle with old method : 0.03379034996032715 length of segment : 348 time for calcul the mask position with numpy : 0.13793516159057617 nb_pixel_total : 3303183 time to create 1 rle with new method : 0.4142129421234131 length of segment : 1286 time for calcul the mask position with numpy : 0.1394340991973877 nb_pixel_total : 2777535 time to create 1 rle with new method : 0.21804451942443848 length of segment : 1840 time for calcul the mask position with numpy : 0.0031745433807373047 nb_pixel_total : 107306 time to create 1 rle with old method : 0.14208054542541504 length of segment : 407 time for calcul the mask position with numpy : 0.024550437927246094 nb_pixel_total : 849568 time to create 1 rle with new method : 0.06294059753417969 length of segment : 866 time for calcul the mask position with numpy : 0.002363443374633789 nb_pixel_total : 70854 time to create 1 rle with old method : 0.07989692687988281 length of segment : 577 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 11911 time to create 1 rle with old method : 0.014148473739624023 length of segment : 122 time for calcul the mask position with numpy : 0.0009417533874511719 nb_pixel_total : 23815 time to create 1 rle with old method : 0.027718544006347656 length of segment : 156 time for calcul the mask position with numpy : 0.0007939338684082031 nb_pixel_total : 17903 time to create 1 rle with old method : 0.021503210067749023 length of segment : 124 time for calcul the mask position with numpy : 0.001413106918334961 nb_pixel_total : 51961 time to create 1 rle with old method : 0.059088945388793945 length of segment : 278 time for calcul the mask position with numpy : 0.0007734298706054688 nb_pixel_total : 6036 time to create 1 rle with old method : 0.007439851760864258 length of segment : 152 time for calcul the mask position with numpy : 0.0023193359375 nb_pixel_total : 84771 time to create 1 rle with old method : 0.1027369499206543 length of segment : 113 time for calcul the mask position with numpy : 0.004395246505737305 nb_pixel_total : 125376 time to create 1 rle with old method : 0.14027810096740723 length of segment : 391 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 7748 time to create 1 rle with old method : 0.00980520248413086 length of segment : 247 time for calcul the mask position with numpy : 0.00860285758972168 nb_pixel_total : 276782 time to create 1 rle with new method : 0.018053770065307617 length of segment : 1374 time for calcul the mask position with numpy : 0.0008122920989990234 nb_pixel_total : 19800 time to create 1 rle with old method : 0.022200345993041992 length of segment : 183 time for calcul the mask position with numpy : 0.0007474422454833984 nb_pixel_total : 23144 time to create 1 rle with old method : 0.026473522186279297 length of segment : 180 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 12610 time to create 1 rle with old method : 0.014919042587280273 length of segment : 121 time for calcul the mask position with numpy : 0.004366397857666016 nb_pixel_total : 152817 time to create 1 rle with new method : 0.006399393081665039 length of segment : 358 time for calcul the mask position with numpy : 0.0012981891632080078 nb_pixel_total : 51201 time to create 1 rle with old method : 0.05882000923156738 length of segment : 151 time for calcul the mask position with numpy : 0.0006697177886962891 nb_pixel_total : 18619 time to create 1 rle with old method : 0.02168750762939453 length of segment : 167 time for calcul the mask position with numpy : 0.0036983489990234375 nb_pixel_total : 186967 time to create 1 rle with new method : 0.0058138370513916016 length of segment : 362 time for calcul the mask position with numpy : 0.0019412040710449219 nb_pixel_total : 54133 time to create 1 rle with old method : 0.06239819526672363 length of segment : 599 time for calcul the mask position with numpy : 0.0007264614105224609 nb_pixel_total : 24872 time to create 1 rle with old method : 0.02903890609741211 length of segment : 177 time for calcul the mask position with numpy : 0.001039266586303711 nb_pixel_total : 40176 time to create 1 rle with old method : 0.0456850528717041 length of segment : 251 time for calcul the mask position with numpy : 0.0024309158325195312 nb_pixel_total : 66188 time to create 1 rle with old method : 0.08408355712890625 length of segment : 399 time for calcul the mask position with numpy : 0.0011072158813476562 nb_pixel_total : 30906 time to create 1 rle with old method : 0.0354306697845459 length of segment : 270 time for calcul the mask position with numpy : 0.0005552768707275391 nb_pixel_total : 16944 time to create 1 rle with old method : 0.019414663314819336 length of segment : 130 time for calcul the mask position with numpy : 0.0010335445404052734 nb_pixel_total : 40649 time to create 1 rle with old method : 0.0449674129486084 length of segment : 236 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 10933 time to create 1 rle with old method : 0.012230873107910156 length of segment : 147 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 12616 time to create 1 rle with old method : 0.014517545700073242 length of segment : 174 time for calcul the mask position with numpy : 0.0007474422454833984 nb_pixel_total : 32037 time to create 1 rle with old method : 0.03551006317138672 length of segment : 229 time for calcul the mask position with numpy : 0.00579833984375 nb_pixel_total : 194795 time to create 1 rle with new method : 0.011175870895385742 length of segment : 978 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 34654 time to create 1 rle with old method : 0.038788795471191406 length of segment : 232 time for calcul the mask position with numpy : 0.0014138221740722656 nb_pixel_total : 52056 time to create 1 rle with old method : 0.058174848556518555 length of segment : 290 time for calcul the mask position with numpy : 0.012213706970214844 nb_pixel_total : 388578 time to create 1 rle with new method : 0.01882481575012207 length of segment : 553 time for calcul the mask position with numpy : 0.0034673213958740234 nb_pixel_total : 118340 time to create 1 rle with old method : 0.13261032104492188 length of segment : 449 time for calcul the mask position with numpy : 0.0017578601837158203 nb_pixel_total : 57662 time to create 1 rle with old method : 0.06578898429870605 length of segment : 222 time for calcul the mask position with numpy : 0.010529279708862305 nb_pixel_total : 367942 time to create 1 rle with new method : 0.016213655471801758 length of segment : 508 time for calcul the mask position with numpy : 0.0178377628326416 nb_pixel_total : 749836 time to create 1 rle with new method : 0.023981332778930664 length of segment : 969 time for calcul the mask position with numpy : 0.0020427703857421875 nb_pixel_total : 61842 time to create 1 rle with old method : 0.07200074195861816 length of segment : 309 time for calcul the mask position with numpy : 0.0014061927795410156 nb_pixel_total : 37936 time to create 1 rle with old method : 0.04191780090332031 length of segment : 360 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 9910 time to create 1 rle with old method : 0.016521930694580078 length of segment : 150 length of segment : 0 time for calcul the mask position with numpy : 0.00017833709716796875 nb_pixel_total : 1552 time to create 1 rle with old method : 0.0027303695678710938 length of segment : 39 time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 16410 time to create 1 rle with old method : 0.021395444869995117 length of segment : 149 time for calcul the mask position with numpy : 0.0007574558258056641 nb_pixel_total : 15711 time to create 1 rle with old method : 0.01797628402709961 length of segment : 231 time for calcul the mask position with numpy : 0.005348682403564453 nb_pixel_total : 266758 time to create 1 rle with new method : 0.013804912567138672 length of segment : 1165 time for calcul the mask position with numpy : 0.0035390853881835938 nb_pixel_total : 121090 time to create 1 rle with old method : 0.1352231502532959 length of segment : 513 time for calcul the mask position with numpy : 0.002331972122192383 nb_pixel_total : 61840 time to create 1 rle with old method : 0.06910967826843262 length of segment : 310 length of segment : 0 time for calcul the mask position with numpy : 0.0010006427764892578 nb_pixel_total : 29181 time to create 1 rle with old method : 0.032514333724975586 length of segment : 183 time for calcul the mask position with numpy : 0.0011665821075439453 nb_pixel_total : 24694 time to create 1 rle with old method : 0.027529001235961914 length of segment : 255 length of segment : 0 time for calcul the mask position with numpy : 0.00052642822265625 nb_pixel_total : 13923 time to create 1 rle with old method : 0.01629328727722168 length of segment : 233 time for calcul the mask position with numpy : 0.010944604873657227 nb_pixel_total : 418062 time to create 1 rle with new method : 0.01719069480895996 length of segment : 744 time for calcul the mask position with numpy : 0.010958433151245117 nb_pixel_total : 365831 time to create 1 rle with new method : 0.018046855926513672 length of segment : 653 time for calcul the mask position with numpy : 0.00568699836730957 nb_pixel_total : 141542 time to create 1 rle with old method : 0.16522979736328125 length of segment : 345 time for calcul the mask position with numpy : 0.0011210441589355469 nb_pixel_total : 27008 time to create 1 rle with old method : 0.0306854248046875 length of segment : 236 time for calcul the mask position with numpy : 0.0011687278747558594 nb_pixel_total : 29582 time to create 1 rle with old method : 0.03445744514465332 length of segment : 208 time for calcul the mask position with numpy : 0.0008068084716796875 nb_pixel_total : 14269 time to create 1 rle with old method : 0.016530752182006836 length of segment : 237 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 27575 time to create 1 rle with old method : 0.03173351287841797 length of segment : 280 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 16792 time to create 1 rle with old method : 0.019449234008789062 length of segment : 224 time for calcul the mask position with numpy : 0.0017743110656738281 nb_pixel_total : 49616 time to create 1 rle with old method : 0.05657815933227539 length of segment : 251 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 22516 time to create 1 rle with old method : 0.026256561279296875 length of segment : 128 time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 16947 time to create 1 rle with old method : 0.019873380661010742 length of segment : 168 time for calcul the mask position with numpy : 0.0013670921325683594 nb_pixel_total : 18706 time to create 1 rle with old method : 0.02213883399963379 length of segment : 169 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 14733 time to create 1 rle with old method : 0.01682114601135254 length of segment : 255 time for calcul the mask position with numpy : 0.0013763904571533203 nb_pixel_total : 50819 time to create 1 rle with old method : 0.05796527862548828 length of segment : 279 time for calcul the mask position with numpy : 0.0007240772247314453 nb_pixel_total : 23337 time to create 1 rle with old method : 0.02688741683959961 length of segment : 229 time for calcul the mask position with numpy : 0.0022373199462890625 nb_pixel_total : 60080 time to create 1 rle with old method : 0.06908917427062988 length of segment : 291 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 46747 time to create 1 rle with old method : 0.05361294746398926 length of segment : 248 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 24082 time to create 1 rle with old method : 0.0293118953704834 length of segment : 129 time for calcul the mask position with numpy : 0.0040590763092041016 nb_pixel_total : 154980 time to create 1 rle with new method : 0.006865978240966797 length of segment : 399 time for calcul the mask position with numpy : 0.00911712646484375 nb_pixel_total : 352846 time to create 1 rle with new method : 0.01855778694152832 length of segment : 721 time for calcul the mask position with numpy : 0.002193450927734375 nb_pixel_total : 75196 time to create 1 rle with old method : 0.08452033996582031 length of segment : 375 time for calcul the mask position with numpy : 0.013172149658203125 nb_pixel_total : 491717 time to create 1 rle with new method : 0.0257260799407959 length of segment : 670 time for calcul the mask position with numpy : 0.0021016597747802734 nb_pixel_total : 57788 time to create 1 rle with old method : 0.07736635208129883 length of segment : 264 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 27250 time to create 1 rle with old method : 0.03398633003234863 length of segment : 191 time for calcul the mask position with numpy : 0.0005266666412353516 nb_pixel_total : 15051 time to create 1 rle with old method : 0.01717996597290039 length of segment : 167 time for calcul the mask position with numpy : 0.0014941692352294922 nb_pixel_total : 58664 time to create 1 rle with old method : 0.06556534767150879 length of segment : 264 time for calcul the mask position with numpy : 0.0008413791656494141 nb_pixel_total : 22126 time to create 1 rle with old method : 0.025218963623046875 length of segment : 186 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 11092 time to create 1 rle with old method : 0.012883186340332031 length of segment : 107 time for calcul the mask position with numpy : 0.0003364086151123047 nb_pixel_total : 14429 time to create 1 rle with old method : 0.016272783279418945 length of segment : 152 time for calcul the mask position with numpy : 0.0007979869842529297 nb_pixel_total : 27082 time to create 1 rle with old method : 0.030623197555541992 length of segment : 178 time for calcul the mask position with numpy : 0.6963169574737549 nb_pixel_total : 5269464 time to create 1 rle with new method : 1.0100433826446533 length of segment : 5232 time for calcul the mask position with numpy : 0.1773829460144043 nb_pixel_total : 3671711 time to create 1 rle with new method : 0.4555652141571045 length of segment : 1730 time for calcul the mask position with numpy : 0.00986480712890625 nb_pixel_total : 399753 time to create 1 rle with new method : 0.02659296989440918 length of segment : 884 time for calcul the mask position with numpy : 0.21732664108276367 nb_pixel_total : 3490755 time to create 1 rle with new method : 0.8572158813476562 length of segment : 2690 time spent for convertir_results : 43.43389534950256 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 99 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 152.25048160552979 time spend to save output : 0.12160181999206543 total time spend for step 1 : 152.37208342552185 step2:mask_detect Tue May 6 12:44:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2500 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 12:44:07.149329: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 12:44:07.199157: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 12:44:07.201513: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7e50000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 12:44:07.201562: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 12:44:07.209102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 12:44:07.500025: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1f5cf270 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 12:44:07.500070: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 12:44:07.500783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:44:07.501887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:44:07.505923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:44:07.509433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:44:07.511051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:44:07.515562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:44:07.517586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:44:07.524985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:44:07.526193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:44:07.526273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:44:07.527025: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 12:44:07.527047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 12:44:07.527070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 12:44:07.528192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2048 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 12:44:07.676008: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:44:07.676155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:44:07.676194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:44:07.676233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:44:07.676267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:44:07.676301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:44:07.676334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:44:07.676367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:44:07.677546: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:44:07.679057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 12:44:07.679104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 12:44:07.679125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:44:07.679145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 12:44:07.679165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 12:44:07.679184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 12:44:07.679204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 12:44:07.679224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:44:07.680193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 12:44:07.680224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 12:44:07.680235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 12:44:07.680244: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 12:44:07.681267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2048 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 12:44:27.841648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 12:44:28.327948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 12:44:31.318074: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.319123: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.326094: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.326165: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.386587: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.386633: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.429462: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.429501: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.482724: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.482790: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 12:44:31.484721: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 97.41250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 72 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.13750 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 777095 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 301 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3831 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 1.5056705474853516 nb_pixel_total : 5060347 time to create 1 rle with new method : 1.412076711654663 length of segment : 4649 time for calcul the mask position with numpy : 0.019209623336791992 nb_pixel_total : 1117193 time to create 1 rle with new method : 0.0609433650970459 length of segment : 971 time for calcul the mask position with numpy : 0.0517120361328125 nb_pixel_total : 1110009 time to create 1 rle with new method : 0.3162221908569336 length of segment : 1633 time for calcul the mask position with numpy : 0.007885932922363281 nb_pixel_total : 455377 time to create 1 rle with new method : 0.016857624053955078 length of segment : 694 time for calcul the mask position with numpy : 0.010652542114257812 nb_pixel_total : 472438 time to create 1 rle with new method : 0.010789871215820312 length of segment : 371 time for calcul the mask position with numpy : 0.01652359962463379 nb_pixel_total : 33865 time to create 1 rle with old method : 0.03913283348083496 length of segment : 204 time for calcul the mask position with numpy : 0.002712726593017578 nb_pixel_total : 27038 time to create 1 rle with old method : 0.030896663665771484 length of segment : 250 time for calcul the mask position with numpy : 0.0013535022735595703 nb_pixel_total : 85377 time to create 1 rle with old method : 0.0979607105255127 length of segment : 355 time for calcul the mask position with numpy : 0.0022268295288085938 nb_pixel_total : 114929 time to create 1 rle with old method : 0.13159942626953125 length of segment : 375 time for calcul the mask position with numpy : 0.0043201446533203125 nb_pixel_total : 190651 time to create 1 rle with new method : 0.012873649597167969 length of segment : 970 time for calcul the mask position with numpy : 1.09653639793396 nb_pixel_total : 5396387 time to create 1 rle with new method : 1.2352027893066406 length of segment : 5028 time for calcul the mask position with numpy : 0.007213592529296875 nb_pixel_total : 342736 time to create 1 rle with new method : 0.012109518051147461 length of segment : 580 time for calcul the mask position with numpy : 0.008862733840942383 nb_pixel_total : 699934 time to create 1 rle with new method : 0.015043973922729492 length of segment : 800 time for calcul the mask position with numpy : 0.010536432266235352 nb_pixel_total : 169922 time to create 1 rle with new method : 0.00410914421081543 length of segment : 137 time for calcul the mask position with numpy : 1.3403961658477783 nb_pixel_total : 4972448 time to create 1 rle with new method : 1.694258451461792 length of segment : 4772 time for calcul the mask position with numpy : 0.006703376770019531 nb_pixel_total : 28372 time to create 1 rle with old method : 0.03553342819213867 length of segment : 119 time for calcul the mask position with numpy : 0.0037534236907958984 nb_pixel_total : 48044 time to create 1 rle with old method : 0.057951927185058594 length of segment : 188 time for calcul the mask position with numpy : 0.002130746841430664 nb_pixel_total : 33191 time to create 1 rle with old method : 0.03871655464172363 length of segment : 148 time for calcul the mask position with numpy : 0.008928537368774414 nb_pixel_total : 652987 time to create 1 rle with new method : 0.015591621398925781 length of segment : 758 time for calcul the mask position with numpy : 0.0367283821105957 nb_pixel_total : 674065 time to create 1 rle with new method : 0.017483949661254883 length of segment : 760 time for calcul the mask position with numpy : 0.011542797088623047 nb_pixel_total : 293002 time to create 1 rle with new method : 0.013036966323852539 length of segment : 427 time for calcul the mask position with numpy : 0.02036428451538086 nb_pixel_total : 1219060 time to create 1 rle with new method : 0.4265275001525879 length of segment : 1408 time for calcul the mask position with numpy : 0.6319117546081543 nb_pixel_total : 840974 time to create 1 rle with new method : 1.4993739128112793 length of segment : 3351 time for calcul the mask position with numpy : 0.013427734375 nb_pixel_total : 673982 time to create 1 rle with new method : 0.08028721809387207 length of segment : 1210 time for calcul the mask position with numpy : 0.47519779205322266 nb_pixel_total : 4727543 time to create 1 rle with new method : 0.6001882553100586 length of segment : 1826 time for calcul the mask position with numpy : 0.37851834297180176 nb_pixel_total : 3152262 time to create 1 rle with new method : 0.3329894542694092 length of segment : 1469 time for calcul the mask position with numpy : 0.0034332275390625 nb_pixel_total : 278436 time to create 1 rle with new method : 0.0074956417083740234 length of segment : 422 time for calcul the mask position with numpy : 0.0029268264770507812 nb_pixel_total : 220840 time to create 1 rle with new method : 0.0075185298919677734 length of segment : 940 time for calcul the mask position with numpy : 0.4679830074310303 nb_pixel_total : 210561 time to create 1 rle with new method : 0.01426386833190918 length of segment : 1178 time for calcul the mask position with numpy : 0.1808784008026123 nb_pixel_total : 55513 time to create 1 rle with old method : 0.06253600120544434 length of segment : 314 time for calcul the mask position with numpy : 0.812354564666748 nb_pixel_total : 353898 time to create 1 rle with new method : 0.02519392967224121 length of segment : 802 time for calcul the mask position with numpy : 0.06230044364929199 nb_pixel_total : 31541 time to create 1 rle with old method : 0.06346249580383301 length of segment : 147 time for calcul the mask position with numpy : 0.14337849617004395 nb_pixel_total : 38011 time to create 1 rle with old method : 0.051728010177612305 length of segment : 271 time for calcul the mask position with numpy : 0.13672399520874023 nb_pixel_total : 37414 time to create 1 rle with old method : 0.07127165794372559 length of segment : 223 time for calcul the mask position with numpy : 0.011626005172729492 nb_pixel_total : 120885 time to create 1 rle with old method : 0.1575472354888916 length of segment : 538 time for calcul the mask position with numpy : 0.5043716430664062 nb_pixel_total : 202494 time to create 1 rle with new method : 0.01840376853942871 length of segment : 518 time for calcul the mask position with numpy : 0.14085674285888672 nb_pixel_total : 41661 time to create 1 rle with old method : 0.04786062240600586 length of segment : 223 time for calcul the mask position with numpy : 0.07711362838745117 nb_pixel_total : 25386 time to create 1 rle with old method : 0.03408312797546387 length of segment : 160 time for calcul the mask position with numpy : 0.1183168888092041 nb_pixel_total : 32595 time to create 1 rle with old method : 0.043599605560302734 length of segment : 280 time for calcul the mask position with numpy : 0.5057005882263184 nb_pixel_total : 379850 time to create 1 rle with new method : 0.015801668167114258 length of segment : 591 time for calcul the mask position with numpy : 0.1622605323791504 nb_pixel_total : 85541 time to create 1 rle with old method : 0.15259337425231934 length of segment : 266 time for calcul the mask position with numpy : 0.19584941864013672 nb_pixel_total : 123260 time to create 1 rle with old method : 0.1466977596282959 length of segment : 415 time for calcul the mask position with numpy : 0.10864543914794922 nb_pixel_total : 25884 time to create 1 rle with old method : 0.04316258430480957 length of segment : 185 time for calcul the mask position with numpy : 0.022726058959960938 nb_pixel_total : 103694 time to create 1 rle with old method : 0.14318394660949707 length of segment : 522 time for calcul the mask position with numpy : 0.7104897499084473 nb_pixel_total : 547470 time to create 1 rle with new method : 0.03526186943054199 length of segment : 918 time for calcul the mask position with numpy : 0.29262304306030273 nb_pixel_total : 237015 time to create 1 rle with new method : 0.017510175704956055 length of segment : 435 time for calcul the mask position with numpy : 0.11497735977172852 nb_pixel_total : 94957 time to create 1 rle with old method : 0.1632838249206543 length of segment : 429 time for calcul the mask position with numpy : 0.03287243843078613 nb_pixel_total : 14325 time to create 1 rle with old method : 0.018542051315307617 length of segment : 84 time for calcul the mask position with numpy : 0.09981322288513184 nb_pixel_total : 64079 time to create 1 rle with old method : 0.099365234375 length of segment : 229 time for calcul the mask position with numpy : 0.2559378147125244 nb_pixel_total : 244720 time to create 1 rle with new method : 0.018590450286865234 length of segment : 558 time for calcul the mask position with numpy : 0.0008840560913085938 nb_pixel_total : 35251 time to create 1 rle with old method : 0.040831565856933594 length of segment : 196 time for calcul the mask position with numpy : 0.03710293769836426 nb_pixel_total : 18147 time to create 1 rle with old method : 0.027302265167236328 length of segment : 201 time for calcul the mask position with numpy : 0.10954618453979492 nb_pixel_total : 24733 time to create 1 rle with old method : 0.050978899002075195 length of segment : 157 time for calcul the mask position with numpy : 0.15047311782836914 nb_pixel_total : 153264 time to create 1 rle with new method : 0.009555339813232422 length of segment : 486 time for calcul the mask position with numpy : 0.14135122299194336 nb_pixel_total : 153207 time to create 1 rle with new method : 0.028920888900756836 length of segment : 490 time for calcul the mask position with numpy : 0.5724306106567383 nb_pixel_total : 415872 time to create 1 rle with new method : 0.026971817016601562 length of segment : 641 time for calcul the mask position with numpy : 0.02408313751220703 nb_pixel_total : 89177 time to create 1 rle with old method : 0.14919400215148926 length of segment : 286 time for calcul the mask position with numpy : 0.08755087852478027 nb_pixel_total : 121029 time to create 1 rle with old method : 0.1969432830810547 length of segment : 464 time for calcul the mask position with numpy : 0.0330042839050293 nb_pixel_total : 60856 time to create 1 rle with old method : 0.07332086563110352 length of segment : 277 time for calcul the mask position with numpy : 0.0010216236114501953 nb_pixel_total : 45673 time to create 1 rle with old method : 0.05372452735900879 length of segment : 213 time for calcul the mask position with numpy : 0.03443431854248047 nb_pixel_total : 20543 time to create 1 rle with old method : 0.025451183319091797 length of segment : 159 time for calcul the mask position with numpy : 0.11339259147644043 nb_pixel_total : 148082 time to create 1 rle with old method : 0.17343497276306152 length of segment : 436 time for calcul the mask position with numpy : 0.04661154747009277 nb_pixel_total : 197364 time to create 1 rle with new method : 0.03554940223693848 length of segment : 711 time for calcul the mask position with numpy : 0.015777111053466797 nb_pixel_total : 63318 time to create 1 rle with old method : 0.11239242553710938 length of segment : 258 time for calcul the mask position with numpy : 0.020524263381958008 nb_pixel_total : 45691 time to create 1 rle with old method : 0.05131196975708008 length of segment : 165 time for calcul the mask position with numpy : 0.003909111022949219 nb_pixel_total : 153674 time to create 1 rle with new method : 0.012369155883789062 length of segment : 509 time for calcul the mask position with numpy : 0.0013451576232910156 nb_pixel_total : 60268 time to create 1 rle with old method : 0.08335661888122559 length of segment : 268 time for calcul the mask position with numpy : 0.10933685302734375 nb_pixel_total : 353601 time to create 1 rle with new method : 0.01753067970275879 length of segment : 704 time for calcul the mask position with numpy : 0.0222318172454834 nb_pixel_total : 148909 time to create 1 rle with old method : 0.17210817337036133 length of segment : 334 time for calcul the mask position with numpy : 0.201829195022583 nb_pixel_total : 514627 time to create 1 rle with new method : 0.10866451263427734 length of segment : 1464 time for calcul the mask position with numpy : 0.01103973388671875 nb_pixel_total : 121198 time to create 1 rle with old method : 0.15038204193115234 length of segment : 475 time for calcul the mask position with numpy : 0.05556368827819824 nb_pixel_total : 181491 time to create 1 rle with new method : 0.011044979095458984 length of segment : 640 time for calcul the mask position with numpy : 0.0015807151794433594 nb_pixel_total : 61689 time to create 1 rle with old method : 0.07378482818603516 length of segment : 249 time for calcul the mask position with numpy : 0.0013530254364013672 nb_pixel_total : 66068 time to create 1 rle with old method : 0.07639956474304199 length of segment : 286 time for calcul the mask position with numpy : 0.010161876678466797 nb_pixel_total : 81135 time to create 1 rle with old method : 0.12732672691345215 length of segment : 246 time for calcul the mask position with numpy : 0.42559218406677246 nb_pixel_total : 594190 time to create 1 rle with new method : 0.029621124267578125 length of segment : 1023 time for calcul the mask position with numpy : 0.022097349166870117 nb_pixel_total : 67744 time to create 1 rle with old method : 0.08501720428466797 length of segment : 288 time for calcul the mask position with numpy : 0.02028203010559082 nb_pixel_total : 74241 time to create 1 rle with old method : 0.12421035766601562 length of segment : 338 time for calcul the mask position with numpy : 0.0027701854705810547 nb_pixel_total : 99482 time to create 1 rle with old method : 0.11438775062561035 length of segment : 671 time for calcul the mask position with numpy : 0.08306765556335449 nb_pixel_total : 125347 time to create 1 rle with old method : 0.18016552925109863 length of segment : 719 time for calcul the mask position with numpy : 0.011285066604614258 nb_pixel_total : 171981 time to create 1 rle with new method : 0.009517192840576172 length of segment : 372 time for calcul the mask position with numpy : 0.002074003219604492 nb_pixel_total : 82793 time to create 1 rle with old method : 0.09371757507324219 length of segment : 570 time for calcul the mask position with numpy : 0.0031800270080566406 nb_pixel_total : 43143 time to create 1 rle with old method : 0.04932260513305664 length of segment : 216 time for calcul the mask position with numpy : 0.0035097599029541016 nb_pixel_total : 117869 time to create 1 rle with old method : 0.13474583625793457 length of segment : 515 time for calcul the mask position with numpy : 0.38535356521606445 nb_pixel_total : 798720 time to create 1 rle with new method : 0.09541106224060059 length of segment : 1814 time for calcul the mask position with numpy : 0.3319735527038574 nb_pixel_total : 121236 time to create 1 rle with old method : 0.15769100189208984 length of segment : 430 time for calcul the mask position with numpy : 0.1229398250579834 nb_pixel_total : 27559 time to create 1 rle with old method : 0.036031246185302734 length of segment : 209 time for calcul the mask position with numpy : 0.12610244750976562 nb_pixel_total : 68588 time to create 1 rle with old method : 0.08303165435791016 length of segment : 283 time for calcul the mask position with numpy : 0.37366652488708496 nb_pixel_total : 226672 time to create 1 rle with new method : 0.010707616806030273 length of segment : 362 time for calcul the mask position with numpy : 0.4847848415374756 nb_pixel_total : 169568 time to create 1 rle with new method : 0.011302471160888672 length of segment : 625 time for calcul the mask position with numpy : 0.6010951995849609 nb_pixel_total : 166610 time to create 1 rle with new method : 0.01192331314086914 length of segment : 537 time for calcul the mask position with numpy : 0.18265366554260254 nb_pixel_total : 41170 time to create 1 rle with old method : 0.056195735931396484 length of segment : 301 time for calcul the mask position with numpy : 0.5636765956878662 nb_pixel_total : 237903 time to create 1 rle with new method : 0.015667438507080078 length of segment : 361 time for calcul the mask position with numpy : 0.7637608051300049 nb_pixel_total : 206287 time to create 1 rle with new method : 0.015222549438476562 length of segment : 503 time for calcul the mask position with numpy : 0.20636439323425293 nb_pixel_total : 71892 time to create 1 rle with old method : 0.08690428733825684 length of segment : 264 time for calcul the mask position with numpy : 0.5102975368499756 nb_pixel_total : 183864 time to create 1 rle with new method : 0.01157379150390625 length of segment : 696 time for calcul the mask position with numpy : 0.07775378227233887 nb_pixel_total : 16370 time to create 1 rle with old method : 0.023656845092773438 length of segment : 133 time for calcul the mask position with numpy : 1.7294032573699951 nb_pixel_total : 449588 time to create 1 rle with new method : 0.07627582550048828 length of segment : 1136 time for calcul the mask position with numpy : 0.34168291091918945 nb_pixel_total : 116837 time to create 1 rle with old method : 0.14859533309936523 length of segment : 334 time for calcul the mask position with numpy : 0.07060647010803223 nb_pixel_total : 42279 time to create 1 rle with old method : 0.04796481132507324 length of segment : 284 time for calcul the mask position with numpy : 0.0640106201171875 nb_pixel_total : 32488 time to create 1 rle with old method : 0.04260826110839844 length of segment : 163 time for calcul the mask position with numpy : 0.8793590068817139 nb_pixel_total : 210435 time to create 1 rle with new method : 0.031362295150756836 length of segment : 949 time for calcul the mask position with numpy : 0.6255927085876465 nb_pixel_total : 519081 time to create 1 rle with new method : 0.025246620178222656 length of segment : 674 time for calcul the mask position with numpy : 0.028117656707763672 nb_pixel_total : 34406 time to create 1 rle with old method : 0.04551124572753906 length of segment : 299 time for calcul the mask position with numpy : 0.3644065856933594 nb_pixel_total : 401249 time to create 1 rle with new method : 0.031513214111328125 length of segment : 576 time for calcul the mask position with numpy : 0.15132546424865723 nb_pixel_total : 97712 time to create 1 rle with old method : 0.1268172264099121 length of segment : 326 time for calcul the mask position with numpy : 0.2227320671081543 nb_pixel_total : 30916 time to create 1 rle with old method : 0.09231209754943848 length of segment : 408 time for calcul the mask position with numpy : 0.20589494705200195 nb_pixel_total : 63715 time to create 1 rle with old method : 0.07498955726623535 length of segment : 460 time for calcul the mask position with numpy : 0.15328359603881836 nb_pixel_total : 51346 time to create 1 rle with old method : 0.12249922752380371 length of segment : 284 time for calcul the mask position with numpy : 0.19899868965148926 nb_pixel_total : 129864 time to create 1 rle with old method : 0.1473078727722168 length of segment : 483 time for calcul the mask position with numpy : 0.03577232360839844 nb_pixel_total : 51935 time to create 1 rle with old method : 0.06420445442199707 length of segment : 301 time for calcul the mask position with numpy : 0.08505654335021973 nb_pixel_total : 33678 time to create 1 rle with old method : 0.058583974838256836 length of segment : 244 time for calcul the mask position with numpy : 0.07430505752563477 nb_pixel_total : 36131 time to create 1 rle with old method : 0.045030832290649414 length of segment : 287 time for calcul the mask position with numpy : 0.7855699062347412 nb_pixel_total : 312960 time to create 1 rle with new method : 0.022326231002807617 length of segment : 744 time for calcul the mask position with numpy : 0.0025186538696289062 nb_pixel_total : 4436 time to create 1 rle with old method : 0.005300283432006836 length of segment : 129 time for calcul the mask position with numpy : 0.05628561973571777 nb_pixel_total : 40309 time to create 1 rle with old method : 0.05028581619262695 length of segment : 234 time for calcul the mask position with numpy : 0.2378230094909668 nb_pixel_total : 79689 time to create 1 rle with old method : 0.09287333488464355 length of segment : 390 time for calcul the mask position with numpy : 0.0027472972869873047 nb_pixel_total : 122466 time to create 1 rle with old method : 0.13826465606689453 length of segment : 469 time for calcul the mask position with numpy : 0.13257741928100586 nb_pixel_total : 210419 time to create 1 rle with new method : 0.015948057174682617 length of segment : 816 time for calcul the mask position with numpy : 0.07465457916259766 nb_pixel_total : 34808 time to create 1 rle with old method : 0.045001983642578125 length of segment : 220 time for calcul the mask position with numpy : 0.0008175373077392578 nb_pixel_total : 9465 time to create 1 rle with old method : 0.012614250183105469 length of segment : 168 time for calcul the mask position with numpy : 0.43526411056518555 nb_pixel_total : 265286 time to create 1 rle with new method : 0.0243527889251709 length of segment : 638 time for calcul the mask position with numpy : 0.056801557540893555 nb_pixel_total : 71055 time to create 1 rle with old method : 0.09707903861999512 length of segment : 367 time for calcul the mask position with numpy : 0.17618227005004883 nb_pixel_total : 50443 time to create 1 rle with old method : 0.0848245620727539 length of segment : 243 time for calcul the mask position with numpy : 0.41919898986816406 nb_pixel_total : 310467 time to create 1 rle with new method : 0.018232345581054688 length of segment : 676 time for calcul the mask position with numpy : 0.3155395984649658 nb_pixel_total : 261746 time to create 1 rle with new method : 0.01758599281311035 length of segment : 462 time for calcul the mask position with numpy : 0.16489768028259277 nb_pixel_total : 91689 time to create 1 rle with old method : 0.10732889175415039 length of segment : 308 time for calcul the mask position with numpy : 0.10725951194763184 nb_pixel_total : 197857 time to create 1 rle with new method : 0.012391090393066406 length of segment : 647 time for calcul the mask position with numpy : 0.4138448238372803 nb_pixel_total : 516214 time to create 1 rle with new method : 0.03497624397277832 length of segment : 971 time for calcul the mask position with numpy : 0.0008018016815185547 nb_pixel_total : 27804 time to create 1 rle with old method : 0.03277468681335449 length of segment : 150 time for calcul the mask position with numpy : 0.025861263275146484 nb_pixel_total : 100243 time to create 1 rle with old method : 0.11678218841552734 length of segment : 432 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 28135 time to create 1 rle with old method : 0.03219485282897949 length of segment : 231 time for calcul the mask position with numpy : 0.00135040283203125 nb_pixel_total : 37352 time to create 1 rle with old method : 0.05759787559509277 length of segment : 257 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 50057 time to create 1 rle with old method : 0.07630753517150879 length of segment : 299 time for calcul the mask position with numpy : 0.004691362380981445 nb_pixel_total : 105084 time to create 1 rle with old method : 0.1195981502532959 length of segment : 418 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 10462 time to create 1 rle with old method : 0.012239933013916016 length of segment : 113 time for calcul the mask position with numpy : 0.21418190002441406 nb_pixel_total : 141448 time to create 1 rle with old method : 0.1623995304107666 length of segment : 935 time for calcul the mask position with numpy : 0.11294817924499512 nb_pixel_total : 278172 time to create 1 rle with new method : 0.02947545051574707 length of segment : 1317 time for calcul the mask position with numpy : 0.013491153717041016 nb_pixel_total : 142361 time to create 1 rle with old method : 0.17374968528747559 length of segment : 386 time for calcul the mask position with numpy : 0.011949777603149414 nb_pixel_total : 65764 time to create 1 rle with old method : 0.08161735534667969 length of segment : 208 time for calcul the mask position with numpy : 0.007452726364135742 nb_pixel_total : 35536 time to create 1 rle with old method : 0.06777834892272949 length of segment : 137 time for calcul the mask position with numpy : 0.05575680732727051 nb_pixel_total : 27577 time to create 1 rle with old method : 0.03533053398132324 length of segment : 255 time for calcul the mask position with numpy : 0.0009312629699707031 nb_pixel_total : 38451 time to create 1 rle with old method : 0.04551362991333008 length of segment : 208 time for calcul the mask position with numpy : 0.03975081443786621 nb_pixel_total : 60652 time to create 1 rle with old method : 0.07230353355407715 length of segment : 268 time for calcul the mask position with numpy : 0.13714838027954102 nb_pixel_total : 209537 time to create 1 rle with new method : 0.01447749137878418 length of segment : 501 time for calcul the mask position with numpy : 0.0028917789459228516 nb_pixel_total : 40450 time to create 1 rle with old method : 0.06091141700744629 length of segment : 378 time for calcul the mask position with numpy : 0.0017464160919189453 nb_pixel_total : 61995 time to create 1 rle with old method : 0.07052922248840332 length of segment : 270 time for calcul the mask position with numpy : 0.002426624298095703 nb_pixel_total : 53464 time to create 1 rle with old method : 0.061370849609375 length of segment : 643 time for calcul the mask position with numpy : 0.20880651473999023 nb_pixel_total : 315222 time to create 1 rle with new method : 0.020189762115478516 length of segment : 597 time for calcul the mask position with numpy : 0.008281469345092773 nb_pixel_total : 287232 time to create 1 rle with new method : 0.022584199905395508 length of segment : 1324 time for calcul the mask position with numpy : 0.08115696907043457 nb_pixel_total : 145217 time to create 1 rle with old method : 0.16164112091064453 length of segment : 442 time for calcul the mask position with numpy : 0.03364968299865723 nb_pixel_total : 180363 time to create 1 rle with new method : 0.014878273010253906 length of segment : 693 time for calcul the mask position with numpy : 0.06467890739440918 nb_pixel_total : 203506 time to create 1 rle with new method : 0.01110386848449707 length of segment : 397 time for calcul the mask position with numpy : 0.0017502307891845703 nb_pixel_total : 71313 time to create 1 rle with old method : 0.08210229873657227 length of segment : 327 time for calcul the mask position with numpy : 0.004913806915283203 nb_pixel_total : 45116 time to create 1 rle with old method : 0.05329394340515137 length of segment : 318 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 43129 time to create 1 rle with old method : 0.050130605697631836 length of segment : 303 time for calcul the mask position with numpy : 0.004537343978881836 nb_pixel_total : 50070 time to create 1 rle with old method : 0.061728477478027344 length of segment : 279 time for calcul the mask position with numpy : 0.050746917724609375 nb_pixel_total : 72521 time to create 1 rle with old method : 0.11128592491149902 length of segment : 371 time for calcul the mask position with numpy : 0.14047694206237793 nb_pixel_total : 53338 time to create 1 rle with old method : 0.06877803802490234 length of segment : 257 time for calcul the mask position with numpy : 0.10910344123840332 nb_pixel_total : 28265 time to create 1 rle with old method : 0.0374300479888916 length of segment : 223 time for calcul the mask position with numpy : 0.27236390113830566 nb_pixel_total : 106651 time to create 1 rle with old method : 0.19112062454223633 length of segment : 414 time for calcul the mask position with numpy : 0.4551272392272949 nb_pixel_total : 201193 time to create 1 rle with new method : 0.012498855590820312 length of segment : 358 time for calcul the mask position with numpy : 0.15459823608398438 nb_pixel_total : 67738 time to create 1 rle with old method : 0.09322309494018555 length of segment : 270 time for calcul the mask position with numpy : 0.0700998306274414 nb_pixel_total : 60726 time to create 1 rle with old method : 0.08516097068786621 length of segment : 286 time for calcul the mask position with numpy : 0.09844374656677246 nb_pixel_total : 61714 time to create 1 rle with old method : 0.09235882759094238 length of segment : 224 time for calcul the mask position with numpy : 0.1612999439239502 nb_pixel_total : 113104 time to create 1 rle with old method : 0.19347763061523438 length of segment : 376 time for calcul the mask position with numpy : 0.09021711349487305 nb_pixel_total : 31548 time to create 1 rle with old method : 0.04677557945251465 length of segment : 211 time for calcul the mask position with numpy : 0.09337067604064941 nb_pixel_total : 67907 time to create 1 rle with old method : 0.08217263221740723 length of segment : 382 time for calcul the mask position with numpy : 0.19182276725769043 nb_pixel_total : 72589 time to create 1 rle with old method : 0.11295890808105469 length of segment : 275 time for calcul the mask position with numpy : 0.29007840156555176 nb_pixel_total : 147514 time to create 1 rle with old method : 0.20659136772155762 length of segment : 728 time for calcul the mask position with numpy : 0.4170827865600586 nb_pixel_total : 235756 time to create 1 rle with new method : 0.01216578483581543 length of segment : 484 time for calcul the mask position with numpy : 0.37416672706604004 nb_pixel_total : 239225 time to create 1 rle with new method : 0.01743602752685547 length of segment : 752 time for calcul the mask position with numpy : 0.22762537002563477 nb_pixel_total : 111061 time to create 1 rle with old method : 0.17051935195922852 length of segment : 315 time for calcul the mask position with numpy : 0.036087989807128906 nb_pixel_total : 47912 time to create 1 rle with old method : 0.060303688049316406 length of segment : 242 time for calcul the mask position with numpy : 0.09550237655639648 nb_pixel_total : 62077 time to create 1 rle with old method : 0.08843541145324707 length of segment : 272 time for calcul the mask position with numpy : 0.10607481002807617 nb_pixel_total : 80120 time to create 1 rle with old method : 0.15107417106628418 length of segment : 511 time for calcul the mask position with numpy : 0.11886382102966309 nb_pixel_total : 94411 time to create 1 rle with old method : 0.11226391792297363 length of segment : 321 time for calcul the mask position with numpy : 0.855294942855835 nb_pixel_total : 757089 time to create 1 rle with new method : 0.32576775550842285 length of segment : 1129 time for calcul the mask position with numpy : 0.2590756416320801 nb_pixel_total : 160658 time to create 1 rle with new method : 0.026055574417114258 length of segment : 979 time for calcul the mask position with numpy : 0.12258481979370117 nb_pixel_total : 67505 time to create 1 rle with old method : 0.0785219669342041 length of segment : 277 time for calcul the mask position with numpy : 0.00892782211303711 nb_pixel_total : 109750 time to create 1 rle with old method : 0.1431901454925537 length of segment : 473 time for calcul the mask position with numpy : 0.1201009750366211 nb_pixel_total : 240632 time to create 1 rle with new method : 0.012463569641113281 length of segment : 441 time for calcul the mask position with numpy : 0.058023691177368164 nb_pixel_total : 124839 time to create 1 rle with old method : 0.14471054077148438 length of segment : 454 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 13247 time to create 1 rle with old method : 0.015410423278808594 length of segment : 128 time for calcul the mask position with numpy : 0.1211092472076416 nb_pixel_total : 148990 time to create 1 rle with old method : 0.1737818717956543 length of segment : 558 time for calcul the mask position with numpy : 0.016622304916381836 nb_pixel_total : 60939 time to create 1 rle with old method : 0.07304525375366211 length of segment : 266 time for calcul the mask position with numpy : 0.30198049545288086 nb_pixel_total : 258145 time to create 1 rle with new method : 0.016931533813476562 length of segment : 486 time for calcul the mask position with numpy : 0.0012543201446533203 nb_pixel_total : 25995 time to create 1 rle with old method : 0.02843499183654785 length of segment : 321 time for calcul the mask position with numpy : 0.03307843208312988 nb_pixel_total : 34676 time to create 1 rle with old method : 0.04129362106323242 length of segment : 677 time for calcul the mask position with numpy : 0.0009334087371826172 nb_pixel_total : 30837 time to create 1 rle with old method : 0.03578591346740723 length of segment : 283 time for calcul the mask position with numpy : 0.0005221366882324219 nb_pixel_total : 18326 time to create 1 rle with old method : 0.020120859146118164 length of segment : 166 time for calcul the mask position with numpy : 0.020710229873657227 nb_pixel_total : 15908 time to create 1 rle with old method : 0.022835493087768555 length of segment : 192 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 19551 time to create 1 rle with old method : 0.022857666015625 length of segment : 100 time for calcul the mask position with numpy : 0.001500844955444336 nb_pixel_total : 28377 time to create 1 rle with old method : 0.037787675857543945 length of segment : 235 time for calcul the mask position with numpy : 0.040294647216796875 nb_pixel_total : 145807 time to create 1 rle with old method : 0.20293331146240234 length of segment : 678 time for calcul the mask position with numpy : 0.015486955642700195 nb_pixel_total : 39476 time to create 1 rle with old method : 0.049738407135009766 length of segment : 135 time for calcul the mask position with numpy : 0.010538816452026367 nb_pixel_total : 2126 time to create 1 rle with old method : 0.00475001335144043 length of segment : 257 time for calcul the mask position with numpy : 0.002200603485107422 nb_pixel_total : 41659 time to create 1 rle with old method : 0.04725074768066406 length of segment : 206 time for calcul the mask position with numpy : 0.0014634132385253906 nb_pixel_total : 69629 time to create 1 rle with old method : 0.08209824562072754 length of segment : 424 time for calcul the mask position with numpy : 0.14769768714904785 nb_pixel_total : 113398 time to create 1 rle with old method : 0.24070310592651367 length of segment : 362 time for calcul the mask position with numpy : 0.16130590438842773 nb_pixel_total : 119329 time to create 1 rle with old method : 0.1388399600982666 length of segment : 422 time for calcul the mask position with numpy : 0.1168968677520752 nb_pixel_total : 157966 time to create 1 rle with new method : 0.010906696319580078 length of segment : 405 time for calcul the mask position with numpy : 0.0064890384674072266 nb_pixel_total : 5607 time to create 1 rle with old method : 0.008626222610473633 length of segment : 131 time for calcul the mask position with numpy : 0.08336162567138672 nb_pixel_total : 117829 time to create 1 rle with old method : 0.1728670597076416 length of segment : 323 time for calcul the mask position with numpy : 0.019326210021972656 nb_pixel_total : 141153 time to create 1 rle with old method : 0.16894841194152832 length of segment : 418 time for calcul the mask position with numpy : 0.0035927295684814453 nb_pixel_total : 165317 time to create 1 rle with new method : 0.011367082595825195 length of segment : 305 time for calcul the mask position with numpy : 0.12336444854736328 nb_pixel_total : 493194 time to create 1 rle with new method : 0.09158635139465332 length of segment : 834 time for calcul the mask position with numpy : 0.073455810546875 nb_pixel_total : 214132 time to create 1 rle with new method : 0.011202335357666016 length of segment : 429 time for calcul the mask position with numpy : 0.0030775070190429688 nb_pixel_total : 178807 time to create 1 rle with new method : 0.008289098739624023 length of segment : 335 time for calcul the mask position with numpy : 0.04243755340576172 nb_pixel_total : 324191 time to create 1 rle with new method : 0.019741058349609375 length of segment : 453 time for calcul the mask position with numpy : 0.05250668525695801 nb_pixel_total : 166366 time to create 1 rle with new method : 0.010071516036987305 length of segment : 457 time for calcul the mask position with numpy : 0.04406595230102539 nb_pixel_total : 89046 time to create 1 rle with old method : 0.10622072219848633 length of segment : 362 time for calcul the mask position with numpy : 0.0023136138916015625 nb_pixel_total : 82065 time to create 1 rle with old method : 0.09293651580810547 length of segment : 413 time for calcul the mask position with numpy : 0.04495954513549805 nb_pixel_total : 172118 time to create 1 rle with new method : 0.00794363021850586 length of segment : 494 time for calcul the mask position with numpy : 0.004235506057739258 nb_pixel_total : 202587 time to create 1 rle with new method : 0.011846780776977539 length of segment : 380 time for calcul the mask position with numpy : 0.013352394104003906 nb_pixel_total : 428069 time to create 1 rle with new method : 0.019628286361694336 length of segment : 696 time for calcul the mask position with numpy : 0.025200366973876953 nb_pixel_total : 66176 time to create 1 rle with old method : 0.08424878120422363 length of segment : 312 time for calcul the mask position with numpy : 0.005518674850463867 nb_pixel_total : 140718 time to create 1 rle with old method : 0.1634371280670166 length of segment : 306 time for calcul the mask position with numpy : 0.0050814151763916016 nb_pixel_total : 164410 time to create 1 rle with new method : 0.006046295166015625 length of segment : 332 time for calcul the mask position with numpy : 0.001623392105102539 nb_pixel_total : 63445 time to create 1 rle with old method : 0.07303786277770996 length of segment : 181 time for calcul the mask position with numpy : 0.0009915828704833984 nb_pixel_total : 28535 time to create 1 rle with old method : 0.033267974853515625 length of segment : 260 time for calcul the mask position with numpy : 0.0201418399810791 nb_pixel_total : 58004 time to create 1 rle with old method : 0.06571173667907715 length of segment : 300 time for calcul the mask position with numpy : 0.001298666000366211 nb_pixel_total : 14058 time to create 1 rle with old method : 0.01595330238342285 length of segment : 360 time for calcul the mask position with numpy : 0.042615652084350586 nb_pixel_total : 54047 time to create 1 rle with old method : 0.0646982192993164 length of segment : 324 time for calcul the mask position with numpy : 0.0008044242858886719 nb_pixel_total : 39716 time to create 1 rle with old method : 0.04587697982788086 length of segment : 252 time for calcul the mask position with numpy : 0.11503911018371582 nb_pixel_total : 432539 time to create 1 rle with new method : 0.028268098831176758 length of segment : 1297 time for calcul the mask position with numpy : 0.018338441848754883 nb_pixel_total : 74758 time to create 1 rle with old method : 0.08530092239379883 length of segment : 475 time for calcul the mask position with numpy : 0.020958662033081055 nb_pixel_total : 63952 time to create 1 rle with old method : 0.07992696762084961 length of segment : 250 time for calcul the mask position with numpy : 0.01415395736694336 nb_pixel_total : 15565 time to create 1 rle with old method : 0.02335047721862793 length of segment : 162 time for calcul the mask position with numpy : 0.002099275588989258 nb_pixel_total : 44558 time to create 1 rle with old method : 0.0510561466217041 length of segment : 270 time for calcul the mask position with numpy : 0.10335826873779297 nb_pixel_total : 1273448 time to create 1 rle with new method : 0.13253998756408691 length of segment : 1180 time for calcul the mask position with numpy : 0.016283512115478516 nb_pixel_total : 81238 time to create 1 rle with old method : 0.09862518310546875 length of segment : 477 time for calcul the mask position with numpy : 0.0262906551361084 nb_pixel_total : 27154 time to create 1 rle with old method : 0.039215803146362305 length of segment : 308 time for calcul the mask position with numpy : 0.06702566146850586 nb_pixel_total : 103868 time to create 1 rle with old method : 0.12266826629638672 length of segment : 326 time for calcul the mask position with numpy : 0.03579902648925781 nb_pixel_total : 43535 time to create 1 rle with old method : 0.06699132919311523 length of segment : 280 time for calcul the mask position with numpy : 0.013395547866821289 nb_pixel_total : 28247 time to create 1 rle with old method : 0.032503604888916016 length of segment : 200 time for calcul the mask position with numpy : 0.06388449668884277 nb_pixel_total : 503169 time to create 1 rle with new method : 0.09434247016906738 length of segment : 718 time for calcul the mask position with numpy : 0.1328897476196289 nb_pixel_total : 765630 time to create 1 rle with new method : 0.07501959800720215 length of segment : 844 time for calcul the mask position with numpy : 0.11857247352600098 nb_pixel_total : 456701 time to create 1 rle with new method : 0.03368878364562988 length of segment : 713 time for calcul the mask position with numpy : 0.0008616447448730469 nb_pixel_total : 28523 time to create 1 rle with old method : 0.042249202728271484 length of segment : 197 time for calcul the mask position with numpy : 0.003870248794555664 nb_pixel_total : 156975 time to create 1 rle with new method : 0.010838508605957031 length of segment : 604 time for calcul the mask position with numpy : 0.010775566101074219 nb_pixel_total : 56029 time to create 1 rle with old method : 0.06804156303405762 length of segment : 417 time for calcul the mask position with numpy : 0.019071102142333984 nb_pixel_total : 75792 time to create 1 rle with old method : 0.09686088562011719 length of segment : 311 time for calcul the mask position with numpy : 0.002362489700317383 nb_pixel_total : 29322 time to create 1 rle with old method : 0.06084775924682617 length of segment : 192 time for calcul the mask position with numpy : 0.019725322723388672 nb_pixel_total : 93178 time to create 1 rle with old method : 0.11033105850219727 length of segment : 360 time for calcul the mask position with numpy : 0.0014867782592773438 nb_pixel_total : 75558 time to create 1 rle with old method : 0.08641767501831055 length of segment : 219 time for calcul the mask position with numpy : 0.01720595359802246 nb_pixel_total : 31349 time to create 1 rle with old method : 0.04232001304626465 length of segment : 149 time for calcul the mask position with numpy : 0.01621723175048828 nb_pixel_total : 399328 time to create 1 rle with new method : 0.020882368087768555 length of segment : 740 time for calcul the mask position with numpy : 0.002440214157104492 nb_pixel_total : 52836 time to create 1 rle with old method : 0.06017494201660156 length of segment : 329 time for calcul the mask position with numpy : 0.007355451583862305 nb_pixel_total : 116952 time to create 1 rle with old method : 0.1347963809967041 length of segment : 408 time for calcul the mask position with numpy : 0.022401094436645508 nb_pixel_total : 53375 time to create 1 rle with old method : 0.06724882125854492 length of segment : 332 time for calcul the mask position with numpy : 0.0005195140838623047 nb_pixel_total : 13829 time to create 1 rle with old method : 0.01603078842163086 length of segment : 150 time for calcul the mask position with numpy : 0.0013306140899658203 nb_pixel_total : 79839 time to create 1 rle with old method : 0.0906670093536377 length of segment : 338 time for calcul the mask position with numpy : 0.022152423858642578 nb_pixel_total : 83019 time to create 1 rle with old method : 0.09862112998962402 length of segment : 367 time for calcul the mask position with numpy : 0.07258439064025879 nb_pixel_total : 558532 time to create 1 rle with new method : 0.0415189266204834 length of segment : 869 time for calcul the mask position with numpy : 0.017241477966308594 nb_pixel_total : 148719 time to create 1 rle with old method : 0.17214155197143555 length of segment : 711 time for calcul the mask position with numpy : 0.0009589195251464844 nb_pixel_total : 49551 time to create 1 rle with old method : 0.05624675750732422 length of segment : 295 time for calcul the mask position with numpy : 0.004179954528808594 nb_pixel_total : 62012 time to create 1 rle with old method : 0.07327437400817871 length of segment : 245 time for calcul the mask position with numpy : 0.025384902954101562 nb_pixel_total : 205324 time to create 1 rle with new method : 0.01865363121032715 length of segment : 506 time for calcul the mask position with numpy : 0.0007491111755371094 nb_pixel_total : 20362 time to create 1 rle with old method : 0.023782730102539062 length of segment : 119 time for calcul the mask position with numpy : 0.003079652786254883 nb_pixel_total : 35540 time to create 1 rle with old method : 0.041254281997680664 length of segment : 448 time for calcul the mask position with numpy : 0.0018627643585205078 nb_pixel_total : 68173 time to create 1 rle with old method : 0.08194899559020996 length of segment : 224 time for calcul the mask position with numpy : 0.0018906593322753906 nb_pixel_total : 60047 time to create 1 rle with old method : 0.06848454475402832 length of segment : 241 time for calcul the mask position with numpy : 0.009646415710449219 nb_pixel_total : 22700 time to create 1 rle with old method : 0.02879047393798828 length of segment : 248 time for calcul the mask position with numpy : 0.0025141239166259766 nb_pixel_total : 123022 time to create 1 rle with old method : 0.14047455787658691 length of segment : 384 time for calcul the mask position with numpy : 0.0024154186248779297 nb_pixel_total : 117095 time to create 1 rle with old method : 0.16020846366882324 length of segment : 421 time for calcul the mask position with numpy : 0.0015616416931152344 nb_pixel_total : 73062 time to create 1 rle with old method : 0.08284950256347656 length of segment : 363 time for calcul the mask position with numpy : 0.029970407485961914 nb_pixel_total : 909077 time to create 1 rle with new method : 0.14912986755371094 length of segment : 1785 time for calcul the mask position with numpy : 0.0050618648529052734 nb_pixel_total : 113703 time to create 1 rle with old method : 0.13394761085510254 length of segment : 389 time for calcul the mask position with numpy : 0.0035347938537597656 nb_pixel_total : 113039 time to create 1 rle with old method : 0.1280829906463623 length of segment : 425 time for calcul the mask position with numpy : 0.0015842914581298828 nb_pixel_total : 71591 time to create 1 rle with old method : 0.08269286155700684 length of segment : 300 time for calcul the mask position with numpy : 0.016820907592773438 nb_pixel_total : 139569 time to create 1 rle with old method : 0.161088228225708 length of segment : 360 time for calcul the mask position with numpy : 0.0012023448944091797 nb_pixel_total : 46418 time to create 1 rle with old method : 0.05379796028137207 length of segment : 261 time for calcul the mask position with numpy : 0.004303932189941406 nb_pixel_total : 208064 time to create 1 rle with new method : 0.01295924186706543 length of segment : 618 time for calcul the mask position with numpy : 0.004698276519775391 nb_pixel_total : 32420 time to create 1 rle with old method : 0.05547785758972168 length of segment : 155 time for calcul the mask position with numpy : 0.002816915512084961 nb_pixel_total : 119375 time to create 1 rle with old method : 0.1339552402496338 length of segment : 430 time for calcul the mask position with numpy : 0.018949508666992188 nb_pixel_total : 74364 time to create 1 rle with old method : 0.08857345581054688 length of segment : 304 time for calcul the mask position with numpy : 0.001226663589477539 nb_pixel_total : 58504 time to create 1 rle with old method : 0.06689286231994629 length of segment : 285 time for calcul the mask position with numpy : 0.0019690990447998047 nb_pixel_total : 113181 time to create 1 rle with old method : 0.12943029403686523 length of segment : 421 time for calcul the mask position with numpy : 0.0007197856903076172 nb_pixel_total : 35874 time to create 1 rle with old method : 0.040895938873291016 length of segment : 233 time for calcul the mask position with numpy : 0.0021431446075439453 nb_pixel_total : 117077 time to create 1 rle with old method : 0.13270926475524902 length of segment : 432 time for calcul the mask position with numpy : 0.0015919208526611328 nb_pixel_total : 72571 time to create 1 rle with old method : 0.08278846740722656 length of segment : 297 time for calcul the mask position with numpy : 0.006188869476318359 nb_pixel_total : 79414 time to create 1 rle with old method : 0.09132647514343262 length of segment : 357 time for calcul the mask position with numpy : 0.012198925018310547 nb_pixel_total : 404893 time to create 1 rle with new method : 0.0435183048248291 length of segment : 1122 time for calcul the mask position with numpy : 0.0072307586669921875 nb_pixel_total : 166425 time to create 1 rle with new method : 0.008963346481323242 length of segment : 371 time for calcul the mask position with numpy : 0.0011975765228271484 nb_pixel_total : 59383 time to create 1 rle with old method : 0.06757855415344238 length of segment : 385 time for calcul the mask position with numpy : 0.001819610595703125 nb_pixel_total : 39718 time to create 1 rle with old method : 0.045801639556884766 length of segment : 220 time for calcul the mask position with numpy : 0.001256704330444336 nb_pixel_total : 26535 time to create 1 rle with old method : 0.0302121639251709 length of segment : 211 time for calcul the mask position with numpy : 0.003488302230834961 nb_pixel_total : 157295 time to create 1 rle with new method : 0.008854150772094727 length of segment : 419 time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 20802 time to create 1 rle with old method : 0.024608612060546875 length of segment : 150 time for calcul the mask position with numpy : 0.0012047290802001953 nb_pixel_total : 48425 time to create 1 rle with old method : 0.05536031723022461 length of segment : 317 time for calcul the mask position with numpy : 0.0023336410522460938 nb_pixel_total : 110029 time to create 1 rle with old method : 0.13353586196899414 length of segment : 317 time for calcul the mask position with numpy : 0.0006008148193359375 nb_pixel_total : 18350 time to create 1 rle with old method : 0.021885156631469727 length of segment : 101 time for calcul the mask position with numpy : 0.0033860206604003906 nb_pixel_total : 146087 time to create 1 rle with old method : 0.16485071182250977 length of segment : 437 time for calcul the mask position with numpy : 0.001766204833984375 nb_pixel_total : 79521 time to create 1 rle with old method : 0.08955192565917969 length of segment : 321 time for calcul the mask position with numpy : 0.006741046905517578 nb_pixel_total : 295625 time to create 1 rle with new method : 0.017229080200195312 length of segment : 720 time for calcul the mask position with numpy : 0.003661632537841797 nb_pixel_total : 164364 time to create 1 rle with new method : 0.009533166885375977 length of segment : 491 time for calcul the mask position with numpy : 0.0006244182586669922 nb_pixel_total : 22446 time to create 1 rle with old method : 0.025849342346191406 length of segment : 156 time for calcul the mask position with numpy : 0.003642559051513672 nb_pixel_total : 157617 time to create 1 rle with new method : 0.009235620498657227 length of segment : 466 time for calcul the mask position with numpy : 0.0021004676818847656 nb_pixel_total : 105449 time to create 1 rle with old method : 0.1210625171661377 length of segment : 236 time for calcul the mask position with numpy : 0.0009076595306396484 nb_pixel_total : 17736 time to create 1 rle with old method : 0.02087235450744629 length of segment : 155 time for calcul the mask position with numpy : 0.005845546722412109 nb_pixel_total : 271819 time to create 1 rle with new method : 0.014858245849609375 length of segment : 623 time for calcul the mask position with numpy : 0.0013930797576904297 nb_pixel_total : 65841 time to create 1 rle with old method : 0.07376360893249512 length of segment : 280 time for calcul the mask position with numpy : 0.000728607177734375 nb_pixel_total : 37755 time to create 1 rle with old method : 0.04278111457824707 length of segment : 252 time for calcul the mask position with numpy : 0.0010764598846435547 nb_pixel_total : 41275 time to create 1 rle with old method : 0.04797482490539551 length of segment : 197 time for calcul the mask position with numpy : 0.008865833282470703 nb_pixel_total : 361665 time to create 1 rle with new method : 0.021346330642700195 length of segment : 712 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 27084 time to create 1 rle with old method : 0.031360626220703125 length of segment : 286 time for calcul the mask position with numpy : 0.0006673336029052734 nb_pixel_total : 26794 time to create 1 rle with old method : 0.030980348587036133 length of segment : 179 time for calcul the mask position with numpy : 0.003632068634033203 nb_pixel_total : 190842 time to create 1 rle with new method : 0.009493827819824219 length of segment : 466 time for calcul the mask position with numpy : 0.00986623764038086 nb_pixel_total : 251333 time to create 1 rle with new method : 0.011108875274658203 length of segment : 923 time for calcul the mask position with numpy : 0.00756072998046875 nb_pixel_total : 338304 time to create 1 rle with new method : 0.02044367790222168 length of segment : 1237 time for calcul the mask position with numpy : 0.0013353824615478516 nb_pixel_total : 38592 time to create 1 rle with old method : 0.0444183349609375 length of segment : 291 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 7492 time to create 1 rle with old method : 0.008767366409301758 length of segment : 111 time for calcul the mask position with numpy : 0.0034084320068359375 nb_pixel_total : 118332 time to create 1 rle with old method : 0.13479065895080566 length of segment : 337 time for calcul the mask position with numpy : 0.001058816909790039 nb_pixel_total : 29050 time to create 1 rle with old method : 0.03569793701171875 length of segment : 353 time for calcul the mask position with numpy : 0.0023453235626220703 nb_pixel_total : 32435 time to create 1 rle with old method : 0.03822827339172363 length of segment : 175 time for calcul the mask position with numpy : 0.0016574859619140625 nb_pixel_total : 62345 time to create 1 rle with old method : 0.07091283798217773 length of segment : 374 time for calcul the mask position with numpy : 0.01890397071838379 nb_pixel_total : 370332 time to create 1 rle with new method : 0.09779572486877441 length of segment : 661 time for calcul the mask position with numpy : 0.0018534660339355469 nb_pixel_total : 56092 time to create 1 rle with old method : 0.0660090446472168 length of segment : 284 time for calcul the mask position with numpy : 0.004337787628173828 nb_pixel_total : 134420 time to create 1 rle with old method : 0.15224719047546387 length of segment : 494 time for calcul the mask position with numpy : 0.0005552768707275391 nb_pixel_total : 9169 time to create 1 rle with old method : 0.011148214340209961 length of segment : 96 time for calcul the mask position with numpy : 0.016465187072753906 nb_pixel_total : 318143 time to create 1 rle with new method : 0.021330595016479492 length of segment : 1281 time for calcul the mask position with numpy : 0.0010275840759277344 nb_pixel_total : 45360 time to create 1 rle with old method : 0.05284285545349121 length of segment : 290 time for calcul the mask position with numpy : 0.0066699981689453125 nb_pixel_total : 105043 time to create 1 rle with old method : 0.1200261116027832 length of segment : 425 time for calcul the mask position with numpy : 0.008310556411743164 nb_pixel_total : 356508 time to create 1 rle with new method : 0.020109891891479492 length of segment : 726 time for calcul the mask position with numpy : 0.0033431053161621094 nb_pixel_total : 130207 time to create 1 rle with old method : 0.14893794059753418 length of segment : 389 time for calcul the mask position with numpy : 0.0010485649108886719 nb_pixel_total : 36405 time to create 1 rle with old method : 0.04174304008483887 length of segment : 243 time for calcul the mask position with numpy : 0.0018875598907470703 nb_pixel_total : 34063 time to create 1 rle with old method : 0.03928565979003906 length of segment : 310 time for calcul the mask position with numpy : 0.002425670623779297 nb_pixel_total : 71779 time to create 1 rle with old method : 0.08144569396972656 length of segment : 308 time for calcul the mask position with numpy : 0.0037882328033447266 nb_pixel_total : 158537 time to create 1 rle with new method : 0.008236885070800781 length of segment : 638 time for calcul the mask position with numpy : 0.013423919677734375 nb_pixel_total : 164030 time to create 1 rle with new method : 0.10548925399780273 length of segment : 908 time for calcul the mask position with numpy : 0.02117013931274414 nb_pixel_total : 243962 time to create 1 rle with new method : 0.015764713287353516 length of segment : 408 time for calcul the mask position with numpy : 0.003339529037475586 nb_pixel_total : 61713 time to create 1 rle with old method : 0.07222199440002441 length of segment : 233 time for calcul the mask position with numpy : 0.0012898445129394531 nb_pixel_total : 46806 time to create 1 rle with old method : 0.0539698600769043 length of segment : 284 time for calcul the mask position with numpy : 0.0022559165954589844 nb_pixel_total : 81136 time to create 1 rle with old method : 0.09271240234375 length of segment : 365 time for calcul the mask position with numpy : 0.001302480697631836 nb_pixel_total : 65432 time to create 1 rle with old method : 0.07441830635070801 length of segment : 237 time for calcul the mask position with numpy : 0.0007777214050292969 nb_pixel_total : 15430 time to create 1 rle with old method : 0.017932653427124023 length of segment : 133 time for calcul the mask position with numpy : 0.0046596527099609375 nb_pixel_total : 249052 time to create 1 rle with new method : 0.013229608535766602 length of segment : 407 time for calcul the mask position with numpy : 1.3297016620635986 nb_pixel_total : 7070861 time to create 1 rle with new method : 1.951481819152832 length of segment : 4451 time for calcul the mask position with numpy : 0.0004096031188964844 nb_pixel_total : 25962 time to create 1 rle with old method : 0.03309202194213867 length of segment : 131 time for calcul the mask position with numpy : 0.01876354217529297 nb_pixel_total : 1246474 time to create 1 rle with new method : 0.030431270599365234 length of segment : 938 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 65883 time to create 1 rle with old method : 0.07417416572570801 length of segment : 319 time for calcul the mask position with numpy : 0.007305622100830078 nb_pixel_total : 494000 time to create 1 rle with new method : 0.010474205017089844 length of segment : 347 time for calcul the mask position with numpy : 0.0078008174896240234 nb_pixel_total : 157388 time to create 1 rle with new method : 0.027970552444458008 length of segment : 1146 time for calcul the mask position with numpy : 0.0035283565521240234 nb_pixel_total : 218572 time to create 1 rle with new method : 0.009571075439453125 length of segment : 633 time for calcul the mask position with numpy : 0.010087728500366211 nb_pixel_total : 590182 time to create 1 rle with new method : 0.015604496002197266 length of segment : 824 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 22257 time to create 1 rle with old method : 0.02619194984436035 length of segment : 74 time for calcul the mask position with numpy : 0.0015592575073242188 nb_pixel_total : 122612 time to create 1 rle with old method : 0.13924002647399902 length of segment : 358 time for calcul the mask position with numpy : 0.48837995529174805 nb_pixel_total : 10066828 time to create 1 rle with new method : 2.4130122661590576 length of segment : 5065 time for calcul the mask position with numpy : 0.008293390274047852 nb_pixel_total : 501171 time to create 1 rle with new method : 0.019741296768188477 length of segment : 930 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 21314 time to create 1 rle with old method : 0.023841142654418945 length of segment : 203 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 4271 time to create 1 rle with old method : 0.005182743072509766 length of segment : 210 time for calcul the mask position with numpy : 0.009898185729980469 nb_pixel_total : 547108 time to create 1 rle with new method : 0.024871110916137695 length of segment : 1281 time for calcul the mask position with numpy : 0.005625486373901367 nb_pixel_total : 199959 time to create 1 rle with new method : 0.006021261215209961 length of segment : 496 time spent for convertir_results : 124.49748826026917 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 453 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 329.32837772369385 time spend to save output : 0.2604553699493408 total time spend for step 2 : 329.5888330936432 step3:blur_detection Tue May 6 12:49:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 4160) 1463.932058360798 (3120, 4160) 526.568480341672 (3120, 4160) 760.7985054079087 (4160, 3120) 89.60640022278695 (3120, 4160) 2626.0154200285915 (3120, 4160) 1376.1698391603493 (3120, 4160) 3936.0375646567954 (3120, 4160) 2200.094558085102 (3120, 4160) 2130.3089572045974 (3120, 4160) 1055.1590120336348 (4160, 3120) 93.78120770908892 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 11 time used for this insertion : 0.014133214950561523 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 11 time used for this insertion : 0.013046741485595703 save missing photos in datou_result : time spend for datou_step_exec : 1.8895912170410156 time spend to save output : 0.03311634063720703 total time spend for step 3 : 1.9227075576782227 step4:brightness Tue May 6 12:49:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746528089_771234_1356331857_5bdfc8b3c56ef0a460edcf24743c12e5.jpg treat image : temp/1746528089_771234_1356331848_29fb364fad86984d23f127d2b116da38.jpg treat image : temp/1746528089_771234_1356331842_ba10d9a64925706fff092a62332b5771.jpg treat image : temp/1746528089_771234_1356331838_a8975bac8285aa0e8bbd6783b9eae9c9.jpg treat image : temp/1746528089_771234_1356331817_d67dacd6c1342b36788029aafb77ba49.jpg treat image : temp/1746528089_771234_1356331815_7de4d6ea604b422d7c468395505cf6b7.jpg treat image : temp/1746528089_771234_1356331809_9785df3056b619a06550cb62c66d452d.jpg treat image : temp/1746528089_771234_1356331801_c0c2b2011b3cf9c5fb321f8bab810bf4.jpg treat image : temp/1746528089_771234_1356331794_1e88d5cfe13ee0a62ad9a39a47ab3d98.jpg treat image : temp/1746528089_771234_1356331788_2c0c30ce78672abdae62b149974b2e30.jpg treat image : temp/1746528089_771234_1356331771_eb4f2e0e3bc726c7741c5ea797ea8068.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 11 time used for this insertion : 0.014837980270385742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 11 time used for this insertion : 0.01467442512512207 save missing photos in datou_result : time spend for datou_step_exec : 17.5116446018219 time spend to save output : 0.03449535369873047 total time spend for step 4 : 17.54613995552063 step5:rle_unique_nms_with_priority Tue May 6 12:49:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 453 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 39.33542251586914 time for calcul the mask position with numpy : 0.11194849014282227 nb_pixel_total : 2302827 time to create 1 rle with new method : 2.0060224533081055 time for calcul the mask position with numpy : 0.0790250301361084 nb_pixel_total : 2390 time to create 1 rle with old method : 0.0031855106353759766 time for calcul the mask position with numpy : 0.09274482727050781 nb_pixel_total : 1153039 time to create 1 rle with new method : 2.0493223667144775 time for calcul the mask position with numpy : 0.07075977325439453 nb_pixel_total : 50976 time to create 1 rle with old method : 0.061499595642089844 time for calcul the mask position with numpy : 0.0711827278137207 nb_pixel_total : 85162 time to create 1 rle with old method : 0.09963035583496094 time for calcul the mask position with numpy : 0.07500338554382324 nb_pixel_total : 19556 time to create 1 rle with old method : 0.02202749252319336 time for calcul the mask position with numpy : 0.07011532783508301 nb_pixel_total : 33799 time to create 1 rle with old method : 0.038575172424316406 time for calcul the mask position with numpy : 0.10285496711730957 nb_pixel_total : 446901 time to create 1 rle with new method : 2.4481937885284424 time for calcul the mask position with numpy : 0.067230224609375 nb_pixel_total : 335482 time to create 1 rle with new method : 1.8284039497375488 time for calcul the mask position with numpy : 0.06744575500488281 nb_pixel_total : 52405 time to create 1 rle with old method : 0.061327457427978516 time for calcul the mask position with numpy : 0.11355471611022949 nb_pixel_total : 2231679 time to create 1 rle with new method : 3.316955327987671 time for calcul the mask position with numpy : 0.7527909278869629 nb_pixel_total : 6264984 time to create 1 rle with new method : 1.9840338230133057 create new chi : 15.9764084815979 time to delete rle : 0.019488811492919922 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 16867 TO DO : save crop sub photo not yet done ! save time : 1.033332109451294 nb_obj : 7 nb_hashtags : 5 time to prepare the origin masks : 25.594359636306763 time for calcul the mask position with numpy : 0.14540433883666992 nb_pixel_total : 2378626 time to create 1 rle with new method : 1.707002878189087 time for calcul the mask position with numpy : 0.06606435775756836 nb_pixel_total : 61330 time to create 1 rle with old method : 0.06919479370117188 time for calcul the mask position with numpy : 0.07092690467834473 nb_pixel_total : 650056 time to create 1 rle with new method : 1.2117822170257568 time for calcul the mask position with numpy : 0.08177399635314941 nb_pixel_total : 942758 time to create 1 rle with new method : 1.224360466003418 time for calcul the mask position with numpy : 0.05839395523071289 nb_pixel_total : 1057070 time to create 1 rle with new method : 1.374509334564209 time for calcul the mask position with numpy : 0.048727989196777344 nb_pixel_total : 248054 time to create 1 rle with new method : 1.2734241485595703 time for calcul the mask position with numpy : 0.061708927154541016 nb_pixel_total : 2140022 time to create 1 rle with new method : 1.8607115745544434 time for calcul the mask position with numpy : 0.3692648410797119 nb_pixel_total : 5501284 time to create 1 rle with new method : 1.9114222526550293 create new chi : 11.912560224533081 time to delete rle : 0.0027418136596679688 batch 1 Loaded 8 chid ids of type : 4855 Number RLEs to save : 19814 TO DO : save crop sub photo not yet done ! save time : 1.2657203674316406 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 34.470271825790405 time for calcul the mask position with numpy : 0.0765070915222168 nb_pixel_total : 3475900 time to create 1 rle with new method : 2.229215621948242 time for calcul the mask position with numpy : 0.04745888710021973 nb_pixel_total : 115667 time to create 1 rle with old method : 0.1270465850830078 time for calcul the mask position with numpy : 0.046888113021850586 nb_pixel_total : 14811 time to create 1 rle with old method : 0.017793655395507812 time for calcul the mask position with numpy : 0.05792427062988281 nb_pixel_total : 737289 time to create 1 rle with new method : 2.1153924465179443 time for calcul the mask position with numpy : 0.05394124984741211 nb_pixel_total : 624426 time to create 1 rle with new method : 1.592292070388794 time for calcul the mask position with numpy : 0.044225215911865234 nb_pixel_total : 33005 time to create 1 rle with old method : 0.03619790077209473 time for calcul the mask position with numpy : 0.043796539306640625 nb_pixel_total : 30648 time to create 1 rle with old method : 0.033478736877441406 time for calcul the mask position with numpy : 0.04348397254943848 nb_pixel_total : 28193 time to create 1 rle with old method : 0.029353618621826172 time for calcul the mask position with numpy : 0.0681755542755127 nb_pixel_total : 2831155 time to create 1 rle with new method : 1.2223985195159912 time for calcul the mask position with numpy : 0.04520821571350098 nb_pixel_total : 111942 time to create 1 rle with old method : 0.11887550354003906 time for calcul the mask position with numpy : 0.8092546463012695 nb_pixel_total : 4976164 time to create 1 rle with new method : 1.296262502670288 create new chi : 10.433410167694092 time to delete rle : 0.0021028518676757812 batch 1 Loaded 11 chid ids of type : 4855 Number RLEs to save : 18896 TO DO : save crop sub photo not yet done ! save time : 1.106898546218872 nb_obj : 9 nb_hashtags : 6 time to prepare the origin masks : 28.539701223373413 time for calcul the mask position with numpy : 0.3231074810028076 nb_pixel_total : 3554181 time to create 1 rle with new method : 1.6764085292816162 time for calcul the mask position with numpy : 0.06921696662902832 nb_pixel_total : 164624 time to create 1 rle with new method : 1.848008394241333 time for calcul the mask position with numpy : 0.06780886650085449 nb_pixel_total : 10804 time to create 1 rle with old method : 0.012166261672973633 time for calcul the mask position with numpy : 0.05507063865661621 nb_pixel_total : 29423 time to create 1 rle with old method : 0.0322880744934082 time for calcul the mask position with numpy : 0.06864595413208008 nb_pixel_total : 98998 time to create 1 rle with old method : 0.13212108612060547 time for calcul the mask position with numpy : 0.048922061920166016 nb_pixel_total : 754351 time to create 1 rle with new method : 1.0413076877593994 time for calcul the mask position with numpy : 0.11204218864440918 nb_pixel_total : 2807345 time to create 1 rle with new method : 1.351822853088379 time for calcul the mask position with numpy : 0.5438506603240967 nb_pixel_total : 4047271 time to create 1 rle with new method : 2.119544267654419 time for calcul the mask position with numpy : 0.07454609870910645 nb_pixel_total : 672755 time to create 1 rle with new method : 1.372497320175171 time for calcul the mask position with numpy : 0.07152104377746582 nb_pixel_total : 839448 time to create 1 rle with new method : 1.3657455444335938 create new chi : 12.77480673789978 time to delete rle : 0.00342559814453125 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 23035 TO DO : save crop sub photo not yet done ! save time : 1.4030683040618896 nb_obj : 73 nb_hashtags : 10 time to prepare the origin masks : 72.29101967811584 time for calcul the mask position with numpy : 1.111447811126709 nb_pixel_total : 5455299 time to create 1 rle with new method : 1.3453471660614014 time for calcul the mask position with numpy : 0.055272817611694336 nb_pixel_total : 210388 time to create 1 rle with new method : 1.626344919204712 time for calcul the mask position with numpy : 0.05444622039794922 nb_pixel_total : 84231 time to create 1 rle with old method : 0.0922553539276123 time for calcul the mask position with numpy : 0.061754703521728516 nb_pixel_total : 847978 time to create 1 rle with new method : 1.1685519218444824 time for calcul the mask position with numpy : 0.05659842491149902 nb_pixel_total : 42526 time to create 1 rle with old method : 0.04730391502380371 time for calcul the mask position with numpy : 0.06499981880187988 nb_pixel_total : 581930 time to create 1 rle with new method : 1.836918592453003 time for calcul the mask position with numpy : 0.0518338680267334 nb_pixel_total : 7825 time to create 1 rle with old method : 0.00918126106262207 time for calcul the mask position with numpy : 0.05401110649108887 nb_pixel_total : 85866 time to create 1 rle with old method : 0.09394025802612305 time for calcul the mask position with numpy : 0.053887128829956055 nb_pixel_total : 14713 time to create 1 rle with old method : 0.016816139221191406 time for calcul the mask position with numpy : 0.05370497703552246 nb_pixel_total : 123106 time to create 1 rle with old method : 0.13588929176330566 time for calcul the mask position with numpy : 0.05296921730041504 nb_pixel_total : 23138 time to create 1 rle with old method : 0.02562689781188965 time for calcul the mask position with numpy : 0.05327582359313965 nb_pixel_total : 35108 time to create 1 rle with old method : 0.038893938064575195 time for calcul the mask position with numpy : 0.05267190933227539 nb_pixel_total : 67745 time to create 1 rle with old method : 0.07253289222717285 time for calcul the mask position with numpy : 0.05278587341308594 nb_pixel_total : 31359 time to create 1 rle with old method : 0.03576993942260742 time for calcul the mask position with numpy : 0.05231142044067383 nb_pixel_total : 11864 time to create 1 rle with old method : 0.0133514404296875 time for calcul the mask position with numpy : 0.05382704734802246 nb_pixel_total : 142930 time to create 1 rle with old method : 0.164689302444458 time for calcul the mask position with numpy : 0.052437782287597656 nb_pixel_total : 17843 time to create 1 rle with old method : 0.019549846649169922 time for calcul the mask position with numpy : 0.05323028564453125 nb_pixel_total : 200321 time to create 1 rle with new method : 1.7623834609985352 time for calcul the mask position with numpy : 0.05248117446899414 nb_pixel_total : 62026 time to create 1 rle with old method : 0.06684041023254395 time for calcul the mask position with numpy : 0.05278205871582031 nb_pixel_total : 125026 time to create 1 rle with old method : 0.13545703887939453 time for calcul the mask position with numpy : 0.05135035514831543 nb_pixel_total : 23070 time to create 1 rle with old method : 0.02548837661743164 time for calcul the mask position with numpy : 0.052670955657958984 nb_pixel_total : 118388 time to create 1 rle with old method : 0.12708568572998047 time for calcul the mask position with numpy : 0.05183577537536621 nb_pixel_total : 65789 time to create 1 rle with old method : 0.07123422622680664 time for calcul the mask position with numpy : 0.05307507514953613 nb_pixel_total : 85349 time to create 1 rle with old method : 0.09188008308410645 time for calcul the mask position with numpy : 0.051728248596191406 nb_pixel_total : 107040 time to create 1 rle with old method : 0.11584782600402832 time for calcul the mask position with numpy : 0.05060529708862305 nb_pixel_total : 44823 time to create 1 rle with old method : 0.04814767837524414 time for calcul the mask position with numpy : 0.0510101318359375 nb_pixel_total : 50467 time to create 1 rle with old method : 0.05365133285522461 time for calcul the mask position with numpy : 0.051039695739746094 nb_pixel_total : 152968 time to create 1 rle with new method : 2.005087375640869 time for calcul the mask position with numpy : 0.05238914489746094 nb_pixel_total : 12074 time to create 1 rle with old method : 0.013339519500732422 time for calcul the mask position with numpy : 0.05585074424743652 nb_pixel_total : 362400 time to create 1 rle with new method : 2.5755245685577393 time for calcul the mask position with numpy : 0.06015801429748535 nb_pixel_total : 7983 time to create 1 rle with old method : 0.015201568603515625 time for calcul the mask position with numpy : 0.060471534729003906 nb_pixel_total : 82657 time to create 1 rle with old method : 0.11462593078613281 time for calcul the mask position with numpy : 0.05410456657409668 nb_pixel_total : 51890 time to create 1 rle with old method : 0.05752372741699219 time for calcul the mask position with numpy : 0.05275130271911621 nb_pixel_total : 17352 time to create 1 rle with old method : 0.018964290618896484 time for calcul the mask position with numpy : 0.053777456283569336 nb_pixel_total : 12486 time to create 1 rle with old method : 0.014591217041015625 time for calcul the mask position with numpy : 0.055855751037597656 nb_pixel_total : 343812 time to create 1 rle with new method : 1.6028778553009033 time for calcul the mask position with numpy : 0.057443857192993164 nb_pixel_total : 284261 time to create 1 rle with new method : 1.109175682067871 time for calcul the mask position with numpy : 0.05710148811340332 nb_pixel_total : 19729 time to create 1 rle with old method : 0.022219419479370117 time for calcul the mask position with numpy : 0.053708791732788086 nb_pixel_total : 18561 time to create 1 rle with old method : 0.021017074584960938 time for calcul the mask position with numpy : 0.05365753173828125 nb_pixel_total : 3761 time to create 1 rle with old method : 0.0043756961822509766 time for calcul the mask position with numpy : 0.06209516525268555 nb_pixel_total : 1689 time to create 1 rle with old method : 0.0020151138305664062 time for calcul the mask position with numpy : 0.05281186103820801 nb_pixel_total : 55435 time to create 1 rle with old method : 0.06203341484069824 time for calcul the mask position with numpy : 0.05428266525268555 nb_pixel_total : 18123 time to create 1 rle with old method : 0.019576311111450195 time for calcul the mask position with numpy : 0.05402660369873047 nb_pixel_total : 378824 time to create 1 rle with new method : 1.768763780593872 time for calcul the mask position with numpy : 0.0563352108001709 nb_pixel_total : 37348 time to create 1 rle with old method : 0.04070544242858887 time for calcul the mask position with numpy : 0.052559614181518555 nb_pixel_total : 94548 time to create 1 rle with old method : 0.13418245315551758 time for calcul the mask position with numpy : 0.06193375587463379 nb_pixel_total : 237637 time to create 1 rle with new method : 1.3575546741485596 time for calcul the mask position with numpy : 0.05605435371398926 nb_pixel_total : 402368 time to create 1 rle with new method : 1.8720226287841797 time for calcul the mask position with numpy : 0.06130409240722656 nb_pixel_total : 4384 time to create 1 rle with old method : 0.005724668502807617 time for calcul the mask position with numpy : 0.06863784790039062 nb_pixel_total : 25622 time to create 1 rle with old method : 0.034417152404785156 time for calcul the mask position with numpy : 0.06704568862915039 nb_pixel_total : 152806 time to create 1 rle with new method : 1.9298107624053955 time for calcul the mask position with numpy : 0.05282759666442871 nb_pixel_total : 72235 time to create 1 rle with old method : 0.08391332626342773 time for calcul the mask position with numpy : 0.05394124984741211 nb_pixel_total : 60695 time to create 1 rle with old method : 0.06945157051086426 time for calcul the mask position with numpy : 0.05387306213378906 nb_pixel_total : 37470 time to create 1 rle with old method : 0.05672717094421387 time for calcul the mask position with numpy : 0.06295967102050781 nb_pixel_total : 5990 time to create 1 rle with old method : 0.009213685989379883 time for calcul the mask position with numpy : 0.06138348579406738 nb_pixel_total : 37854 time to create 1 rle with old method : 0.06582522392272949 time for calcul the mask position with numpy : 0.06695985794067383 nb_pixel_total : 70676 time to create 1 rle with old method : 0.07933378219604492 time for calcul the mask position with numpy : 0.05377340316772461 nb_pixel_total : 32482 time to create 1 rle with old method : 0.036726951599121094 time for calcul the mask position with numpy : 0.05339646339416504 nb_pixel_total : 2303 time to create 1 rle with old method : 0.0029501914978027344 time for calcul the mask position with numpy : 0.05441784858703613 nb_pixel_total : 23631 time to create 1 rle with old method : 0.030126094818115234 time for calcul the mask position with numpy : 0.05481672286987305 nb_pixel_total : 120905 time to create 1 rle with old method : 0.15588641166687012 time for calcul the mask position with numpy : 0.058078765869140625 nb_pixel_total : 526334 time to create 1 rle with new method : 1.1750264167785645 time for calcul the mask position with numpy : 0.056175947189331055 nb_pixel_total : 18065 time to create 1 rle with old method : 0.020979881286621094 time for calcul the mask position with numpy : 0.0541536808013916 nb_pixel_total : 69193 time to create 1 rle with old method : 0.07677245140075684 time for calcul the mask position with numpy : 0.053078651428222656 nb_pixel_total : 9582 time to create 1 rle with old method : 0.010440587997436523 time for calcul the mask position with numpy : 0.05442023277282715 nb_pixel_total : 41627 time to create 1 rle with old method : 0.04686141014099121 time for calcul the mask position with numpy : 0.0537569522857666 nb_pixel_total : 3883 time to create 1 rle with old method : 0.004708290100097656 time for calcul the mask position with numpy : 0.06192278861999512 nb_pixel_total : 25233 time to create 1 rle with old method : 0.03689241409301758 time for calcul the mask position with numpy : 0.062223196029663086 nb_pixel_total : 228042 time to create 1 rle with new method : 2.0248043537139893 time for calcul the mask position with numpy : 0.06091141700744629 nb_pixel_total : 23562 time to create 1 rle with old method : 0.02663898468017578 time for calcul the mask position with numpy : 0.0538945198059082 nb_pixel_total : 63822 time to create 1 rle with old method : 0.07337689399719238 time for calcul the mask position with numpy : 0.05888819694519043 nb_pixel_total : 45602 time to create 1 rle with old method : 0.05127668380737305 time for calcul the mask position with numpy : 0.05607128143310547 nb_pixel_total : 948 time to create 1 rle with old method : 0.0021505355834960938 time for calcul the mask position with numpy : 0.06303000450134277 nb_pixel_total : 14200 time to create 1 rle with old method : 0.02137279510498047 create new chi : 34.62144494056702 time to delete rle : 0.00800633430480957 batch 1 Loaded 74 chid ids of type : 4855 Number RLEs to save : 49258 TO DO : save crop sub photo not yet done ! save time : 2.971266031265259 nb_obj : 86 nb_hashtags : 9 time to prepare the origin masks : 88.63710331916809 time for calcul the mask position with numpy : 0.618060827255249 nb_pixel_total : 5021348 time to create 1 rle with new method : 2.2192304134368896 time for calcul the mask position with numpy : 0.05315518379211426 nb_pixel_total : 68676 time to create 1 rle with old method : 0.0754241943359375 time for calcul the mask position with numpy : 0.05323219299316406 nb_pixel_total : 225960 time to create 1 rle with new method : 1.5785167217254639 time for calcul the mask position with numpy : 0.05056595802307129 nb_pixel_total : 40294 time to create 1 rle with old method : 0.04202008247375488 time for calcul the mask position with numpy : 0.050807952880859375 nb_pixel_total : 51064 time to create 1 rle with old method : 0.0540921688079834 time for calcul the mask position with numpy : 0.05330085754394531 nb_pixel_total : 237334 time to create 1 rle with new method : 1.87147855758667 time for calcul the mask position with numpy : 0.05382537841796875 nb_pixel_total : 133618 time to create 1 rle with old method : 0.1484668254852295 time for calcul the mask position with numpy : 0.052474021911621094 nb_pixel_total : 49080 time to create 1 rle with old method : 0.054235219955444336 time for calcul the mask position with numpy : 0.05361676216125488 nb_pixel_total : 70361 time to create 1 rle with old method : 0.08019614219665527 time for calcul the mask position with numpy : 0.05641674995422363 nb_pixel_total : 129610 time to create 1 rle with old method : 0.1587204933166504 time for calcul the mask position with numpy : 0.05331921577453613 nb_pixel_total : 30847 time to create 1 rle with old method : 0.03378629684448242 time for calcul the mask position with numpy : 0.05352330207824707 nb_pixel_total : 7847 time to create 1 rle with old method : 0.009037256240844727 time for calcul the mask position with numpy : 0.054134368896484375 nb_pixel_total : 37264 time to create 1 rle with old method : 0.04436802864074707 time for calcul the mask position with numpy : 0.05400967597961426 nb_pixel_total : 42042 time to create 1 rle with old method : 0.048375606536865234 time for calcul the mask position with numpy : 0.056879520416259766 nb_pixel_total : 399137 time to create 1 rle with new method : 1.1749694347381592 time for calcul the mask position with numpy : 0.05534029006958008 nb_pixel_total : 121255 time to create 1 rle with old method : 0.1298823356628418 time for calcul the mask position with numpy : 0.05657172203063965 nb_pixel_total : 449306 time to create 1 rle with new method : 2.424729824066162 time for calcul the mask position with numpy : 0.054466962814331055 nb_pixel_total : 121062 time to create 1 rle with old method : 0.17211532592773438 time for calcul the mask position with numpy : 0.0533902645111084 nb_pixel_total : 37143 time to create 1 rle with old method : 0.1292116641998291 time for calcul the mask position with numpy : 0.05342268943786621 nb_pixel_total : 27433 time to create 1 rle with old method : 0.030836820602416992 time for calcul the mask position with numpy : 0.053429365158081055 nb_pixel_total : 88455 time to create 1 rle with old method : 0.09781503677368164 time for calcul the mask position with numpy : 0.052156686782836914 nb_pixel_total : 8419 time to create 1 rle with old method : 0.010072708129882812 time for calcul the mask position with numpy : 0.05567431449890137 nb_pixel_total : 50286 time to create 1 rle with old method : 0.05482673645019531 time for calcul the mask position with numpy : 0.05323195457458496 nb_pixel_total : 97583 time to create 1 rle with old method : 0.1081995964050293 time for calcul the mask position with numpy : 0.055010318756103516 nb_pixel_total : 911 time to create 1 rle with old method : 0.0010836124420166016 time for calcul the mask position with numpy : 0.05404949188232422 nb_pixel_total : 7169 time to create 1 rle with old method : 0.008351802825927734 time for calcul the mask position with numpy : 0.06663179397583008 nb_pixel_total : 518569 time to create 1 rle with new method : 1.5285398960113525 time for calcul the mask position with numpy : 0.05441021919250488 nb_pixel_total : 169582 time to create 1 rle with new method : 1.4036500453948975 time for calcul the mask position with numpy : 0.05362415313720703 nb_pixel_total : 263085 time to create 1 rle with new method : 1.0905144214630127 time for calcul the mask position with numpy : 0.05693507194519043 nb_pixel_total : 45006 time to create 1 rle with old method : 0.05406808853149414 time for calcul the mask position with numpy : 0.05300307273864746 nb_pixel_total : 59599 time to create 1 rle with old method : 0.06546926498413086 time for calcul the mask position with numpy : 0.053871870040893555 nb_pixel_total : 1552 time to create 1 rle with old method : 0.002032041549682617 time for calcul the mask position with numpy : 0.05880856513977051 nb_pixel_total : 923 time to create 1 rle with old method : 0.0012176036834716797 time for calcul the mask position with numpy : 0.058266639709472656 nb_pixel_total : 4376 time to create 1 rle with old method : 0.007197856903076172 time for calcul the mask position with numpy : 0.05779600143432617 nb_pixel_total : 18525 time to create 1 rle with old method : 0.021285057067871094 time for calcul the mask position with numpy : 0.053467750549316406 nb_pixel_total : 27412 time to create 1 rle with old method : 0.0309598445892334 time for calcul the mask position with numpy : 0.053916215896606445 nb_pixel_total : 91409 time to create 1 rle with old method : 0.10295224189758301 time for calcul the mask position with numpy : 0.05558490753173828 nb_pixel_total : 71732 time to create 1 rle with old method : 0.07841300964355469 time for calcul the mask position with numpy : 0.05316519737243652 nb_pixel_total : 120782 time to create 1 rle with old method : 0.13287138938903809 time for calcul the mask position with numpy : 0.05259966850280762 nb_pixel_total : 40105 time to create 1 rle with old method : 0.04425048828125 time for calcul the mask position with numpy : 0.052918195724487305 nb_pixel_total : 34775 time to create 1 rle with old method : 0.041994333267211914 time for calcul the mask position with numpy : 0.05258369445800781 nb_pixel_total : 10266 time to create 1 rle with old method : 0.011105060577392578 time for calcul the mask position with numpy : 0.05219292640686035 nb_pixel_total : 6300 time to create 1 rle with old method : 0.007238149642944336 time for calcul the mask position with numpy : 0.05546164512634277 nb_pixel_total : 311902 time to create 1 rle with new method : 1.2331738471984863 time for calcul the mask position with numpy : 0.05497622489929199 nb_pixel_total : 24798 time to create 1 rle with old method : 0.026974201202392578 time for calcul the mask position with numpy : 0.05221843719482422 nb_pixel_total : 20872 time to create 1 rle with old method : 0.023148059844970703 time for calcul the mask position with numpy : 0.05377840995788574 nb_pixel_total : 212602 time to create 1 rle with new method : 1.9240171909332275 time for calcul the mask position with numpy : 0.054398536682128906 nb_pixel_total : 186738 time to create 1 rle with new method : 1.0581374168395996 time for calcul the mask position with numpy : 0.05629467964172363 nb_pixel_total : 53589 time to create 1 rle with old method : 0.06267571449279785 time for calcul the mask position with numpy : 0.0552976131439209 nb_pixel_total : 140394 time to create 1 rle with old method : 0.16101765632629395 time for calcul the mask position with numpy : 0.054553985595703125 nb_pixel_total : 90258 time to create 1 rle with old method : 0.1026148796081543 time for calcul the mask position with numpy : 0.05346536636352539 nb_pixel_total : 194966 time to create 1 rle with new method : 1.6264803409576416 time for calcul the mask position with numpy : 0.05179476737976074 nb_pixel_total : 1501 time to create 1 rle with old method : 0.001773834228515625 time for calcul the mask position with numpy : 0.051773786544799805 nb_pixel_total : 16303 time to create 1 rle with old method : 0.017618417739868164 time for calcul the mask position with numpy : 0.05141901969909668 nb_pixel_total : 35346 time to create 1 rle with old method : 0.03833627700805664 time for calcul the mask position with numpy : 0.05383753776550293 nb_pixel_total : 166769 time to create 1 rle with new method : 1.740281581878662 time for calcul the mask position with numpy : 0.054442644119262695 nb_pixel_total : 254451 time to create 1 rle with new method : 1.338099718093872 time for calcul the mask position with numpy : 0.053465843200683594 nb_pixel_total : 79721 time to create 1 rle with old method : 0.08735537528991699 time for calcul the mask position with numpy : 0.055348873138427734 nb_pixel_total : 312252 time to create 1 rle with new method : 1.4085254669189453 time for calcul the mask position with numpy : 0.05738067626953125 nb_pixel_total : 263818 time to create 1 rle with new method : 1.4355738162994385 time for calcul the mask position with numpy : 0.05509805679321289 nb_pixel_total : 9832 time to create 1 rle with old method : 0.010802030563354492 time for calcul the mask position with numpy : 0.051522254943847656 nb_pixel_total : 63259 time to create 1 rle with old method : 0.06723284721374512 time for calcul the mask position with numpy : 0.05201911926269531 nb_pixel_total : 66203 time to create 1 rle with old method : 0.06981277465820312 time for calcul the mask position with numpy : 0.051110029220581055 nb_pixel_total : 51824 time to create 1 rle with old method : 0.05466961860656738 time for calcul the mask position with numpy : 0.0527348518371582 nb_pixel_total : 259803 time to create 1 rle with new method : 1.515688180923462 time for calcul the mask position with numpy : 0.05228090286254883 nb_pixel_total : 197624 time to create 1 rle with new method : 1.2112388610839844 time for calcul the mask position with numpy : 0.05703568458557129 nb_pixel_total : 4299 time to create 1 rle with old method : 0.004663705825805664 time for calcul the mask position with numpy : 0.05137276649475098 nb_pixel_total : 22514 time to create 1 rle with old method : 0.023688554763793945 time for calcul the mask position with numpy : 0.05096149444580078 nb_pixel_total : 24873 time to create 1 rle with old method : 0.02635645866394043 time for calcul the mask position with numpy : 0.05009770393371582 nb_pixel_total : 254 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.05241513252258301 nb_pixel_total : 116514 time to create 1 rle with old method : 0.12357115745544434 time for calcul the mask position with numpy : 0.05200624465942383 nb_pixel_total : 161150 time to create 1 rle with new method : 1.3508415222167969 time for calcul the mask position with numpy : 0.051833391189575195 nb_pixel_total : 35831 time to create 1 rle with old method : 0.038561344146728516 time for calcul the mask position with numpy : 0.05251121520996094 nb_pixel_total : 205987 time to create 1 rle with new method : 1.233588695526123 time for calcul the mask position with numpy : 0.05098128318786621 nb_pixel_total : 15704 time to create 1 rle with old method : 0.016938447952270508 time for calcul the mask position with numpy : 0.05015420913696289 nb_pixel_total : 3696 time to create 1 rle with old method : 0.004250049591064453 time for calcul the mask position with numpy : 0.0523219108581543 nb_pixel_total : 30834 time to create 1 rle with old method : 0.033620357513427734 time for calcul the mask position with numpy : 0.05169820785522461 nb_pixel_total : 65617 time to create 1 rle with old method : 0.06947112083435059 time for calcul the mask position with numpy : 0.05547022819519043 nb_pixel_total : 9441 time to create 1 rle with old method : 0.010312795639038086 time for calcul the mask position with numpy : 0.05144071578979492 nb_pixel_total : 40601 time to create 1 rle with old method : 0.04225349426269531 time for calcul the mask position with numpy : 0.051879167556762695 nb_pixel_total : 54325 time to create 1 rle with old method : 0.057309865951538086 time for calcul the mask position with numpy : 0.052300214767456055 nb_pixel_total : 12739 time to create 1 rle with old method : 0.013870477676391602 time for calcul the mask position with numpy : 0.05760979652404785 nb_pixel_total : 31970 time to create 1 rle with old method : 0.03521585464477539 time for calcul the mask position with numpy : 0.05386829376220703 nb_pixel_total : 2851 time to create 1 rle with old method : 0.0037810802459716797 time for calcul the mask position with numpy : 0.05476832389831543 nb_pixel_total : 27859 time to create 1 rle with old method : 0.03018045425415039 time for calcul the mask position with numpy : 0.05097460746765137 nb_pixel_total : 27476 time to create 1 rle with old method : 0.0302889347076416 time for calcul the mask position with numpy : 0.052896976470947266 nb_pixel_total : 32338 time to create 1 rle with old method : 0.034630537033081055 create new chi : 40.00013995170593 time to delete rle : 0.007458686828613281 batch 1 Loaded 87 chid ids of type : 4855 Number RLEs to save : 61630 TO DO : save crop sub photo not yet done ! save time : 3.4101357460021973 nb_obj : 74 nb_hashtags : 8 time to prepare the origin masks : 80.15272998809814 time for calcul the mask position with numpy : 0.8376483917236328 nb_pixel_total : 5957002 time to create 1 rle with new method : 1.9101264476776123 time for calcul the mask position with numpy : 0.053502798080444336 nb_pixel_total : 10380 time to create 1 rle with old method : 0.01184988021850586 time for calcul the mask position with numpy : 0.05357766151428223 nb_pixel_total : 7586 time to create 1 rle with old method : 0.008916378021240234 time for calcul the mask position with numpy : 0.053379058837890625 nb_pixel_total : 83719 time to create 1 rle with old method : 0.0926663875579834 time for calcul the mask position with numpy : 0.059619903564453125 nb_pixel_total : 366866 time to create 1 rle with new method : 1.3790266513824463 time for calcul the mask position with numpy : 0.05578875541687012 nb_pixel_total : 387981 time to create 1 rle with new method : 1.9622626304626465 time for calcul the mask position with numpy : 0.05491137504577637 nb_pixel_total : 84531 time to create 1 rle with old method : 0.09591078758239746 time for calcul the mask position with numpy : 0.055939674377441406 nb_pixel_total : 257261 time to create 1 rle with new method : 1.7644314765930176 time for calcul the mask position with numpy : 0.05265522003173828 nb_pixel_total : 72838 time to create 1 rle with old method : 0.08116984367370605 time for calcul the mask position with numpy : 0.05354166030883789 nb_pixel_total : 7817 time to create 1 rle with old method : 0.00904703140258789 time for calcul the mask position with numpy : 0.05388522148132324 nb_pixel_total : 157921 time to create 1 rle with new method : 2.126232147216797 time for calcul the mask position with numpy : 0.053737640380859375 nb_pixel_total : 119061 time to create 1 rle with old method : 0.1295769214630127 time for calcul the mask position with numpy : 0.052846431732177734 nb_pixel_total : 53298 time to create 1 rle with old method : 0.058016061782836914 time for calcul the mask position with numpy : 0.05212283134460449 nb_pixel_total : 200562 time to create 1 rle with new method : 1.5317981243133545 time for calcul the mask position with numpy : 0.054138898849487305 nb_pixel_total : 118201 time to create 1 rle with old method : 0.15012192726135254 time for calcul the mask position with numpy : 0.058344364166259766 nb_pixel_total : 15956 time to create 1 rle with old method : 0.01818537712097168 time for calcul the mask position with numpy : 0.05374288558959961 nb_pixel_total : 16376 time to create 1 rle with old method : 0.018497705459594727 time for calcul the mask position with numpy : 0.05420112609863281 nb_pixel_total : 128175 time to create 1 rle with old method : 0.1687631607055664 time for calcul the mask position with numpy : 0.054021596908569336 nb_pixel_total : 149719 time to create 1 rle with old method : 0.16637802124023438 time for calcul the mask position with numpy : 0.05447268486022949 nb_pixel_total : 1421 time to create 1 rle with old method : 0.0021469593048095703 time for calcul the mask position with numpy : 0.05445671081542969 nb_pixel_total : 9839 time to create 1 rle with old method : 0.010997533798217773 time for calcul the mask position with numpy : 0.05462765693664551 nb_pixel_total : 238904 time to create 1 rle with new method : 1.3258376121520996 time for calcul the mask position with numpy : 0.053267478942871094 nb_pixel_total : 28232 time to create 1 rle with old method : 0.031473636627197266 time for calcul the mask position with numpy : 0.052206993103027344 nb_pixel_total : 61682 time to create 1 rle with old method : 0.0670626163482666 time for calcul the mask position with numpy : 0.052378177642822266 nb_pixel_total : 88650 time to create 1 rle with old method : 0.09524106979370117 time for calcul the mask position with numpy : 0.05129051208496094 nb_pixel_total : 31440 time to create 1 rle with old method : 0.034494876861572266 time for calcul the mask position with numpy : 0.052582740783691406 nb_pixel_total : 67299 time to create 1 rle with old method : 0.07799363136291504 time for calcul the mask position with numpy : 0.060658931732177734 nb_pixel_total : 15927 time to create 1 rle with old method : 0.018450021743774414 time for calcul the mask position with numpy : 0.053231000900268555 nb_pixel_total : 240037 time to create 1 rle with new method : 1.3576977252960205 time for calcul the mask position with numpy : 0.058864593505859375 nb_pixel_total : 5147 time to create 1 rle with old method : 0.005796670913696289 time for calcul the mask position with numpy : 0.053411006927490234 nb_pixel_total : 72350 time to create 1 rle with old method : 0.10132336616516113 time for calcul the mask position with numpy : 0.05508613586425781 nb_pixel_total : 133630 time to create 1 rle with old method : 0.1482257843017578 time for calcul the mask position with numpy : 0.05402708053588867 nb_pixel_total : 40732 time to create 1 rle with old method : 0.04538559913635254 time for calcul the mask position with numpy : 0.053949832916259766 nb_pixel_total : 67824 time to create 1 rle with old method : 0.07624006271362305 time for calcul the mask position with numpy : 0.05280303955078125 nb_pixel_total : 60553 time to create 1 rle with old method : 0.0694422721862793 time for calcul the mask position with numpy : 0.05309128761291504 nb_pixel_total : 19389 time to create 1 rle with old method : 0.022662639617919922 time for calcul the mask position with numpy : 0.056600093841552734 nb_pixel_total : 368212 time to create 1 rle with new method : 1.703890085220337 time for calcul the mask position with numpy : 0.053929805755615234 nb_pixel_total : 15747 time to create 1 rle with old method : 0.01807260513305664 time for calcul the mask position with numpy : 0.05385613441467285 nb_pixel_total : 15688 time to create 1 rle with old method : 0.017683029174804688 time for calcul the mask position with numpy : 0.05871391296386719 nb_pixel_total : 57432 time to create 1 rle with old method : 0.06643462181091309 time for calcul the mask position with numpy : 0.053369998931884766 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009775161743164062 time for calcul the mask position with numpy : 0.05398678779602051 nb_pixel_total : 72303 time to create 1 rle with old method : 0.08020496368408203 time for calcul the mask position with numpy : 0.054556846618652344 nb_pixel_total : 116697 time to create 1 rle with old method : 0.12960028648376465 time for calcul the mask position with numpy : 0.05486702919006348 nb_pixel_total : 145281 time to create 1 rle with old method : 0.1606132984161377 time for calcul the mask position with numpy : 0.057795047760009766 nb_pixel_total : 108453 time to create 1 rle with old method : 0.14516401290893555 time for calcul the mask position with numpy : 0.05394387245178223 nb_pixel_total : 46175 time to create 1 rle with old method : 0.05095815658569336 time for calcul the mask position with numpy : 0.053580284118652344 nb_pixel_total : 63315 time to create 1 rle with old method : 0.07014226913452148 time for calcul the mask position with numpy : 0.05495738983154297 nb_pixel_total : 124506 time to create 1 rle with old method : 0.13781166076660156 time for calcul the mask position with numpy : 0.05715298652648926 nb_pixel_total : 110520 time to create 1 rle with old method : 0.14514470100402832 time for calcul the mask position with numpy : 0.054762840270996094 nb_pixel_total : 109603 time to create 1 rle with old method : 0.12133049964904785 time for calcul the mask position with numpy : 0.05321550369262695 nb_pixel_total : 12483 time to create 1 rle with old method : 0.014098405838012695 time for calcul the mask position with numpy : 0.054459333419799805 nb_pixel_total : 37908 time to create 1 rle with old method : 0.0416414737701416 time for calcul the mask position with numpy : 0.05472707748413086 nb_pixel_total : 5552 time to create 1 rle with old method : 0.0061168670654296875 time for calcul the mask position with numpy : 0.0561368465423584 nb_pixel_total : 61888 time to create 1 rle with old method : 0.06971883773803711 time for calcul the mask position with numpy : 0.05490279197692871 nb_pixel_total : 18234 time to create 1 rle with old method : 0.02060103416442871 time for calcul the mask position with numpy : 0.05490422248840332 nb_pixel_total : 10273 time to create 1 rle with old method : 0.013792991638183594 time for calcul the mask position with numpy : 0.05697917938232422 nb_pixel_total : 50982 time to create 1 rle with old method : 0.05761361122131348 time for calcul the mask position with numpy : 0.05590009689331055 nb_pixel_total : 164510 time to create 1 rle with new method : 1.201218843460083 time for calcul the mask position with numpy : 0.05583381652832031 nb_pixel_total : 321 time to create 1 rle with old method : 0.00044345855712890625 time for calcul the mask position with numpy : 0.05353498458862305 nb_pixel_total : 120921 time to create 1 rle with old method : 0.15816116333007812 time for calcul the mask position with numpy : 0.05380105972290039 nb_pixel_total : 67385 time to create 1 rle with old method : 0.07532644271850586 time for calcul the mask position with numpy : 0.05592608451843262 nb_pixel_total : 72186 time to create 1 rle with old method : 0.08195781707763672 time for calcul the mask position with numpy : 0.05437278747558594 nb_pixel_total : 113136 time to create 1 rle with old method : 0.12686944007873535 time for calcul the mask position with numpy : 0.05445241928100586 nb_pixel_total : 147261 time to create 1 rle with old method : 0.1669323444366455 time for calcul the mask position with numpy : 0.05359625816345215 nb_pixel_total : 166312 time to create 1 rle with new method : 1.7526631355285645 time for calcul the mask position with numpy : 0.06874752044677734 nb_pixel_total : 748517 time to create 1 rle with new method : 1.4647419452667236 time for calcul the mask position with numpy : 0.054090261459350586 nb_pixel_total : 28977 time to create 1 rle with old method : 0.03221011161804199 time for calcul the mask position with numpy : 0.05565333366394043 nb_pixel_total : 60544 time to create 1 rle with old method : 0.06774640083312988 time for calcul the mask position with numpy : 0.0543360710144043 nb_pixel_total : 106393 time to create 1 rle with old method : 0.12468099594116211 time for calcul the mask position with numpy : 0.05459785461425781 nb_pixel_total : 112443 time to create 1 rle with old method : 0.14879202842712402 time for calcul the mask position with numpy : 0.05677533149719238 nb_pixel_total : 39293 time to create 1 rle with old method : 0.046445369720458984 time for calcul the mask position with numpy : 0.058919429779052734 nb_pixel_total : 22232 time to create 1 rle with old method : 0.036139488220214844 time for calcul the mask position with numpy : 0.05800795555114746 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0014870166778564453 time for calcul the mask position with numpy : 0.05500364303588867 nb_pixel_total : 61824 time to create 1 rle with old method : 0.08933687210083008 time for calcul the mask position with numpy : 0.052442073822021484 nb_pixel_total : 15360 time to create 1 rle with old method : 0.017101049423217773 create new chi : 29.304641485214233 time to delete rle : 0.0059888362884521484 batch 1 Loaded 75 chid ids of type : 4855 Number RLEs to save : 50164 TO DO : save crop sub photo not yet done ! save time : 2.8016536235809326 nb_obj : 84 nb_hashtags : 11 time to prepare the origin masks : 85.3756172657013 time for calcul the mask position with numpy : 0.2705211639404297 nb_pixel_total : 4772117 time to create 1 rle with new method : 2.166696548461914 time for calcul the mask position with numpy : 0.05433464050292969 nb_pixel_total : 6260 time to create 1 rle with old method : 0.007569313049316406 time for calcul the mask position with numpy : 0.055886268615722656 nb_pixel_total : 32359 time to create 1 rle with old method : 0.05105137825012207 time for calcul the mask position with numpy : 0.05482125282287598 nb_pixel_total : 53784 time to create 1 rle with old method : 0.06086921691894531 time for calcul the mask position with numpy : 0.05529284477233887 nb_pixel_total : 141165 time to create 1 rle with old method : 0.15825867652893066 time for calcul the mask position with numpy : 0.052790164947509766 nb_pixel_total : 95839 time to create 1 rle with old method : 0.10466814041137695 time for calcul the mask position with numpy : 0.054314613342285156 nb_pixel_total : 27076 time to create 1 rle with old method : 0.029724597930908203 time for calcul the mask position with numpy : 0.05227065086364746 nb_pixel_total : 43909 time to create 1 rle with old method : 0.04786181449890137 time for calcul the mask position with numpy : 0.05110478401184082 nb_pixel_total : 55891 time to create 1 rle with old method : 0.05826687812805176 time for calcul the mask position with numpy : 0.05950498580932617 nb_pixel_total : 668619 time to create 1 rle with new method : 1.2662711143493652 time for calcul the mask position with numpy : 0.05146384239196777 nb_pixel_total : 15471 time to create 1 rle with old method : 0.01735401153564453 time for calcul the mask position with numpy : 0.05394887924194336 nb_pixel_total : 1573 time to create 1 rle with old method : 0.0019168853759765625 time for calcul the mask position with numpy : 0.05068039894104004 nb_pixel_total : 43453 time to create 1 rle with old method : 0.04541730880737305 time for calcul the mask position with numpy : 0.05043482780456543 nb_pixel_total : 69060 time to create 1 rle with old method : 0.07881975173950195 time for calcul the mask position with numpy : 0.05430173873901367 nb_pixel_total : 28211 time to create 1 rle with old method : 0.03150439262390137 time for calcul the mask position with numpy : 0.052088260650634766 nb_pixel_total : 29525 time to create 1 rle with old method : 0.03200244903564453 time for calcul the mask position with numpy : 0.05184197425842285 nb_pixel_total : 35221 time to create 1 rle with old method : 0.03750038146972656 time for calcul the mask position with numpy : 0.05130791664123535 nb_pixel_total : 13961 time to create 1 rle with old method : 0.014964103698730469 time for calcul the mask position with numpy : 0.05230903625488281 nb_pixel_total : 2577 time to create 1 rle with old method : 0.002991914749145508 time for calcul the mask position with numpy : 0.051503658294677734 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005426406860351562 time for calcul the mask position with numpy : 0.05203104019165039 nb_pixel_total : 4149 time to create 1 rle with old method : 0.004928112030029297 time for calcul the mask position with numpy : 0.05963277816772461 nb_pixel_total : 432459 time to create 1 rle with new method : 2.7593467235565186 time for calcul the mask position with numpy : 0.07427501678466797 nb_pixel_total : 81164 time to create 1 rle with old method : 0.14492511749267578 time for calcul the mask position with numpy : 0.07312798500061035 nb_pixel_total : 99740 time to create 1 rle with old method : 0.17969298362731934 time for calcul the mask position with numpy : 0.07074284553527832 nb_pixel_total : 53195 time to create 1 rle with old method : 0.0905604362487793 time for calcul the mask position with numpy : 0.0706796646118164 nb_pixel_total : 96865 time to create 1 rle with old method : 0.16760993003845215 time for calcul the mask position with numpy : 0.07354736328125 nb_pixel_total : 20192 time to create 1 rle with old method : 0.022932767868041992 time for calcul the mask position with numpy : 0.07339692115783691 nb_pixel_total : 364848 time to create 1 rle with new method : 3.1247732639312744 time for calcul the mask position with numpy : 0.0537257194519043 nb_pixel_total : 82700 time to create 1 rle with old method : 0.08773565292358398 time for calcul the mask position with numpy : 0.05226778984069824 nb_pixel_total : 79387 time to create 1 rle with old method : 0.0837557315826416 time for calcul the mask position with numpy : 0.053896427154541016 nb_pixel_total : 22592 time to create 1 rle with old method : 0.02556324005126953 time for calcul the mask position with numpy : 0.061608314514160156 nb_pixel_total : 29237 time to create 1 rle with old method : 0.050991058349609375 time for calcul the mask position with numpy : 0.06114935874938965 nb_pixel_total : 486380 time to create 1 rle with new method : 1.476111650466919 time for calcul the mask position with numpy : 0.05237746238708496 nb_pixel_total : 62055 time to create 1 rle with old method : 0.06741714477539062 time for calcul the mask position with numpy : 0.05307197570800781 nb_pixel_total : 57655 time to create 1 rle with old method : 0.061969757080078125 time for calcul the mask position with numpy : 0.05278158187866211 nb_pixel_total : 3973 time to create 1 rle with old method : 0.0048885345458984375 time for calcul the mask position with numpy : 0.05327320098876953 nb_pixel_total : 116679 time to create 1 rle with old method : 0.1271963119506836 time for calcul the mask position with numpy : 0.05846691131591797 nb_pixel_total : 29700 time to create 1 rle with old method : 0.033936500549316406 time for calcul the mask position with numpy : 0.053865909576416016 nb_pixel_total : 204257 time to create 1 rle with new method : 2.244598150253296 time for calcul the mask position with numpy : 0.052022457122802734 nb_pixel_total : 4429 time to create 1 rle with old method : 0.005655050277709961 time for calcul the mask position with numpy : 0.05358457565307617 nb_pixel_total : 139179 time to create 1 rle with old method : 0.1528642177581787 time for calcul the mask position with numpy : 0.05223369598388672 nb_pixel_total : 23225 time to create 1 rle with old method : 0.026250362396240234 time for calcul the mask position with numpy : 0.053057193756103516 nb_pixel_total : 2459 time to create 1 rle with old method : 0.0029914379119873047 time for calcul the mask position with numpy : 0.05475497245788574 nb_pixel_total : 74528 time to create 1 rle with old method : 0.08223748207092285 time for calcul the mask position with numpy : 0.05238938331604004 nb_pixel_total : 18688 time to create 1 rle with old method : 0.020211219787597656 time for calcul the mask position with numpy : 0.0510861873626709 nb_pixel_total : 63481 time to create 1 rle with old method : 0.06789278984069824 time for calcul the mask position with numpy : 0.052652835845947266 nb_pixel_total : 92906 time to create 1 rle with old method : 0.09878182411193848 time for calcul the mask position with numpy : 0.050948381423950195 nb_pixel_total : 75621 time to create 1 rle with old method : 0.07982468605041504 time for calcul the mask position with numpy : 0.05080413818359375 nb_pixel_total : 60003 time to create 1 rle with old method : 0.06434369087219238 time for calcul the mask position with numpy : 0.0516202449798584 nb_pixel_total : 66043 time to create 1 rle with old method : 0.06982064247131348 time for calcul the mask position with numpy : 0.05097675323486328 nb_pixel_total : 35814 time to create 1 rle with old method : 0.037755489349365234 time for calcul the mask position with numpy : 0.05023193359375 nb_pixel_total : 31252 time to create 1 rle with old method : 0.03349924087524414 time for calcul the mask position with numpy : 0.050771474838256836 nb_pixel_total : 69249 time to create 1 rle with old method : 0.07427072525024414 time for calcul the mask position with numpy : 0.05210590362548828 nb_pixel_total : 27543 time to create 1 rle with old method : 0.029304027557373047 time for calcul the mask position with numpy : 0.055234432220458984 nb_pixel_total : 500786 time to create 1 rle with new method : 2.3279197216033936 time for calcul the mask position with numpy : 0.055597543716430664 nb_pixel_total : 417682 time to create 1 rle with new method : 2.033703565597534 time for calcul the mask position with numpy : 0.051293134689331055 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0016732215881347656 time for calcul the mask position with numpy : 0.05123114585876465 nb_pixel_total : 37884 time to create 1 rle with old method : 0.04076814651489258 time for calcul the mask position with numpy : 0.06408166885375977 nb_pixel_total : 1107543 time to create 1 rle with new method : 2.5073375701904297 time for calcul the mask position with numpy : 0.05277657508850098 nb_pixel_total : 70911 time to create 1 rle with old method : 0.09535646438598633 time for calcul the mask position with numpy : 0.0587923526763916 nb_pixel_total : 16009 time to create 1 rle with old method : 0.018723726272583008 time for calcul the mask position with numpy : 0.05443286895751953 nb_pixel_total : 26909 time to create 1 rle with old method : 0.030231475830078125 time for calcul the mask position with numpy : 0.054895877838134766 nb_pixel_total : 149240 time to create 1 rle with old method : 0.17062878608703613 time for calcul the mask position with numpy : 0.055811166763305664 nb_pixel_total : 71361 time to create 1 rle with old method : 0.08306670188903809 time for calcul the mask position with numpy : 0.054193735122680664 nb_pixel_total : 1540 time to create 1 rle with old method : 0.002181529998779297 time for calcul the mask position with numpy : 0.05431389808654785 nb_pixel_total : 3365 time to create 1 rle with old method : 0.006055593490600586 time for calcul the mask position with numpy : 0.059673309326171875 nb_pixel_total : 197 time to create 1 rle with old method : 0.0005221366882324219 time for calcul the mask position with numpy : 0.056967973709106445 nb_pixel_total : 116993 time to create 1 rle with old method : 0.14494037628173828 time for calcul the mask position with numpy : 0.06010723114013672 nb_pixel_total : 426797 time to create 1 rle with new method : 2.062934637069702 time for calcul the mask position with numpy : 0.053559303283691406 nb_pixel_total : 28381 time to create 1 rle with old method : 0.03234434127807617 time for calcul the mask position with numpy : 0.05234479904174805 nb_pixel_total : 44372 time to create 1 rle with old method : 0.04735827445983887 time for calcul the mask position with numpy : 0.05147123336791992 nb_pixel_total : 45567 time to create 1 rle with old method : 0.04866671562194824 time for calcul the mask position with numpy : 0.05365562438964844 nb_pixel_total : 164177 time to create 1 rle with new method : 1.1766078472137451 time for calcul the mask position with numpy : 0.05284380912780762 nb_pixel_total : 13781 time to create 1 rle with old method : 0.015185117721557617 time for calcul the mask position with numpy : 0.054621219635009766 nb_pixel_total : 122414 time to create 1 rle with old method : 0.13653802871704102 time for calcul the mask position with numpy : 0.0554194450378418 nb_pixel_total : 140232 time to create 1 rle with old method : 0.15608692169189453 time for calcul the mask position with numpy : 0.05380415916442871 nb_pixel_total : 16877 time to create 1 rle with old method : 0.0195770263671875 time for calcul the mask position with numpy : 0.061662912368774414 nb_pixel_total : 9967 time to create 1 rle with old method : 0.01638317108154297 time for calcul the mask position with numpy : 0.054744720458984375 nb_pixel_total : 249 time to create 1 rle with old method : 0.0004956722259521484 time for calcul the mask position with numpy : 0.051436424255371094 nb_pixel_total : 39575 time to create 1 rle with old method : 0.042497873306274414 time for calcul the mask position with numpy : 0.05351138114929199 nb_pixel_total : 75290 time to create 1 rle with old method : 0.08585357666015625 time for calcul the mask position with numpy : 0.05309247970581055 nb_pixel_total : 63267 time to create 1 rle with old method : 0.0696108341217041 time for calcul the mask position with numpy : 0.05233621597290039 nb_pixel_total : 2313 time to create 1 rle with old method : 0.002706766128540039 time for calcul the mask position with numpy : 0.05137228965759277 nb_pixel_total : 15852 time to create 1 rle with old method : 0.016956567764282227 time for calcul the mask position with numpy : 0.05260181427001953 nb_pixel_total : 311 time to create 1 rle with old method : 0.00037980079650878906 create new chi : 32.70215058326721 time to delete rle : 0.006674766540527344 batch 1 Loaded 85 chid ids of type : 4855 Number RLEs to save : 54207 TO DO : save crop sub photo not yet done ! save time : 2.9574694633483887 nb_obj : 66 nb_hashtags : 8 time to prepare the origin masks : 63.01190686225891 time for calcul the mask position with numpy : 0.3514881134033203 nb_pixel_total : 7200074 time to create 1 rle with new method : 0.8101756572723389 time for calcul the mask position with numpy : 0.054994821548461914 nb_pixel_total : 257974 time to create 1 rle with new method : 0.7648818492889404 time for calcul the mask position with numpy : 0.052652835845947266 nb_pixel_total : 2918 time to create 1 rle with old method : 0.0036840438842773438 time for calcul the mask position with numpy : 0.05208849906921387 nb_pixel_total : 39580 time to create 1 rle with old method : 0.041109323501586914 time for calcul the mask position with numpy : 0.05503535270690918 nb_pixel_total : 352210 time to create 1 rle with new method : 0.6131658554077148 time for calcul the mask position with numpy : 0.05240154266357422 nb_pixel_total : 298057 time to create 1 rle with new method : 0.749824047088623 time for calcul the mask position with numpy : 0.05188417434692383 nb_pixel_total : 21159 time to create 1 rle with old method : 0.026273250579833984 time for calcul the mask position with numpy : 0.051640987396240234 nb_pixel_total : 108119 time to create 1 rle with old method : 0.11720490455627441 time for calcul the mask position with numpy : 0.051389217376708984 nb_pixel_total : 9872 time to create 1 rle with old method : 0.010845184326171875 time for calcul the mask position with numpy : 0.05299806594848633 nb_pixel_total : 105248 time to create 1 rle with old method : 0.11334419250488281 time for calcul the mask position with numpy : 0.056119680404663086 nb_pixel_total : 12984 time to create 1 rle with old method : 0.014800786972045898 time for calcul the mask position with numpy : 0.05494999885559082 nb_pixel_total : 162240 time to create 1 rle with new method : 0.6848797798156738 time for calcul the mask position with numpy : 0.05112433433532715 nb_pixel_total : 27173 time to create 1 rle with old method : 0.028549909591674805 time for calcul the mask position with numpy : 0.051662445068359375 nb_pixel_total : 26511 time to create 1 rle with old method : 0.02898430824279785 time for calcul the mask position with numpy : 0.052643537521362305 nb_pixel_total : 22355 time to create 1 rle with old method : 0.024255752563476562 time for calcul the mask position with numpy : 0.0524594783782959 nb_pixel_total : 1977 time to create 1 rle with old method : 0.002440929412841797 time for calcul the mask position with numpy : 0.05133986473083496 nb_pixel_total : 50812 time to create 1 rle with old method : 0.054666996002197266 time for calcul the mask position with numpy : 0.050655364990234375 nb_pixel_total : 15014 time to create 1 rle with old method : 0.016005516052246094 time for calcul the mask position with numpy : 0.050409793853759766 nb_pixel_total : 197 time to create 1 rle with old method : 0.00033092498779296875 time for calcul the mask position with numpy : 0.05142021179199219 nb_pixel_total : 57653 time to create 1 rle with old method : 0.06051445007324219 time for calcul the mask position with numpy : 0.05328679084777832 nb_pixel_total : 235214 time to create 1 rle with new method : 0.7230122089385986 time for calcul the mask position with numpy : 0.0515446662902832 nb_pixel_total : 22100 time to create 1 rle with old method : 0.02381420135498047 time for calcul the mask position with numpy : 0.05190157890319824 nb_pixel_total : 44498 time to create 1 rle with old method : 0.05280900001525879 time for calcul the mask position with numpy : 0.05382394790649414 nb_pixel_total : 294412 time to create 1 rle with new method : 0.5950148105621338 time for calcul the mask position with numpy : 0.052747249603271484 nb_pixel_total : 120989 time to create 1 rle with old method : 0.1307981014251709 time for calcul the mask position with numpy : 0.0523684024810791 nb_pixel_total : 48248 time to create 1 rle with old method : 0.053194284439086914 time for calcul the mask position with numpy : 0.053321123123168945 nb_pixel_total : 154577 time to create 1 rle with new method : 0.6024875640869141 time for calcul the mask position with numpy : 0.0548553466796875 nb_pixel_total : 164106 time to create 1 rle with new method : 0.7015860080718994 time for calcul the mask position with numpy : 0.05457425117492676 nb_pixel_total : 37644 time to create 1 rle with old method : 0.042697906494140625 time for calcul the mask position with numpy : 0.05449080467224121 nb_pixel_total : 114285 time to create 1 rle with old method : 0.12836217880249023 time for calcul the mask position with numpy : 0.05473589897155762 nb_pixel_total : 138645 time to create 1 rle with old method : 0.17848849296569824 time for calcul the mask position with numpy : 0.05418086051940918 nb_pixel_total : 59801 time to create 1 rle with old method : 0.06760811805725098 time for calcul the mask position with numpy : 0.05412030220031738 nb_pixel_total : 40705 time to create 1 rle with old method : 0.046233177185058594 time for calcul the mask position with numpy : 0.05295848846435547 nb_pixel_total : 9900 time to create 1 rle with old method : 0.011467933654785156 time for calcul the mask position with numpy : 0.05391430854797363 nb_pixel_total : 243112 time to create 1 rle with new method : 0.5889811515808105 time for calcul the mask position with numpy : 0.05241894721984863 nb_pixel_total : 27000 time to create 1 rle with old method : 0.02870464324951172 time for calcul the mask position with numpy : 0.05114102363586426 nb_pixel_total : 3526 time to create 1 rle with old method : 0.004464626312255859 time for calcul the mask position with numpy : 0.05559182167053223 nb_pixel_total : 360048 time to create 1 rle with new method : 0.6572728157043457 time for calcul the mask position with numpy : 0.05173206329345703 nb_pixel_total : 75229 time to create 1 rle with old method : 0.08592724800109863 time for calcul the mask position with numpy : 0.05118131637573242 nb_pixel_total : 3882 time to create 1 rle with old method : 0.004553794860839844 time for calcul the mask position with numpy : 0.05093669891357422 nb_pixel_total : 11080 time to create 1 rle with old method : 0.011804819107055664 time for calcul the mask position with numpy : 0.05127358436584473 nb_pixel_total : 145951 time to create 1 rle with old method : 0.15254640579223633 time for calcul the mask position with numpy : 0.05167818069458008 nb_pixel_total : 105125 time to create 1 rle with old method : 0.11197757720947266 time for calcul the mask position with numpy : 0.052449941635131836 nb_pixel_total : 59315 time to create 1 rle with old method : 0.06448698043823242 time for calcul the mask position with numpy : 0.052258968353271484 nb_pixel_total : 26600 time to create 1 rle with old method : 0.029737234115600586 time for calcul the mask position with numpy : 0.05256795883178711 nb_pixel_total : 38018 time to create 1 rle with old method : 0.04138517379760742 time for calcul the mask position with numpy : 0.054434776306152344 nb_pixel_total : 403498 time to create 1 rle with new method : 0.7301962375640869 time for calcul the mask position with numpy : 0.05349087715148926 nb_pixel_total : 190265 time to create 1 rle with new method : 0.6090283393859863 time for calcul the mask position with numpy : 0.05163979530334473 nb_pixel_total : 36368 time to create 1 rle with old method : 0.03966045379638672 time for calcul the mask position with numpy : 0.055403709411621094 nb_pixel_total : 157073 time to create 1 rle with new method : 0.6265244483947754 time for calcul the mask position with numpy : 0.05716824531555176 nb_pixel_total : 52333 time to create 1 rle with old method : 0.05655813217163086 time for calcul the mask position with numpy : 0.05208444595336914 nb_pixel_total : 3747 time to create 1 rle with old method : 0.004784107208251953 time for calcul the mask position with numpy : 0.05541205406188965 nb_pixel_total : 61572 time to create 1 rle with old method : 0.06643128395080566 time for calcul the mask position with numpy : 0.05301976203918457 nb_pixel_total : 79372 time to create 1 rle with old method : 0.08649778366088867 time for calcul the mask position with numpy : 0.05283617973327637 nb_pixel_total : 155205 time to create 1 rle with new method : 0.7399897575378418 time for calcul the mask position with numpy : 0.05407142639160156 nb_pixel_total : 7471 time to create 1 rle with old method : 0.008611440658569336 time for calcul the mask position with numpy : 0.05626225471496582 nb_pixel_total : 22325 time to create 1 rle with old method : 0.024161815643310547 time for calcul the mask position with numpy : 0.052544355392456055 nb_pixel_total : 17025 time to create 1 rle with old method : 0.018544912338256836 time for calcul the mask position with numpy : 0.05320429801940918 nb_pixel_total : 15406 time to create 1 rle with old method : 0.017034292221069336 time for calcul the mask position with numpy : 0.051836252212524414 nb_pixel_total : 9066 time to create 1 rle with old method : 0.009806632995605469 time for calcul the mask position with numpy : 0.05228734016418457 nb_pixel_total : 26723 time to create 1 rle with old method : 0.02894449234008789 time for calcul the mask position with numpy : 0.054283857345581055 nb_pixel_total : 108115 time to create 1 rle with old method : 0.11649560928344727 time for calcul the mask position with numpy : 0.05564594268798828 nb_pixel_total : 157036 time to create 1 rle with new method : 0.6874403953552246 time for calcul the mask position with numpy : 0.05080103874206543 nb_pixel_total : 65748 time to create 1 rle with old method : 0.06893515586853027 time for calcul the mask position with numpy : 0.05017256736755371 nb_pixel_total : 20711 time to create 1 rle with old method : 0.02171945571899414 time for calcul the mask position with numpy : 0.050679922103881836 nb_pixel_total : 33996 time to create 1 rle with old method : 0.036655426025390625 time for calcul the mask position with numpy : 0.050788164138793945 nb_pixel_total : 8 time to create 1 rle with old method : 5.269050598144531e-05 create new chi : 17.849897384643555 time to delete rle : 0.003641843795776367 batch 1 Loaded 67 chid ids of type : 4855 Number RLEs to save : 42758 TO DO : save crop sub photo not yet done ! save time : 2.458016872406006 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 33.407129526138306 time for calcul the mask position with numpy : 0.08779311180114746 nb_pixel_total : 1860093 time to create 1 rle with new method : 0.8485970497131348 time for calcul the mask position with numpy : 0.0716090202331543 nb_pixel_total : 22243 time to create 1 rle with old method : 0.0249788761138916 time for calcul the mask position with numpy : 0.06130623817443848 nb_pixel_total : 71423 time to create 1 rle with old method : 0.08034658432006836 time for calcul the mask position with numpy : 0.04118466377258301 nb_pixel_total : 44935 time to create 1 rle with old method : 0.06229424476623535 time for calcul the mask position with numpy : 0.04403829574584961 nb_pixel_total : 30861 time to create 1 rle with old method : 0.03500056266784668 time for calcul the mask position with numpy : 0.046509742736816406 nb_pixel_total : 748194 time to create 1 rle with new method : 1.0162403583526611 time for calcul the mask position with numpy : 0.040430307388305664 nb_pixel_total : 198110 time to create 1 rle with new method : 0.6656322479248047 time for calcul the mask position with numpy : 0.0497736930847168 nb_pixel_total : 1674173 time to create 1 rle with new method : 1.5572843551635742 time for calcul the mask position with numpy : 0.042577266693115234 nb_pixel_total : 61569 time to create 1 rle with old method : 0.0686652660369873 time for calcul the mask position with numpy : 0.051007747650146484 nb_pixel_total : 1166035 time to create 1 rle with new method : 0.7631738185882568 time for calcul the mask position with numpy : 0.041001081466674805 nb_pixel_total : 25936 time to create 1 rle with old method : 0.02894449234008789 time for calcul the mask position with numpy : 0.38339948654174805 nb_pixel_total : 7075628 time to create 1 rle with new method : 0.5405192375183105 create new chi : 6.926607370376587 time to delete rle : 0.0022611618041992188 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 21499 TO DO : save crop sub photo not yet done ! save time : 1.2277238368988037 nb_obj : 7 nb_hashtags : 5 time to prepare the origin masks : 17.665083646774292 time for calcul the mask position with numpy : 0.07517719268798828 nb_pixel_total : 1613632 time to create 1 rle with new method : 1.8799269199371338 time for calcul the mask position with numpy : 0.06064438819885254 nb_pixel_total : 139820 time to create 1 rle with old method : 0.15613317489624023 time for calcul the mask position with numpy : 0.05558943748474121 nb_pixel_total : 55198 time to create 1 rle with old method : 0.06296920776367188 time for calcul the mask position with numpy : 0.057274580001831055 nb_pixel_total : 598581 time to create 1 rle with new method : 1.9622066020965576 time for calcul the mask position with numpy : 0.0603938102722168 nb_pixel_total : 15957 time to create 1 rle with old method : 0.020230531692504883 time for calcul the mask position with numpy : 0.052477359771728516 nb_pixel_total : 115887 time to create 1 rle with old method : 0.13449621200561523 time for calcul the mask position with numpy : 0.0626840591430664 nb_pixel_total : 399164 time to create 1 rle with new method : 0.8831262588500977 time for calcul the mask position with numpy : 1.1927168369293213 nb_pixel_total : 10040961 time to create 1 rle with new method : 0.8823239803314209 create new chi : 7.8515849113464355 time to delete rle : 0.0021157264709472656 batch 1 Loaded 8 chid ids of type : 4855 Number RLEs to save : 21665 TO DO : save crop sub photo not yet done ! save time : 1.316178560256958 map_output_result : {1356331857: (0.4743222440550498, 'Should be the crop_list due to order', 0.8434010071024324), 1356331848: (0.4743222440550498, 'Should be the crop_list due to order', 0.7839280438596407), 1356331842: (0.4743222440550498, 'Should be the crop_list due to order', 0.7947686257908652), 1356331838: (0.4743222440550498, 'Should be the crop_list due to order', 0.25318758112898443), 1356331817: (0.4743222440550498, 'Should be the crop_list due to order', 0.3440792665064079), 1356331815: (0.4743222440550498, 'Should be the crop_list due to order', 0.2897363620334291), 1356331809: (0.4743222440550498, 'Should be the crop_list due to order', 0.15698173060205653), 1356331801: (0.4743222440550498, 'Should be the crop_list due to order', 0.42388864457512354), 1356331794: (0.4743222440550498, 'Should be the crop_list due to order', 0.3111618635130604), 1356331788: (0.4743222440550498, 'Should be the crop_list due to order', 0.39059099659359586), 1356331771: (0.4743222440550498, 'Should be the crop_list due to order', 0.6258205628999512)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 11 /1356331857.Didn't retrieve data . /1356331848.Didn't retrieve data . /1356331842.Didn't retrieve data . /1356331838.Didn't retrieve data . /1356331817.Didn't retrieve data . /1356331815.Didn't retrieve data . /1356331809.Didn't retrieve data . /1356331801.Didn't retrieve data . /1356331794.Didn't retrieve data . /1356331788.Didn't retrieve data . /1356331771.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.012219667434692383 save_final save missing photos in datou_result : time spend for datou_step_exec : 813.544022321701 time spend to save output : 0.017092466354370117 total time spend for step 5 : 813.5611147880554 step6:crop_condition Tue May 6 13:03:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 449 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3015255 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529472_771234 we have uploaded 43 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.688155174255371 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 102 About to insert : list_path_to_insert length 102 new photo from crops ! About to upload 102 photos upload in portfolio : 3015255 init cache_photo without model_param we have 102 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529545_771234 we have uploaded 102 photos in the portfolio 3015255 time of upload the photos Elapsed time : 25.160030126571655 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3015255 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529583_771234 we have uploaded 29 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.842464447021484 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3015255 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529598_771234 we have uploaded 6 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.6201810836791992 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529604_771234 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7376375198364258 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529609_771234 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.49451613426208496 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3015255 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529656_771234 we have uploaded 36 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.71776008605957 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529670_771234 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8014481067657471 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3015255 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529709_771234 we have uploaded 47 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.227068901062012 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529729_771234 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5999307632446289 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746529737_771234 we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.895481586456299 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! About to upload 61 photos upload in portfolio : 3015255 init cache_photo without model_param we have 61 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746530064_771234 we have uploaded 61 photos in the portfolio 3015255 time of upload the photos Elapsed time : 21.673658847808838 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 339 /1356349415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356349999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356350695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356351885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1028 time used for this insertion : 0.08204984664916992 save_final save missing photos in datou_result : time spend for datou_step_exec : 683.7929086685181 time spend to save output : 0.21133995056152344 total time spend for step 6 : 684.0042486190796 step7:ventilate_hashtags_in_portfolio Tue May 6 13:14:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22713611 get user id for portfolio 22713611 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713611 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713611 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713611 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713611 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22715642,22715643,22715644,22715645,22715646,22715651,22715653,22715654,22715655,22715656,22715657,22715658,22715660,22715661,22715662,22715663,22715664,22715665,22715666,22715667?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22713611 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 1 /22713611. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014020442962646484 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.220493316650391 time spend to save output : 0.014319896697998047 total time spend for step 7 : 4.234813213348389 step8:final Tue May 6 13:14:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356331857: ('0.41588060852915326',), 1356331848: ('0.41588060852915326',), 1356331842: ('0.41588060852915326',), 1356331838: ('0.41588060852915326',), 1356331817: ('0.41588060852915326',), 1356331815: ('0.41588060852915326',), 1356331809: ('0.41588060852915326',), 1356331801: ('0.41588060852915326',), 1356331794: ('0.41588060852915326',), 1356331788: ('0.41588060852915326',), 1356331771: ('0.41588060852915326',)} new output for save of step final : {1356331857: ('0.41588060852915326',), 1356331848: ('0.41588060852915326',), 1356331842: ('0.41588060852915326',), 1356331838: ('0.41588060852915326',), 1356331817: ('0.41588060852915326',), 1356331815: ('0.41588060852915326',), 1356331809: ('0.41588060852915326',), 1356331801: ('0.41588060852915326',), 1356331794: ('0.41588060852915326',), 1356331788: ('0.41588060852915326',), 1356331771: ('0.41588060852915326',)} [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 11 /1356331857.Didn't retrieve data . /1356331848.Didn't retrieve data . /1356331842.Didn't retrieve data . /1356331838.Didn't retrieve data . /1356331817.Didn't retrieve data . /1356331815.Didn't retrieve data . /1356331809.Didn't retrieve data . /1356331801.Didn't retrieve data . /1356331794.Didn't retrieve data . /1356331788.Didn't retrieve data . /1356331771.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013087749481201172 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11575126647949219 time spend to save output : 0.01395416259765625 total time spend for step 8 : 0.12970542907714844 step9:velours_tree Tue May 6 13:14:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 2.012178421020508 time spend to save output : 3.6716461181640625e-05 total time spend for step 9 : 2.0122151374816895 step10:send_mail_cod Tue May 6 13:14:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22713611_06-05-2025_13_14_57.pdf 22715616 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156161746530097 22715617 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156171746530098 22715618 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156181746530105 22715619 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156191746530106 22715620 change filename to text .imagette227156201746530107 22715621 change filename to text .imagette227156211746530107 22715622 imagette227156221746530107 22715623 imagette227156231746530107 22715624 imagette227156241746530107 22715625 imagette227156251746530107 22715626 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156261746530107 22715627 change filename to text .change filename to text .imagette227156271746530109 22715628 imagette227156281746530109 22715629 imagette227156291746530109 22715630 imagette227156301746530109 22715631 imagette227156311746530109 22715632 imagette227156321746530109 22715633 change filename to text .imagette227156331746530109 22715634 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156341746530109 22715636 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227156361746530110 22715637 imagette227156371746530112 22715638 imagette227156381746530112 22715639 imagette227156391746530112 22715640 imagette227156401746530112 22715641 imagette227156411746530112 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22713611 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22715642,22715643,22715644,22715645,22715646,22715651,22715653,22715654,22715655,22715656,22715657,22715658,22715660,22715661,22715662,22715663,22715664,22715665,22715666,22715667?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22713611 your option no_mail is active, we will not send the real mail to your client args[1356331857] : ((1356331857, 1463.932058360798, 2107751945), (1356331857, -0.9554088244022896, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331848] : ((1356331848, 526.568480341672, 492688767), (1356331848, -0.7581252344542273, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331842] : ((1356331842, 760.7985054079087, 492688767), (1356331842, -0.9174561625951911, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331838] : ((1356331838, 89.60640022278695, 492688767), (1356331838, -0.32997848049692396, 496442774), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331817] : ((1356331817, 2626.0154200285915, 492609224), (1356331817, -0.5413616194575115, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331815] : ((1356331815, 1376.1698391603493, 2107751945), (1356331815, -0.25560121960640053, 496442774), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331809] : ((1356331809, 3936.0375646567954, 492609224), (1356331809, -0.40232087001211253, 496442774), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331801] : ((1356331801, 2200.094558085102, 492609224), (1356331801, -0.31651349364087333, 496442774), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331794] : ((1356331794, 2130.3089572045974, 492609224), (1356331794, -0.5289655501976199, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331788] : ((1356331788, 1055.1590120336348, 2107751945), (1356331788, -0.8813127156627181, 501862349), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356331771] : ((1356331771, 93.78120770908892, 492688767), (1356331771, -0.2087638744030891, 496442774), '0.41588060852915326') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.41588060852915326 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713611_06-05-2025_13_14_57.pdf results_Auto_P22713611_06-05-2025_13_14_57.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713611_06-05-2025_13_14_57.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22713611','results_Auto_P22713611_06-05-2025_13_14_57.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713611_06-05-2025_13_14_57.pdf','pdf','','2.42','0.41588060852915326') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013914108276367188 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.40742063522339 time spend to save output : 0.014249086380004883 total time spend for step 10 : 19.421669721603394 step11:split_time_score Tue May 6 13:15:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('01', 2), ('02', 2), ('03', 3), ('10', 1), ('11', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01052025 22713611 Nombre de photos uploadées : 11 / 23040 (0%) 01052025 22713611 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 01052025 22713611 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008130073547363281 elapsed_time : insert_dashboard_record_day_entry 0.023802995681762695 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.39026506267119515 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713349_06-05-2025_12_09_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713349 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713349 AND mptpi.`type`=4855 To do Qualite : 0.41588060852915326 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713611_06-05-2025_13_14_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713611 AND mptpi.`type`=4855 To do Qualite : 0.3116130851449679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713612_06-05-2025_12_01_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713612 AND mptpi.`type`=4855 To do Qualite : 0.4894512328470049 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22713613_06-05-2025_12_16_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22713613 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22713613 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356331857, 1356331848, 1356331842, 1356331838, 1356331817, 1356331815, 1356331809, 1356331801, 1356331794, 1356331788, 1356331771] Looping around the photos to save general results len do output : 1 /22713611Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331857', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331848', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331842', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331838', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331817', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331815', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331809', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331801', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331794', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331788', None, None, None, None, None, '2797353') ('4741', None, None, None, None, None, None, None, '2797353') ('4741', '22713611', '1356331771', None, None, None, None, None, '2797353') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014128923416137695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.43413829803466797 time spend to save output : 0.014387845993041992 total time spend for step 11 : 0.44852614402770996 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 1064.24user 812.24system 33:51.60elapsed 92%CPU (0avgtext+0avgdata 6858216maxresident)k 14684648inputs+1144016outputs (514442major+75602706minor)pagefaults 0swaps