python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3385930 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2924663'] with mtr_portfolio_ids : ['23212383'] and first list_photo_ids : [] new path : /proc/3385930/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.8700838088989258 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed May 21 16:21:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 16:21:31.189743: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 16:21:31.215181: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 16:21:31.216766: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f334c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 16:21:31.216812: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 16:21:31.219751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 16:21:31.362393: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x786adb0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 16:21:31.362442: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 16:21:31.363468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:21:31.363815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:21:31.388685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:21:31.391215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:21:31.391675: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:21:31.395066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:21:31.396520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:21:31.402892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:21:31.404411: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:21:31.404502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:21:31.405283: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 16:21:31.405300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 16:21:31.405309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 16:21:31.406623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 16:21:31.689906: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:21:31.690050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:21:31.690077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:21:31.690095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:21:31.690113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:21:31.690130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:21:31.690147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:21:31.690167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:21:31.691439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:21:31.692859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:21:31.692900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:21:31.692918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:21:31.692936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:21:31.692970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:21:31.692988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:21:31.693003: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:21:31.693017: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:21:31.694214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:21:31.694259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 16:21:31.694268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 16:21:31.694275: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 16:21:31.695550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masq2025-05-21 16:21:43.494381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:21:43.666614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.36016 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.51250 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.05547 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19609 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 3386149 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.5056509971618652 nb_pixel_total : 363229 time to create 1 rle with new method : 0.039177894592285156 length of segment : 542 time for calcul the mask position with numpy : 0.0012099742889404297 nb_pixel_total : 87217 time to create 1 rle with old method : 0.09695148468017578 length of segment : 257 time for calcul the mask position with numpy : 0.0010988712310791016 nb_pixel_total : 76232 time to create 1 rle with old method : 0.08602309226989746 length of segment : 265 time for calcul the mask position with numpy : 0.0003859996795654297 nb_pixel_total : 13998 time to create 1 rle with old method : 0.01578998565673828 length of segment : 225 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 13991 time to create 1 rle with old method : 0.018579721450805664 length of segment : 83 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 11908 time to create 1 rle with old method : 0.014052152633666992 length of segment : 149 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 15163 time to create 1 rle with old method : 0.017354488372802734 length of segment : 125 time for calcul the mask position with numpy : 0.00048351287841796875 nb_pixel_total : 33171 time to create 1 rle with old method : 0.04215097427368164 length of segment : 160 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 10815 time to create 1 rle with old method : 0.012267351150512695 length of segment : 120 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 15345 time to create 1 rle with old method : 0.017595767974853516 length of segment : 250 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 13968 time to create 1 rle with old method : 0.015650510787963867 length of segment : 181 time for calcul the mask position with numpy : 0.002080678939819336 nb_pixel_total : 62543 time to create 1 rle with old method : 0.07068204879760742 length of segment : 248 time for calcul the mask position with numpy : 0.001495361328125 nb_pixel_total : 37166 time to create 1 rle with old method : 0.04120779037475586 length of segment : 380 time for calcul the mask position with numpy : 0.00095367431640625 nb_pixel_total : 18320 time to create 1 rle with old method : 0.02020859718322754 length of segment : 234 time for calcul the mask position with numpy : 0.0018529891967773438 nb_pixel_total : 72181 time to create 1 rle with old method : 0.0790092945098877 length of segment : 253 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 38754 time to create 1 rle with old method : 0.04211711883544922 length of segment : 334 time for calcul the mask position with numpy : 0.001386880874633789 nb_pixel_total : 28089 time to create 1 rle with old method : 0.03220081329345703 length of segment : 232 time for calcul the mask position with numpy : 0.0009207725524902344 nb_pixel_total : 25838 time to create 1 rle with old method : 0.029657363891601562 length of segment : 151 time for calcul the mask position with numpy : 0.0011539459228515625 nb_pixel_total : 20159 time to create 1 rle with old method : 0.033087730407714844 length of segment : 220 time for calcul the mask position with numpy : 0.004252433776855469 nb_pixel_total : 117244 time to create 1 rle with old method : 0.13110971450805664 length of segment : 268 time for calcul the mask position with numpy : 0.0007426738739013672 nb_pixel_total : 14431 time to create 1 rle with old method : 0.01624894142150879 length of segment : 200 time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 10803 time to create 1 rle with old method : 0.012400627136230469 length of segment : 160 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 3072 time to create 1 rle with old method : 0.0036249160766601562 length of segment : 63 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 33188 time to create 1 rle with old method : 0.038062095642089844 length of segment : 177 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 7279 time to create 1 rle with old method : 0.008777141571044922 length of segment : 126 time for calcul the mask position with numpy : 0.001249074935913086 nb_pixel_total : 39323 time to create 1 rle with old method : 0.04947829246520996 length of segment : 190 time for calcul the mask position with numpy : 0.004580259323120117 nb_pixel_total : 140560 time to create 1 rle with old method : 0.1529390811920166 length of segment : 321 time for calcul the mask position with numpy : 0.0010480880737304688 nb_pixel_total : 25878 time to create 1 rle with old method : 0.029184341430664062 length of segment : 206 time for calcul the mask position with numpy : 0.002248048782348633 nb_pixel_total : 51173 time to create 1 rle with old method : 0.05746579170227051 length of segment : 370 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 20544 time to create 1 rle with old method : 0.02293229103088379 length of segment : 163 time for calcul the mask position with numpy : 0.0014028549194335938 nb_pixel_total : 29332 time to create 1 rle with old method : 0.033216238021850586 length of segment : 265 time for calcul the mask position with numpy : 0.0017533302307128906 nb_pixel_total : 28848 time to create 1 rle with old method : 0.03204202651977539 length of segment : 403 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 18707 time to create 1 rle with old method : 0.0207369327545166 length of segment : 199 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 12008 time to create 1 rle with old method : 0.013513565063476562 length of segment : 148 time for calcul the mask position with numpy : 0.0008647441864013672 nb_pixel_total : 20598 time to create 1 rle with old method : 0.023046493530273438 length of segment : 206 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 27456 time to create 1 rle with old method : 0.03054976463317871 length of segment : 214 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 32232 time to create 1 rle with old method : 0.036147117614746094 length of segment : 250 time for calcul the mask position with numpy : 0.0008225440979003906 nb_pixel_total : 49381 time to create 1 rle with old method : 0.05477285385131836 length of segment : 208 time for calcul the mask position with numpy : 0.0008013248443603516 nb_pixel_total : 62267 time to create 1 rle with old method : 0.0681309700012207 length of segment : 261 time for calcul the mask position with numpy : 0.004838228225708008 nb_pixel_total : 258464 time to create 1 rle with new method : 0.01707935333251953 length of segment : 433 time for calcul the mask position with numpy : 0.0024521350860595703 nb_pixel_total : 62671 time to create 1 rle with old method : 0.07048654556274414 length of segment : 485 time for calcul the mask position with numpy : 0.001150369644165039 nb_pixel_total : 16056 time to create 1 rle with old method : 0.02702164649963379 length of segment : 275 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 13638 time to create 1 rle with old method : 0.015543699264526367 length of segment : 251 time for calcul the mask position with numpy : 0.0006849765777587891 nb_pixel_total : 18562 time to create 1 rle with old method : 0.021092891693115234 length of segment : 142 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 19694 time to create 1 rle with old method : 0.02212381362915039 length of segment : 298 time for calcul the mask position with numpy : 0.0008521080017089844 nb_pixel_total : 16486 time to create 1 rle with old method : 0.01875925064086914 length of segment : 213 time for calcul the mask position with numpy : 0.0011811256408691406 nb_pixel_total : 26573 time to create 1 rle with old method : 0.03007674217224121 length of segment : 250 time for calcul the mask position with numpy : 0.002131223678588867 nb_pixel_total : 93210 time to create 1 rle with old method : 0.10000157356262207 length of segment : 372 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 5211 time to create 1 rle with old method : 0.006009101867675781 length of segment : 107 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 14634 time to create 1 rle with old method : 0.016344547271728516 length of segment : 130 time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 12978 time to create 1 rle with old method : 0.014973640441894531 length of segment : 116 time for calcul the mask position with numpy : 0.0007951259613037109 nb_pixel_total : 22486 time to create 1 rle with old method : 0.02423238754272461 length of segment : 188 time for calcul the mask position with numpy : 0.003981828689575195 nb_pixel_total : 104859 time to create 1 rle with old method : 0.1121969223022461 length of segment : 486 time for calcul the mask position with numpy : 0.03954124450683594 nb_pixel_total : 639445 time to create 1 rle with new method : 0.05084061622619629 length of segment : 804 time for calcul the mask position with numpy : 0.006204366683959961 nb_pixel_total : 183521 time to create 1 rle with new method : 0.012091636657714844 length of segment : 382 time for calcul the mask position with numpy : 0.03589510917663574 nb_pixel_total : 711393 time to create 1 rle with new method : 0.10885238647460938 length of segment : 1333 time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 6797 time to create 1 rle with old method : 0.007853031158447266 length of segment : 76 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 14034 time to create 1 rle with old method : 0.01646113395690918 length of segment : 137 time for calcul the mask position with numpy : 0.003981113433837891 nb_pixel_total : 179618 time to create 1 rle with new method : 0.009048700332641602 length of segment : 371 time for calcul the mask position with numpy : 0.0010135173797607422 nb_pixel_total : 34308 time to create 1 rle with old method : 0.03912544250488281 length of segment : 187 time for calcul the mask position with numpy : 0.0011565685272216797 nb_pixel_total : 37779 time to create 1 rle with old method : 0.0429224967956543 length of segment : 227 time for calcul the mask position with numpy : 0.0002865791320800781 nb_pixel_total : 13056 time to create 1 rle with old method : 0.015346288681030273 length of segment : 128 time for calcul the mask position with numpy : 0.0025382041931152344 nb_pixel_total : 108559 time to create 1 rle with old method : 0.1220541000366211 length of segment : 479 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 4381 time to create 1 rle with old method : 0.007412433624267578 length of segment : 130 time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 13780 time to create 1 rle with old method : 0.016309499740600586 length of segment : 130 time for calcul the mask position with numpy : 0.0010445117950439453 nb_pixel_total : 24752 time to create 1 rle with old method : 0.02905893325805664 length of segment : 257 time for calcul the mask position with numpy : 0.0005216598510742188 nb_pixel_total : 13682 time to create 1 rle with old method : 0.01598334312438965 length of segment : 174 time for calcul the mask position with numpy : 0.0033483505249023438 nb_pixel_total : 108706 time to create 1 rle with old method : 0.14131927490234375 length of segment : 299 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 33116 time to create 1 rle with old method : 0.03727126121520996 length of segment : 359 time for calcul the mask position with numpy : 0.0005061626434326172 nb_pixel_total : 14072 time to create 1 rle with old method : 0.016470909118652344 length of segment : 113 time for calcul the mask position with numpy : 0.0010535717010498047 nb_pixel_total : 36298 time to create 1 rle with old method : 0.042432308197021484 length of segment : 218 time for calcul the mask position with numpy : 0.0009915828704833984 nb_pixel_total : 20491 time to create 1 rle with old method : 0.023534536361694336 length of segment : 197 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 11820 time to create 1 rle with old method : 0.013381004333496094 length of segment : 110 time for calcul the mask position with numpy : 0.0008749961853027344 nb_pixel_total : 24586 time to create 1 rle with old method : 0.028298139572143555 length of segment : 243 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 35630 time to create 1 rle with old method : 0.040570974349975586 length of segment : 248 time spent for convertir_results : 6.739420413970947 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 387 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 44.824054479599 time spend to save output : 0.13266444206237793 total time spend for step 1 : 44.95671892166138 step2:mask_detect Wed May 21 16:22:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 16:22:15.343300: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 16:22:15.371406: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 16:22:15.373109: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3354000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 16:22:15.373134: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 16:22:15.376012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 16:22:15.630553: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7adde40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 16:22:15.630604: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 16:22:15.632121: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:22:15.632542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:22:15.636409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:22:15.639705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:22:15.640535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:22:15.643569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:22:15.644869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:22:15.651669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:22:15.653494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:22:15.653627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:22:15.654461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 16:22:15.654482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 16:22:15.654492: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 16:22:15.656019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 16:22:15.909338: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:22:15.909437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:22:15.909468: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:22:15.909497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:22:15.909525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:22:15.909552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:22:15.909580: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:22:15.909607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:22:15.912200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:22:15.914220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 16:22:15.914282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 16:22:15.914319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:22:15.914353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 16:22:15.914387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 16:22:15.914421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 16:22:15.914455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 16:22:15.914488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 16:22:15.916871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 16:22:15.916903: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 16:22:15.916913: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 16:22:15.916922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 16:22:15.918628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-21 16:22:25.889345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 16:22:26.131883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.36016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 93 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 85 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.05547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 78 Detection mask done ! Trying to reset tf kernel 3387741 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001966238021850586 nb_pixel_total : 31928 time to create 1 rle with old method : 0.03821229934692383 length of segment : 250 time for calcul the mask position with numpy : 0.0012929439544677734 nb_pixel_total : 46062 time to create 1 rle with old method : 0.06011795997619629 length of segment : 166 time for calcul the mask position with numpy : 0.0017952919006347656 nb_pixel_total : 63742 time to create 1 rle with old method : 0.07468652725219727 length of segment : 241 time for calcul the mask position with numpy : 0.0006573200225830078 nb_pixel_total : 14514 time to create 1 rle with old method : 0.02113795280456543 length of segment : 98 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 13682 time to create 1 rle with old method : 0.019034862518310547 length of segment : 150 time for calcul the mask position with numpy : 0.0074651241302490234 nb_pixel_total : 209661 time to create 1 rle with new method : 0.021540164947509766 length of segment : 704 time for calcul the mask position with numpy : 0.002356290817260742 nb_pixel_total : 54311 time to create 1 rle with old method : 0.06564831733703613 length of segment : 305 time for calcul the mask position with numpy : 0.005289554595947266 nb_pixel_total : 130286 time to create 1 rle with old method : 0.15267372131347656 length of segment : 418 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 9093 time to create 1 rle with old method : 0.012398242950439453 length of segment : 101 time for calcul the mask position with numpy : 0.00550532341003418 nb_pixel_total : 212001 time to create 1 rle with new method : 0.01689314842224121 length of segment : 728 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 25951 time to create 1 rle with old method : 0.029172897338867188 length of segment : 152 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 12351 time to create 1 rle with old method : 0.014251708984375 length of segment : 219 time for calcul the mask position with numpy : 0.001070261001586914 nb_pixel_total : 38228 time to create 1 rle with old method : 0.044043779373168945 length of segment : 304 time for calcul the mask position with numpy : 0.0007853507995605469 nb_pixel_total : 41743 time to create 1 rle with old method : 0.04517388343811035 length of segment : 193 time for calcul the mask position with numpy : 0.004491090774536133 nb_pixel_total : 110557 time to create 1 rle with old method : 0.12700128555297852 length of segment : 402 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 48075 time to create 1 rle with old method : 0.06516814231872559 length of segment : 359 time for calcul the mask position with numpy : 0.0020723342895507812 nb_pixel_total : 50965 time to create 1 rle with old method : 0.07045674324035645 length of segment : 298 time for calcul the mask position with numpy : 0.010403871536254883 nb_pixel_total : 361502 time to create 1 rle with new method : 0.2808566093444824 length of segment : 551 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 10252 time to create 1 rle with old method : 0.011484622955322266 length of segment : 141 time for calcul the mask position with numpy : 0.0016090869903564453 nb_pixel_total : 50756 time to create 1 rle with old method : 0.07187485694885254 length of segment : 218 time for calcul the mask position with numpy : 0.001512765884399414 nb_pixel_total : 39863 time to create 1 rle with old method : 0.052530527114868164 length of segment : 314 time for calcul the mask position with numpy : 0.0007739067077636719 nb_pixel_total : 27819 time to create 1 rle with old method : 0.036957740783691406 length of segment : 184 time for calcul the mask position with numpy : 0.003324270248413086 nb_pixel_total : 87795 time to create 1 rle with old method : 0.12085175514221191 length of segment : 394 time for calcul the mask position with numpy : 0.0019867420196533203 nb_pixel_total : 49364 time to create 1 rle with old method : 0.061893463134765625 length of segment : 341 time for calcul the mask position with numpy : 0.00443267822265625 nb_pixel_total : 165375 time to create 1 rle with new method : 0.015318632125854492 length of segment : 556 time for calcul the mask position with numpy : 0.0029764175415039062 nb_pixel_total : 96659 time to create 1 rle with old method : 0.11701726913452148 length of segment : 353 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 8025 time to create 1 rle with old method : 0.008855342864990234 length of segment : 100 time for calcul the mask position with numpy : 0.0019178390502929688 nb_pixel_total : 80477 time to create 1 rle with old method : 0.09057116508483887 length of segment : 265 time for calcul the mask position with numpy : 0.001104116439819336 nb_pixel_total : 36424 time to create 1 rle with old method : 0.04165768623352051 length of segment : 223 time for calcul the mask position with numpy : 0.003679037094116211 nb_pixel_total : 168928 time to create 1 rle with new method : 0.010071039199829102 length of segment : 586 time for calcul the mask position with numpy : 0.0008122920989990234 nb_pixel_total : 37346 time to create 1 rle with old method : 0.04259300231933594 length of segment : 285 time for calcul the mask position with numpy : 0.000579833984375 nb_pixel_total : 16665 time to create 1 rle with old method : 0.01912212371826172 length of segment : 147 time for calcul the mask position with numpy : 0.0020470619201660156 nb_pixel_total : 76820 time to create 1 rle with old method : 0.08819317817687988 length of segment : 223 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 11629 time to create 1 rle with old method : 0.013410806655883789 length of segment : 126 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 14976 time to create 1 rle with old method : 0.017735719680786133 length of segment : 161 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 35758 time to create 1 rle with old method : 0.04121255874633789 length of segment : 157 time for calcul the mask position with numpy : 0.0066492557525634766 nb_pixel_total : 265132 time to create 1 rle with new method : 0.03255724906921387 length of segment : 672 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 15222 time to create 1 rle with old method : 0.017369985580444336 length of segment : 151 time for calcul the mask position with numpy : 0.002293109893798828 nb_pixel_total : 114204 time to create 1 rle with old method : 0.1262059211730957 length of segment : 265 time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 31107 time to create 1 rle with old method : 0.03518247604370117 length of segment : 196 time for calcul the mask position with numpy : 0.00020742416381835938 nb_pixel_total : 4110 time to create 1 rle with old method : 0.0049440860748291016 length of segment : 82 time for calcul the mask position with numpy : 0.0014472007751464844 nb_pixel_total : 46099 time to create 1 rle with old method : 0.05284738540649414 length of segment : 249 time for calcul the mask position with numpy : 0.0008158683776855469 nb_pixel_total : 9624 time to create 1 rle with old method : 0.01145482063293457 length of segment : 149 time for calcul the mask position with numpy : 0.10754752159118652 nb_pixel_total : 804847 time to create 1 rle with new method : 0.24488067626953125 length of segment : 1092 time for calcul the mask position with numpy : 0.0016314983367919922 nb_pixel_total : 36569 time to create 1 rle with old method : 0.04219388961791992 length of segment : 338 time for calcul the mask position with numpy : 0.005347490310668945 nb_pixel_total : 184199 time to create 1 rle with new method : 0.015308380126953125 length of segment : 415 time for calcul the mask position with numpy : 0.009013891220092773 nb_pixel_total : 339332 time to create 1 rle with new method : 0.05759763717651367 length of segment : 707 time for calcul the mask position with numpy : 0.0007905960083007812 nb_pixel_total : 29487 time to create 1 rle with old method : 0.03521156311035156 length of segment : 243 time for calcul the mask position with numpy : 0.016064882278442383 nb_pixel_total : 395415 time to create 1 rle with new method : 0.17510652542114258 length of segment : 1052 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 15217 time to create 1 rle with old method : 0.016819000244140625 length of segment : 139 time for calcul the mask position with numpy : 0.0014171600341796875 nb_pixel_total : 49500 time to create 1 rle with old method : 0.05587506294250488 length of segment : 341 time for calcul the mask position with numpy : 0.0007271766662597656 nb_pixel_total : 16193 time to create 1 rle with old method : 0.024335861206054688 length of segment : 226 time for calcul the mask position with numpy : 0.001524209976196289 nb_pixel_total : 49073 time to create 1 rle with old method : 0.05755281448364258 length of segment : 243 time for calcul the mask position with numpy : 0.001302480697631836 nb_pixel_total : 47892 time to create 1 rle with old method : 0.052951812744140625 length of segment : 303 time for calcul the mask position with numpy : 0.0004482269287109375 nb_pixel_total : 16651 time to create 1 rle with old method : 0.01893758773803711 length of segment : 143 time for calcul the mask position with numpy : 0.003126382827758789 nb_pixel_total : 67449 time to create 1 rle with old method : 0.0751340389251709 length of segment : 666 time for calcul the mask position with numpy : 0.0019762516021728516 nb_pixel_total : 87009 time to create 1 rle with old method : 0.09300446510314941 length of segment : 281 time for calcul the mask position with numpy : 0.0032393932342529297 nb_pixel_total : 156740 time to create 1 rle with new method : 0.007688760757446289 length of segment : 359 time for calcul the mask position with numpy : 0.003255605697631836 nb_pixel_total : 156405 time to create 1 rle with new method : 0.01012873649597168 length of segment : 477 time for calcul the mask position with numpy : 0.0016498565673828125 nb_pixel_total : 61798 time to create 1 rle with old method : 0.07006406784057617 length of segment : 250 time for calcul the mask position with numpy : 0.0019407272338867188 nb_pixel_total : 70759 time to create 1 rle with old method : 0.07708191871643066 length of segment : 428 time for calcul the mask position with numpy : 0.0012738704681396484 nb_pixel_total : 19160 time to create 1 rle with old method : 0.026348352432250977 length of segment : 227 time for calcul the mask position with numpy : 0.0017600059509277344 nb_pixel_total : 55192 time to create 1 rle with old method : 0.06084156036376953 length of segment : 336 time for calcul the mask position with numpy : 0.0022041797637939453 nb_pixel_total : 83712 time to create 1 rle with old method : 0.09514188766479492 length of segment : 286 time for calcul the mask position with numpy : 0.003287792205810547 nb_pixel_total : 132840 time to create 1 rle with old method : 0.16650819778442383 length of segment : 506 time for calcul the mask position with numpy : 0.0013759136199951172 nb_pixel_total : 41541 time to create 1 rle with old method : 0.04870176315307617 length of segment : 219 time for calcul the mask position with numpy : 0.00861811637878418 nb_pixel_total : 321821 time to create 1 rle with new method : 0.02791595458984375 length of segment : 686 time for calcul the mask position with numpy : 0.0005726814270019531 nb_pixel_total : 17576 time to create 1 rle with old method : 0.020382404327392578 length of segment : 197 time for calcul the mask position with numpy : 0.0007145404815673828 nb_pixel_total : 30275 time to create 1 rle with old method : 0.03440380096435547 length of segment : 250 time for calcul the mask position with numpy : 0.002733945846557617 nb_pixel_total : 89957 time to create 1 rle with old method : 0.0989828109741211 length of segment : 496 time for calcul the mask position with numpy : 0.008014678955078125 nb_pixel_total : 158990 time to create 1 rle with new method : 0.03321647644042969 length of segment : 541 time for calcul the mask position with numpy : 0.0033326148986816406 nb_pixel_total : 80227 time to create 1 rle with old method : 0.09064221382141113 length of segment : 471 time for calcul the mask position with numpy : 0.0037851333618164062 nb_pixel_total : 99358 time to create 1 rle with old method : 0.10993409156799316 length of segment : 282 time for calcul the mask position with numpy : 0.004391908645629883 nb_pixel_total : 214434 time to create 1 rle with new method : 0.016390562057495117 length of segment : 1255 time for calcul the mask position with numpy : 0.0020895004272460938 nb_pixel_total : 77496 time to create 1 rle with old method : 0.13217926025390625 length of segment : 258 time for calcul the mask position with numpy : 0.001440286636352539 nb_pixel_total : 36000 time to create 1 rle with old method : 0.04249906539916992 length of segment : 200 time for calcul the mask position with numpy : 0.014256477355957031 nb_pixel_total : 354351 time to create 1 rle with new method : 0.08230376243591309 length of segment : 819 time for calcul the mask position with numpy : 0.004986286163330078 nb_pixel_total : 234038 time to create 1 rle with new method : 0.015692710876464844 length of segment : 571 time for calcul the mask position with numpy : 0.0007522106170654297 nb_pixel_total : 27944 time to create 1 rle with old method : 0.030380725860595703 length of segment : 199 time for calcul the mask position with numpy : 0.0015070438385009766 nb_pixel_total : 50742 time to create 1 rle with old method : 0.05647611618041992 length of segment : 212 time for calcul the mask position with numpy : 0.00574183464050293 nb_pixel_total : 325551 time to create 1 rle with new method : 0.018149137496948242 length of segment : 619 time for calcul the mask position with numpy : 0.0022602081298828125 nb_pixel_total : 85427 time to create 1 rle with old method : 0.11849284172058105 length of segment : 310 time for calcul the mask position with numpy : 0.0018172264099121094 nb_pixel_total : 64958 time to create 1 rle with old method : 0.0708003044128418 length of segment : 286 time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 64472 time to create 1 rle with old method : 0.0715937614440918 length of segment : 240 time for calcul the mask position with numpy : 0.0007433891296386719 nb_pixel_total : 29098 time to create 1 rle with old method : 0.03226971626281738 length of segment : 197 time for calcul the mask position with numpy : 0.006627321243286133 nb_pixel_total : 87359 time to create 1 rle with old method : 0.10524463653564453 length of segment : 451 time for calcul the mask position with numpy : 0.0029153823852539062 nb_pixel_total : 155032 time to create 1 rle with new method : 0.008732318878173828 length of segment : 479 time for calcul the mask position with numpy : 0.0013701915740966797 nb_pixel_total : 60763 time to create 1 rle with old method : 0.06665968894958496 length of segment : 357 time for calcul the mask position with numpy : 0.00327301025390625 nb_pixel_total : 67275 time to create 1 rle with old method : 0.07979941368103027 length of segment : 466 time for calcul the mask position with numpy : 0.0012619495391845703 nb_pixel_total : 60430 time to create 1 rle with old method : 0.06944870948791504 length of segment : 230 time for calcul the mask position with numpy : 0.01139378547668457 nb_pixel_total : 368883 time to create 1 rle with new method : 0.13034534454345703 length of segment : 704 time for calcul the mask position with numpy : 0.0020074844360351562 nb_pixel_total : 65891 time to create 1 rle with old method : 0.07352757453918457 length of segment : 246 time for calcul the mask position with numpy : 0.001977682113647461 nb_pixel_total : 69126 time to create 1 rle with old method : 0.07558655738830566 length of segment : 373 time for calcul the mask position with numpy : 0.01608443260192871 nb_pixel_total : 795898 time to create 1 rle with new method : 0.12335395812988281 length of segment : 873 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 26428 time to create 1 rle with old method : 0.0303952693939209 length of segment : 210 time for calcul the mask position with numpy : 0.002942800521850586 nb_pixel_total : 121579 time to create 1 rle with old method : 0.13588976860046387 length of segment : 346 time for calcul the mask position with numpy : 0.00374603271484375 nb_pixel_total : 197358 time to create 1 rle with new method : 0.010658979415893555 length of segment : 562 time for calcul the mask position with numpy : 0.0008945465087890625 nb_pixel_total : 36809 time to create 1 rle with old method : 0.041263580322265625 length of segment : 282 time for calcul the mask position with numpy : 0.005448579788208008 nb_pixel_total : 275929 time to create 1 rle with new method : 0.016297101974487305 length of segment : 758 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 23993 time to create 1 rle with old method : 0.027585268020629883 length of segment : 204 time for calcul the mask position with numpy : 0.0010993480682373047 nb_pixel_total : 37471 time to create 1 rle with old method : 0.04302978515625 length of segment : 231 time for calcul the mask position with numpy : 0.0022363662719726562 nb_pixel_total : 65690 time to create 1 rle with old method : 0.07393193244934082 length of segment : 406 time for calcul the mask position with numpy : 0.0028734207153320312 nb_pixel_total : 140228 time to create 1 rle with old method : 0.1536552906036377 length of segment : 597 time for calcul the mask position with numpy : 0.005428314208984375 nb_pixel_total : 169338 time to create 1 rle with new method : 0.012555599212646484 length of segment : 579 time for calcul the mask position with numpy : 0.0009851455688476562 nb_pixel_total : 21931 time to create 1 rle with old method : 0.025422334671020508 length of segment : 191 time for calcul the mask position with numpy : 0.0009455680847167969 nb_pixel_total : 39160 time to create 1 rle with old method : 0.04520773887634277 length of segment : 265 time for calcul the mask position with numpy : 0.00958871841430664 nb_pixel_total : 326380 time to create 1 rle with new method : 0.11602401733398438 length of segment : 681 time for calcul the mask position with numpy : 0.0004227161407470703 nb_pixel_total : 11682 time to create 1 rle with old method : 0.013314247131347656 length of segment : 234 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 28671 time to create 1 rle with old method : 0.03131914138793945 length of segment : 211 time for calcul the mask position with numpy : 0.0004546642303466797 nb_pixel_total : 18531 time to create 1 rle with old method : 0.020872116088867188 length of segment : 176 time for calcul the mask position with numpy : 0.0011751651763916016 nb_pixel_total : 37651 time to create 1 rle with old method : 0.041341543197631836 length of segment : 294 time for calcul the mask position with numpy : 0.001991748809814453 nb_pixel_total : 72097 time to create 1 rle with old method : 0.07918858528137207 length of segment : 428 time for calcul the mask position with numpy : 0.00109100341796875 nb_pixel_total : 45254 time to create 1 rle with old method : 0.07239151000976562 length of segment : 372 time for calcul the mask position with numpy : 0.0023636817932128906 nb_pixel_total : 113485 time to create 1 rle with old method : 0.12290263175964355 length of segment : 435 time for calcul the mask position with numpy : 0.00045418739318847656 nb_pixel_total : 13736 time to create 1 rle with old method : 0.01547861099243164 length of segment : 154 time for calcul the mask position with numpy : 0.005745887756347656 nb_pixel_total : 240131 time to create 1 rle with new method : 0.02122974395751953 length of segment : 1050 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 26335 time to create 1 rle with old method : 0.029675960540771484 length of segment : 204 time for calcul the mask position with numpy : 0.002070903778076172 nb_pixel_total : 85107 time to create 1 rle with old method : 0.0946965217590332 length of segment : 435 time for calcul the mask position with numpy : 0.003098011016845703 nb_pixel_total : 143548 time to create 1 rle with old method : 0.15530705451965332 length of segment : 407 time for calcul the mask position with numpy : 0.0018835067749023438 nb_pixel_total : 77232 time to create 1 rle with old method : 0.0828237533569336 length of segment : 346 time for calcul the mask position with numpy : 0.003961801528930664 nb_pixel_total : 158911 time to create 1 rle with new method : 0.012445211410522461 length of segment : 436 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 14998 time to create 1 rle with old method : 0.0200197696685791 length of segment : 168 time for calcul the mask position with numpy : 0.0019407272338867188 nb_pixel_total : 64554 time to create 1 rle with old method : 0.07224774360656738 length of segment : 372 time for calcul the mask position with numpy : 0.0011293888092041016 nb_pixel_total : 46611 time to create 1 rle with old method : 0.0542447566986084 length of segment : 167 time for calcul the mask position with numpy : 0.0006151199340820312 nb_pixel_total : 10038 time to create 1 rle with old method : 0.011920452117919922 length of segment : 127 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 13182 time to create 1 rle with old method : 0.015186786651611328 length of segment : 164 time for calcul the mask position with numpy : 0.016328811645507812 nb_pixel_total : 629351 time to create 1 rle with new method : 0.073974609375 length of segment : 1379 time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 38449 time to create 1 rle with old method : 0.04268956184387207 length of segment : 277 time for calcul the mask position with numpy : 0.0026776790618896484 nb_pixel_total : 107034 time to create 1 rle with old method : 0.11899638175964355 length of segment : 368 time for calcul the mask position with numpy : 0.0007646083831787109 nb_pixel_total : 21748 time to create 1 rle with old method : 0.025494813919067383 length of segment : 179 time for calcul the mask position with numpy : 0.002416849136352539 nb_pixel_total : 60572 time to create 1 rle with old method : 0.06848740577697754 length of segment : 430 time for calcul the mask position with numpy : 0.019305944442749023 nb_pixel_total : 672611 time to create 1 rle with new method : 0.13955163955688477 length of segment : 1376 time for calcul the mask position with numpy : 0.0024085044860839844 nb_pixel_total : 110736 time to create 1 rle with old method : 0.12438774108886719 length of segment : 352 time for calcul the mask position with numpy : 0.0003826618194580078 nb_pixel_total : 13585 time to create 1 rle with old method : 0.015718936920166016 length of segment : 103 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 33959 time to create 1 rle with old method : 0.038631439208984375 length of segment : 347 time for calcul the mask position with numpy : 0.0003685951232910156 nb_pixel_total : 5425 time to create 1 rle with old method : 0.006580352783203125 length of segment : 185 time for calcul the mask position with numpy : 0.003634929656982422 nb_pixel_total : 152580 time to create 1 rle with new method : 0.011607170104980469 length of segment : 528 time for calcul the mask position with numpy : 0.0077741146087646484 nb_pixel_total : 326605 time to create 1 rle with new method : 0.05797696113586426 length of segment : 568 time for calcul the mask position with numpy : 0.01235198974609375 nb_pixel_total : 403605 time to create 1 rle with new method : 0.125335693359375 length of segment : 866 time for calcul the mask position with numpy : 0.008446693420410156 nb_pixel_total : 278503 time to create 1 rle with new method : 0.06676268577575684 length of segment : 768 time for calcul the mask position with numpy : 0.0035200119018554688 nb_pixel_total : 106618 time to create 1 rle with old method : 0.14638805389404297 length of segment : 357 time for calcul the mask position with numpy : 0.0008373260498046875 nb_pixel_total : 44284 time to create 1 rle with old method : 0.04970812797546387 length of segment : 213 time for calcul the mask position with numpy : 0.0006716251373291016 nb_pixel_total : 30833 time to create 1 rle with old method : 0.033408164978027344 length of segment : 253 time for calcul the mask position with numpy : 0.0013692378997802734 nb_pixel_total : 34909 time to create 1 rle with old method : 0.03856849670410156 length of segment : 256 time for calcul the mask position with numpy : 0.0007989406585693359 nb_pixel_total : 29093 time to create 1 rle with old method : 0.03296065330505371 length of segment : 253 time for calcul the mask position with numpy : 0.004104137420654297 nb_pixel_total : 186533 time to create 1 rle with new method : 0.0142974853515625 length of segment : 555 time for calcul the mask position with numpy : 0.0016944408416748047 nb_pixel_total : 92944 time to create 1 rle with old method : 0.10218477249145508 length of segment : 256 time for calcul the mask position with numpy : 0.0003528594970703125 nb_pixel_total : 14070 time to create 1 rle with old method : 0.016235828399658203 length of segment : 110 time for calcul the mask position with numpy : 0.0011773109436035156 nb_pixel_total : 53353 time to create 1 rle with old method : 0.059937477111816406 length of segment : 200 time for calcul the mask position with numpy : 0.00041365623474121094 nb_pixel_total : 18585 time to create 1 rle with old method : 0.020211219787597656 length of segment : 230 time for calcul the mask position with numpy : 0.0005784034729003906 nb_pixel_total : 28887 time to create 1 rle with old method : 0.033125877380371094 length of segment : 242 time for calcul the mask position with numpy : 0.001500844955444336 nb_pixel_total : 66556 time to create 1 rle with old method : 0.07233881950378418 length of segment : 233 time for calcul the mask position with numpy : 0.0008404254913330078 nb_pixel_total : 30976 time to create 1 rle with old method : 0.03858351707458496 length of segment : 152 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 16351 time to create 1 rle with old method : 0.01939535140991211 length of segment : 254 time for calcul the mask position with numpy : 0.004692554473876953 nb_pixel_total : 167742 time to create 1 rle with new method : 0.01712799072265625 length of segment : 905 time for calcul the mask position with numpy : 0.0017559528350830078 nb_pixel_total : 51376 time to create 1 rle with old method : 0.05773162841796875 length of segment : 399 time for calcul the mask position with numpy : 0.005911827087402344 nb_pixel_total : 252948 time to create 1 rle with new method : 0.04282498359680176 length of segment : 603 time for calcul the mask position with numpy : 0.0023038387298583984 nb_pixel_total : 41554 time to create 1 rle with old method : 0.05094480514526367 length of segment : 324 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 12785 time to create 1 rle with old method : 0.014763832092285156 length of segment : 113 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 24031 time to create 1 rle with old method : 0.02723097801208496 length of segment : 167 time for calcul the mask position with numpy : 0.004472017288208008 nb_pixel_total : 248159 time to create 1 rle with new method : 0.013621330261230469 length of segment : 712 time for calcul the mask position with numpy : 0.0008797645568847656 nb_pixel_total : 31447 time to create 1 rle with old method : 0.0365748405456543 length of segment : 255 time for calcul the mask position with numpy : 0.0012559890747070312 nb_pixel_total : 47367 time to create 1 rle with old method : 0.05536031723022461 length of segment : 209 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 19554 time to create 1 rle with old method : 0.022621631622314453 length of segment : 128 time for calcul the mask position with numpy : 0.003110647201538086 nb_pixel_total : 105739 time to create 1 rle with old method : 0.11803627014160156 length of segment : 506 time for calcul the mask position with numpy : 0.0013322830200195312 nb_pixel_total : 61469 time to create 1 rle with old method : 0.06825661659240723 length of segment : 255 time for calcul the mask position with numpy : 0.002306222915649414 nb_pixel_total : 105292 time to create 1 rle with old method : 0.11728572845458984 length of segment : 373 time for calcul the mask position with numpy : 0.0025305747985839844 nb_pixel_total : 120579 time to create 1 rle with old method : 0.13321876525878906 length of segment : 412 time for calcul the mask position with numpy : 0.003245115280151367 nb_pixel_total : 129157 time to create 1 rle with old method : 0.13884615898132324 length of segment : 523 time for calcul the mask position with numpy : 0.0012390613555908203 nb_pixel_total : 34212 time to create 1 rle with old method : 0.03738880157470703 length of segment : 247 time for calcul the mask position with numpy : 0.0026159286499023438 nb_pixel_total : 107266 time to create 1 rle with old method : 0.1140294075012207 length of segment : 383 time for calcul the mask position with numpy : 0.0076787471771240234 nb_pixel_total : 314827 time to create 1 rle with new method : 0.034357547760009766 length of segment : 689 time for calcul the mask position with numpy : 0.0023899078369140625 nb_pixel_total : 117289 time to create 1 rle with old method : 0.12925219535827637 length of segment : 556 time for calcul the mask position with numpy : 0.0012385845184326172 nb_pixel_total : 53450 time to create 1 rle with old method : 0.06058979034423828 length of segment : 424 time for calcul the mask position with numpy : 0.003340482711791992 nb_pixel_total : 124963 time to create 1 rle with old method : 0.15089058876037598 length of segment : 576 time for calcul the mask position with numpy : 0.0015799999237060547 nb_pixel_total : 49168 time to create 1 rle with old method : 0.06148862838745117 length of segment : 390 time for calcul the mask position with numpy : 0.0023326873779296875 nb_pixel_total : 122281 time to create 1 rle with old method : 0.15472698211669922 length of segment : 373 time for calcul the mask position with numpy : 0.003715038299560547 nb_pixel_total : 182943 time to create 1 rle with new method : 0.013442277908325195 length of segment : 834 time for calcul the mask position with numpy : 0.012250661849975586 nb_pixel_total : 658085 time to create 1 rle with new method : 0.062143802642822266 length of segment : 794 time for calcul the mask position with numpy : 0.010988950729370117 nb_pixel_total : 574326 time to create 1 rle with new method : 0.04710268974304199 length of segment : 755 time for calcul the mask position with numpy : 0.00044083595275878906 nb_pixel_total : 15882 time to create 1 rle with old method : 0.018331527709960938 length of segment : 167 time for calcul the mask position with numpy : 0.011424541473388672 nb_pixel_total : 539381 time to create 1 rle with new method : 0.12306809425354004 length of segment : 749 time for calcul the mask position with numpy : 0.003909111022949219 nb_pixel_total : 223617 time to create 1 rle with new method : 0.012680530548095703 length of segment : 325 time for calcul the mask position with numpy : 0.12726712226867676 nb_pixel_total : 1321185 time to create 1 rle with new method : 0.26415348052978516 length of segment : 1496 time for calcul the mask position with numpy : 0.0008568763732910156 nb_pixel_total : 47869 time to create 1 rle with old method : 0.05224800109863281 length of segment : 222 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 49145 time to create 1 rle with old method : 0.05946183204650879 length of segment : 263 time for calcul the mask position with numpy : 0.0018312931060791016 nb_pixel_total : 105860 time to create 1 rle with old method : 0.12054991722106934 length of segment : 376 time for calcul the mask position with numpy : 0.005243539810180664 nb_pixel_total : 100626 time to create 1 rle with old method : 0.17017412185668945 length of segment : 437 time for calcul the mask position with numpy : 0.0011453628540039062 nb_pixel_total : 47988 time to create 1 rle with old method : 0.06451678276062012 length of segment : 247 time for calcul the mask position with numpy : 0.022194385528564453 nb_pixel_total : 776100 time to create 1 rle with new method : 0.35019612312316895 length of segment : 997 time for calcul the mask position with numpy : 0.006113529205322266 nb_pixel_total : 273940 time to create 1 rle with new method : 0.2624783515930176 length of segment : 821 time for calcul the mask position with numpy : 0.0009546279907226562 nb_pixel_total : 51454 time to create 1 rle with old method : 0.05851864814758301 length of segment : 398 time for calcul the mask position with numpy : 0.0038716793060302734 nb_pixel_total : 230089 time to create 1 rle with new method : 0.009815692901611328 length of segment : 433 time for calcul the mask position with numpy : 0.002774953842163086 nb_pixel_total : 177043 time to create 1 rle with new method : 0.0069925785064697266 length of segment : 444 time for calcul the mask position with numpy : 0.0009160041809082031 nb_pixel_total : 34307 time to create 1 rle with old method : 0.03934192657470703 length of segment : 234 time for calcul the mask position with numpy : 0.0031626224517822266 nb_pixel_total : 118573 time to create 1 rle with old method : 0.13282299041748047 length of segment : 366 time for calcul the mask position with numpy : 0.0027191638946533203 nb_pixel_total : 140930 time to create 1 rle with old method : 0.15449857711791992 length of segment : 366 time for calcul the mask position with numpy : 0.0015652179718017578 nb_pixel_total : 80493 time to create 1 rle with old method : 0.09424638748168945 length of segment : 244 time for calcul the mask position with numpy : 0.00150299072265625 nb_pixel_total : 67195 time to create 1 rle with old method : 0.07619071006774902 length of segment : 304 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 16694 time to create 1 rle with old method : 0.019249677658081055 length of segment : 109 time for calcul the mask position with numpy : 0.0016527175903320312 nb_pixel_total : 67067 time to create 1 rle with old method : 0.0749518871307373 length of segment : 563 time for calcul the mask position with numpy : 0.006131172180175781 nb_pixel_total : 312204 time to create 1 rle with new method : 0.016387224197387695 length of segment : 623 time for calcul the mask position with numpy : 0.009840965270996094 nb_pixel_total : 493844 time to create 1 rle with new method : 0.04601311683654785 length of segment : 1170 time for calcul the mask position with numpy : 0.002596139907836914 nb_pixel_total : 126686 time to create 1 rle with old method : 0.15750336647033691 length of segment : 358 time for calcul the mask position with numpy : 0.0007810592651367188 nb_pixel_total : 42341 time to create 1 rle with old method : 0.048342227935791016 length of segment : 263 time for calcul the mask position with numpy : 0.004318714141845703 nb_pixel_total : 187642 time to create 1 rle with new method : 0.012360572814941406 length of segment : 590 time for calcul the mask position with numpy : 0.0007288455963134766 nb_pixel_total : 31464 time to create 1 rle with old method : 0.036330223083496094 length of segment : 183 time for calcul the mask position with numpy : 0.004761219024658203 nb_pixel_total : 215868 time to create 1 rle with new method : 0.013599395751953125 length of segment : 666 time for calcul the mask position with numpy : 0.006102561950683594 nb_pixel_total : 254450 time to create 1 rle with new method : 0.019273996353149414 length of segment : 654 time for calcul the mask position with numpy : 0.0008547306060791016 nb_pixel_total : 42911 time to create 1 rle with old method : 0.04871678352355957 length of segment : 162 time for calcul the mask position with numpy : 0.0012340545654296875 nb_pixel_total : 63652 time to create 1 rle with old method : 0.07300162315368652 length of segment : 237 time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 21891 time to create 1 rle with old method : 0.026570558547973633 length of segment : 271 time for calcul the mask position with numpy : 0.01506352424621582 nb_pixel_total : 365935 time to create 1 rle with new method : 0.07570290565490723 length of segment : 957 time for calcul the mask position with numpy : 0.01782679557800293 nb_pixel_total : 888499 time to create 1 rle with new method : 0.0997779369354248 length of segment : 1064 time for calcul the mask position with numpy : 0.0017452239990234375 nb_pixel_total : 80899 time to create 1 rle with old method : 0.0959477424621582 length of segment : 459 time for calcul the mask position with numpy : 0.0018587112426757812 nb_pixel_total : 86378 time to create 1 rle with old method : 0.11158251762390137 length of segment : 326 time for calcul the mask position with numpy : 0.003371715545654297 nb_pixel_total : 190257 time to create 1 rle with new method : 0.009711503982543945 length of segment : 583 time for calcul the mask position with numpy : 0.0008680820465087891 nb_pixel_total : 51396 time to create 1 rle with old method : 0.05948281288146973 length of segment : 323 time for calcul the mask position with numpy : 0.0014660358428955078 nb_pixel_total : 72753 time to create 1 rle with old method : 0.0843043327331543 length of segment : 444 time for calcul the mask position with numpy : 0.0019941329956054688 nb_pixel_total : 123195 time to create 1 rle with old method : 0.13946771621704102 length of segment : 330 time for calcul the mask position with numpy : 0.010911703109741211 nb_pixel_total : 430774 time to create 1 rle with new method : 0.161088228225708 length of segment : 1774 time for calcul the mask position with numpy : 0.0019767284393310547 nb_pixel_total : 81041 time to create 1 rle with old method : 0.09448456764221191 length of segment : 284 time for calcul the mask position with numpy : 0.0018131732940673828 nb_pixel_total : 94605 time to create 1 rle with old method : 0.10709977149963379 length of segment : 287 time for calcul the mask position with numpy : 0.0028116703033447266 nb_pixel_total : 137989 time to create 1 rle with old method : 0.163285493850708 length of segment : 356 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 23947 time to create 1 rle with old method : 0.027470827102661133 length of segment : 336 time for calcul the mask position with numpy : 0.0019366741180419922 nb_pixel_total : 90887 time to create 1 rle with old method : 0.1003272533416748 length of segment : 307 time for calcul the mask position with numpy : 0.003004789352416992 nb_pixel_total : 115259 time to create 1 rle with old method : 0.13320422172546387 length of segment : 380 time for calcul the mask position with numpy : 0.0016732215881347656 nb_pixel_total : 67217 time to create 1 rle with old method : 0.07622456550598145 length of segment : 380 time for calcul the mask position with numpy : 0.0019757747650146484 nb_pixel_total : 108198 time to create 1 rle with old method : 0.12163925170898438 length of segment : 372 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 43304 time to create 1 rle with old method : 0.0479276180267334 length of segment : 264 time for calcul the mask position with numpy : 0.004675149917602539 nb_pixel_total : 235122 time to create 1 rle with new method : 0.012205362319946289 length of segment : 435 time for calcul the mask position with numpy : 0.0013453960418701172 nb_pixel_total : 48354 time to create 1 rle with old method : 0.05338311195373535 length of segment : 258 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 52232 time to create 1 rle with old method : 0.058851003646850586 length of segment : 267 time for calcul the mask position with numpy : 0.0009546279907226562 nb_pixel_total : 46505 time to create 1 rle with old method : 0.06825447082519531 length of segment : 184 time for calcul the mask position with numpy : 0.002234935760498047 nb_pixel_total : 64627 time to create 1 rle with old method : 0.07249903678894043 length of segment : 456 time for calcul the mask position with numpy : 0.001708984375 nb_pixel_total : 68857 time to create 1 rle with old method : 0.07628703117370605 length of segment : 363 time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 38399 time to create 1 rle with old method : 0.044209957122802734 length of segment : 276 time for calcul the mask position with numpy : 0.01323246955871582 nb_pixel_total : 681848 time to create 1 rle with new method : 0.06245136260986328 length of segment : 1292 time for calcul the mask position with numpy : 0.0011990070343017578 nb_pixel_total : 45086 time to create 1 rle with old method : 0.05083775520324707 length of segment : 280 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 4033 time to create 1 rle with old method : 0.005165815353393555 length of segment : 163 time for calcul the mask position with numpy : 0.003644227981567383 nb_pixel_total : 140778 time to create 1 rle with old method : 0.15706849098205566 length of segment : 416 time for calcul the mask position with numpy : 0.0006034374237060547 nb_pixel_total : 15754 time to create 1 rle with old method : 0.018484830856323242 length of segment : 114 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 11003 time to create 1 rle with old method : 0.013014078140258789 length of segment : 105 time for calcul the mask position with numpy : 0.0007584095001220703 nb_pixel_total : 29264 time to create 1 rle with old method : 0.03300285339355469 length of segment : 215 time for calcul the mask position with numpy : 0.0032520294189453125 nb_pixel_total : 146694 time to create 1 rle with old method : 0.187727689743042 length of segment : 431 time for calcul the mask position with numpy : 0.0024230480194091797 nb_pixel_total : 87724 time to create 1 rle with old method : 0.09979653358459473 length of segment : 292 time for calcul the mask position with numpy : 0.0012645721435546875 nb_pixel_total : 40203 time to create 1 rle with old method : 0.04718494415283203 length of segment : 203 time for calcul the mask position with numpy : 0.001718759536743164 nb_pixel_total : 81165 time to create 1 rle with old method : 0.08996462821960449 length of segment : 382 time for calcul the mask position with numpy : 0.008015871047973633 nb_pixel_total : 367132 time to create 1 rle with new method : 0.03865170478820801 length of segment : 603 time for calcul the mask position with numpy : 0.0031442642211914062 nb_pixel_total : 164745 time to create 1 rle with new method : 0.007477283477783203 length of segment : 365 time for calcul the mask position with numpy : 0.0005638599395751953 nb_pixel_total : 15110 time to create 1 rle with old method : 0.0179903507232666 length of segment : 159 time for calcul the mask position with numpy : 0.001115560531616211 nb_pixel_total : 47773 time to create 1 rle with old method : 0.052797794342041016 length of segment : 276 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 19086 time to create 1 rle with old method : 0.02234816551208496 length of segment : 149 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 44891 time to create 1 rle with old method : 0.05306577682495117 length of segment : 214 time for calcul the mask position with numpy : 0.0003654956817626953 nb_pixel_total : 12755 time to create 1 rle with old method : 0.014875411987304688 length of segment : 129 time for calcul the mask position with numpy : 0.003063678741455078 nb_pixel_total : 94919 time to create 1 rle with old method : 0.11314058303833008 length of segment : 521 time for calcul the mask position with numpy : 0.002614259719848633 nb_pixel_total : 85527 time to create 1 rle with old method : 0.09497523307800293 length of segment : 669 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 13073 time to create 1 rle with old method : 0.014423131942749023 length of segment : 143 time for calcul the mask position with numpy : 0.0010161399841308594 nb_pixel_total : 40831 time to create 1 rle with old method : 0.04535245895385742 length of segment : 224 time for calcul the mask position with numpy : 0.0012335777282714844 nb_pixel_total : 46087 time to create 1 rle with old method : 0.05157589912414551 length of segment : 246 time for calcul the mask position with numpy : 0.0012197494506835938 nb_pixel_total : 50645 time to create 1 rle with old method : 0.056708574295043945 length of segment : 219 time for calcul the mask position with numpy : 0.0010616779327392578 nb_pixel_total : 25456 time to create 1 rle with old method : 0.028638124465942383 length of segment : 238 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 15202 time to create 1 rle with old method : 0.017686843872070312 length of segment : 145 time for calcul the mask position with numpy : 0.0018706321716308594 nb_pixel_total : 90720 time to create 1 rle with old method : 0.10285449028015137 length of segment : 338 time for calcul the mask position with numpy : 0.003708362579345703 nb_pixel_total : 183687 time to create 1 rle with new method : 0.010213375091552734 length of segment : 479 time for calcul the mask position with numpy : 0.0017507076263427734 nb_pixel_total : 53427 time to create 1 rle with old method : 0.06009387969970703 length of segment : 283 time for calcul the mask position with numpy : 0.004717588424682617 nb_pixel_total : 229778 time to create 1 rle with new method : 0.028772354125976562 length of segment : 572 time for calcul the mask position with numpy : 0.0005931854248046875 nb_pixel_total : 7350 time to create 1 rle with old method : 0.008894205093383789 length of segment : 105 time for calcul the mask position with numpy : 0.0007560253143310547 nb_pixel_total : 30789 time to create 1 rle with old method : 0.03468441963195801 length of segment : 228 time for calcul the mask position with numpy : 0.0011649131774902344 nb_pixel_total : 57736 time to create 1 rle with old method : 0.06411552429199219 length of segment : 357 time for calcul the mask position with numpy : 0.0007970333099365234 nb_pixel_total : 28503 time to create 1 rle with old method : 0.04206490516662598 length of segment : 309 time for calcul the mask position with numpy : 0.0005817413330078125 nb_pixel_total : 18131 time to create 1 rle with old method : 0.023962974548339844 length of segment : 209 time for calcul the mask position with numpy : 0.0003559589385986328 nb_pixel_total : 10077 time to create 1 rle with old method : 0.011925697326660156 length of segment : 122 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 212291 time to create 1 rle with new method : 0.020853281021118164 length of segment : 468 time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 21529 time to create 1 rle with old method : 0.024750471115112305 length of segment : 144 time for calcul the mask position with numpy : 0.002064943313598633 nb_pixel_total : 84438 time to create 1 rle with old method : 0.09317779541015625 length of segment : 290 time for calcul the mask position with numpy : 0.009168624877929688 nb_pixel_total : 287191 time to create 1 rle with new method : 0.0371549129486084 length of segment : 547 time for calcul the mask position with numpy : 0.0005145072937011719 nb_pixel_total : 18281 time to create 1 rle with old method : 0.021610260009765625 length of segment : 153 time for calcul the mask position with numpy : 0.0002732276916503906 nb_pixel_total : 10138 time to create 1 rle with old method : 0.012205839157104492 length of segment : 148 time for calcul the mask position with numpy : 0.001961946487426758 nb_pixel_total : 50140 time to create 1 rle with old method : 0.057909488677978516 length of segment : 429 time for calcul the mask position with numpy : 0.0014801025390625 nb_pixel_total : 58625 time to create 1 rle with old method : 0.06587481498718262 length of segment : 235 time for calcul the mask position with numpy : 0.0034084320068359375 nb_pixel_total : 157366 time to create 1 rle with new method : 0.009514570236206055 length of segment : 905 time for calcul the mask position with numpy : 0.0011720657348632812 nb_pixel_total : 44473 time to create 1 rle with old method : 0.05730414390563965 length of segment : 267 time for calcul the mask position with numpy : 0.0013146400451660156 nb_pixel_total : 57688 time to create 1 rle with old method : 0.06642818450927734 length of segment : 152 time for calcul the mask position with numpy : 0.0008575916290283203 nb_pixel_total : 18950 time to create 1 rle with old method : 0.02236461639404297 length of segment : 159 time for calcul the mask position with numpy : 0.0011620521545410156 nb_pixel_total : 29515 time to create 1 rle with old method : 0.05150771141052246 length of segment : 269 time for calcul the mask position with numpy : 0.0032808780670166016 nb_pixel_total : 97456 time to create 1 rle with old method : 0.11054015159606934 length of segment : 617 time for calcul the mask position with numpy : 0.0011832714080810547 nb_pixel_total : 37042 time to create 1 rle with old method : 0.04206562042236328 length of segment : 219 time for calcul the mask position with numpy : 0.0022623538970947266 nb_pixel_total : 97259 time to create 1 rle with old method : 0.1126244068145752 length of segment : 226 time for calcul the mask position with numpy : 0.0018889904022216797 nb_pixel_total : 87312 time to create 1 rle with old method : 0.09943366050720215 length of segment : 437 time for calcul the mask position with numpy : 0.0009965896606445312 nb_pixel_total : 35331 time to create 1 rle with old method : 0.051561594009399414 length of segment : 191 time for calcul the mask position with numpy : 0.002407073974609375 nb_pixel_total : 102256 time to create 1 rle with old method : 0.1315779685974121 length of segment : 565 time for calcul the mask position with numpy : 0.0012462139129638672 nb_pixel_total : 43243 time to create 1 rle with old method : 0.05005908012390137 length of segment : 181 time for calcul the mask position with numpy : 0.002789735794067383 nb_pixel_total : 111256 time to create 1 rle with old method : 0.12545061111450195 length of segment : 348 time for calcul the mask position with numpy : 0.0034542083740234375 nb_pixel_total : 144879 time to create 1 rle with old method : 0.16410613059997559 length of segment : 492 time for calcul the mask position with numpy : 0.0011415481567382812 nb_pixel_total : 53009 time to create 1 rle with old method : 0.06051802635192871 length of segment : 271 time for calcul the mask position with numpy : 0.0007033348083496094 nb_pixel_total : 24045 time to create 1 rle with old method : 0.02732682228088379 length of segment : 186 time for calcul the mask position with numpy : 0.001783609390258789 nb_pixel_total : 65699 time to create 1 rle with old method : 0.09367752075195312 length of segment : 274 time for calcul the mask position with numpy : 0.0028820037841796875 nb_pixel_total : 112916 time to create 1 rle with old method : 0.12817955017089844 length of segment : 238 time for calcul the mask position with numpy : 0.0011777877807617188 nb_pixel_total : 46827 time to create 1 rle with old method : 0.05433011054992676 length of segment : 267 time for calcul the mask position with numpy : 0.005816221237182617 nb_pixel_total : 104833 time to create 1 rle with old method : 0.11978721618652344 length of segment : 412 time for calcul the mask position with numpy : 0.0016202926635742188 nb_pixel_total : 49634 time to create 1 rle with old method : 0.06473588943481445 length of segment : 325 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 32364 time to create 1 rle with old method : 0.03910636901855469 length of segment : 224 time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 20246 time to create 1 rle with old method : 0.024202585220336914 length of segment : 134 time for calcul the mask position with numpy : 0.0018198490142822266 nb_pixel_total : 84126 time to create 1 rle with old method : 0.12191176414489746 length of segment : 305 time for calcul the mask position with numpy : 0.002500772476196289 nb_pixel_total : 80125 time to create 1 rle with old method : 0.08991074562072754 length of segment : 335 time for calcul the mask position with numpy : 0.003896474838256836 nb_pixel_total : 168055 time to create 1 rle with new method : 0.011245012283325195 length of segment : 372 time for calcul the mask position with numpy : 0.0019516944885253906 nb_pixel_total : 72474 time to create 1 rle with old method : 0.08339095115661621 length of segment : 332 time spent for convertir_results : 41.45394492149353 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 398 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 124.84359169006348 time spend to save output : 0.18586015701293945 total time spend for step 2 : 125.02945184707642 step3:blur_detection Wed May 21 16:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.010132312774658203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.009767770767211914 save missing photos in datou_result : time spend for datou_step_exec : 0.037177324295043945 time spend to save output : 0.024749040603637695 total time spend for step 3 : 0.06192636489868164 step4:brightness Wed May 21 16:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.008854150772094727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.00795888900756836 save missing photos in datou_result : time spend for datou_step_exec : 0.027274608612060547 time spend to save output : 0.02161693572998047 total time spend for step 4 : 0.048891544342041016 step5:rle_unique_nms_with_priority Wed May 21 16:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 398 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 108 nb_hashtags : 10 time to prepare the origin masks : 53.24207019805908 time for calcul the mask position with numpy : 0.19689154624938965 nb_pixel_total : 3128889 time to create 1 rle with new method : 1.3471062183380127 time for calcul the mask position with numpy : 0.050519704818725586 nb_pixel_total : 362434 time to create 1 rle with new method : 0.7298586368560791 time for calcul the mask position with numpy : 0.03890371322631836 nb_pixel_total : 13881 time to create 1 rle with old method : 0.015295743942260742 time for calcul the mask position with numpy : 0.03875851631164551 nb_pixel_total : 11324 time to create 1 rle with old method : 0.011993408203125 time for calcul the mask position with numpy : 0.042124032974243164 nb_pixel_total : 14400 time to create 1 rle with old method : 0.02316451072692871 time for calcul the mask position with numpy : 0.05901813507080078 nb_pixel_total : 758381 time to create 1 rle with new method : 0.8704099655151367 time for calcul the mask position with numpy : 0.04071331024169922 nb_pixel_total : 125871 time to create 1 rle with old method : 0.14098620414733887 time for calcul the mask position with numpy : 0.04035615921020508 nb_pixel_total : 16115 time to create 1 rle with old method : 0.018035411834716797 time for calcul the mask position with numpy : 0.04002952575683594 nb_pixel_total : 168 time to create 1 rle with old method : 0.0010464191436767578 time for calcul the mask position with numpy : 0.04039263725280762 nb_pixel_total : 11088 time to create 1 rle with old method : 0.013444185256958008 time for calcul the mask position with numpy : 0.040827274322509766 nb_pixel_total : 50850 time to create 1 rle with old method : 0.05670619010925293 time for calcul the mask position with numpy : 0.04070448875427246 nb_pixel_total : 122044 time to create 1 rle with old method : 0.15325379371643066 time for calcul the mask position with numpy : 0.04322075843811035 nb_pixel_total : 15204 time to create 1 rle with old method : 0.01672506332397461 time for calcul the mask position with numpy : 0.04117941856384277 nb_pixel_total : 338867 time to create 1 rle with new method : 0.8874778747558594 time for calcul the mask position with numpy : 0.041681766510009766 nb_pixel_total : 9566 time to create 1 rle with old method : 0.010744571685791016 time for calcul the mask position with numpy : 0.03959393501281738 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007936954498291016 time for calcul the mask position with numpy : 0.03961634635925293 nb_pixel_total : 35914 time to create 1 rle with old method : 0.03955435752868652 time for calcul the mask position with numpy : 0.04005622863769531 nb_pixel_total : 13920 time to create 1 rle with old method : 0.016129493713378906 time for calcul the mask position with numpy : 0.039800167083740234 nb_pixel_total : 64498 time to create 1 rle with old method : 0.07530975341796875 time for calcul the mask position with numpy : 0.04592490196228027 nb_pixel_total : 54808 time to create 1 rle with old method : 0.06839704513549805 time for calcul the mask position with numpy : 0.03809976577758789 nb_pixel_total : 324 time to create 1 rle with old method : 0.0006899833679199219 time for calcul the mask position with numpy : 0.03936338424682617 nb_pixel_total : 31866 time to create 1 rle with old method : 0.03502058982849121 time for calcul the mask position with numpy : 0.039574623107910156 nb_pixel_total : 17517 time to create 1 rle with old method : 0.01953721046447754 time for calcul the mask position with numpy : 0.041748046875 nb_pixel_total : 210632 time to create 1 rle with new method : 0.7606148719787598 time for calcul the mask position with numpy : 0.03892159461975098 nb_pixel_total : 1618 time to create 1 rle with old method : 0.002108335494995117 time for calcul the mask position with numpy : 0.03907513618469238 nb_pixel_total : 70648 time to create 1 rle with old method : 0.07662272453308105 time for calcul the mask position with numpy : 0.03927278518676758 nb_pixel_total : 526 time to create 1 rle with old method : 0.0008668899536132812 time for calcul the mask position with numpy : 0.03958392143249512 nb_pixel_total : 36416 time to create 1 rle with old method : 0.0439457893371582 time for calcul the mask position with numpy : 0.04068255424499512 nb_pixel_total : 36381 time to create 1 rle with old method : 0.040550947189331055 time for calcul the mask position with numpy : 0.04044508934020996 nb_pixel_total : 16510 time to create 1 rle with old method : 0.018691062927246094 time for calcul the mask position with numpy : 0.04055643081665039 nb_pixel_total : 8218 time to create 1 rle with old method : 0.009807825088500977 time for calcul the mask position with numpy : 0.04030466079711914 nb_pixel_total : 87488 time to create 1 rle with old method : 0.09607362747192383 time for calcul the mask position with numpy : 0.03956723213195801 nb_pixel_total : 54391 time to create 1 rle with old method : 0.06010270118713379 time for calcul the mask position with numpy : 0.0399324893951416 nb_pixel_total : 49175 time to create 1 rle with old method : 0.054909706115722656 time for calcul the mask position with numpy : 0.03955507278442383 nb_pixel_total : 47986 time to create 1 rle with old method : 0.052655696868896484 time for calcul the mask position with numpy : 0.040863990783691406 nb_pixel_total : 61550 time to create 1 rle with old method : 0.0691215991973877 time for calcul the mask position with numpy : 0.038880109786987305 nb_pixel_total : 4467 time to create 1 rle with old method : 0.005259275436401367 time for calcul the mask position with numpy : 0.040436506271362305 nb_pixel_total : 87138 time to create 1 rle with old method : 0.10308504104614258 time for calcul the mask position with numpy : 0.03995704650878906 nb_pixel_total : 93965 time to create 1 rle with old method : 0.1291489601135254 time for calcul the mask position with numpy : 0.04027056694030762 nb_pixel_total : 18632 time to create 1 rle with old method : 0.021025896072387695 time for calcul the mask position with numpy : 0.039292335510253906 nb_pixel_total : 63456 time to create 1 rle with old method : 0.06675267219543457 time for calcul the mask position with numpy : 0.03849387168884277 nb_pixel_total : 40445 time to create 1 rle with old method : 0.0458829402923584 time for calcul the mask position with numpy : 0.04024529457092285 nb_pixel_total : 48578 time to create 1 rle with old method : 0.054724693298339844 time for calcul the mask position with numpy : 0.04042983055114746 nb_pixel_total : 80157 time to create 1 rle with old method : 0.11636662483215332 time for calcul the mask position with numpy : 0.039649009704589844 nb_pixel_total : 4088 time to create 1 rle with old method : 0.00461125373840332 time for calcul the mask position with numpy : 0.041962623596191406 nb_pixel_total : 110092 time to create 1 rle with old method : 0.11477112770080566 time for calcul the mask position with numpy : 0.039365291595458984 nb_pixel_total : 152035 time to create 1 rle with new method : 1.122729778289795 time for calcul the mask position with numpy : 0.03812265396118164 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0015993118286132812 time for calcul the mask position with numpy : 0.038503170013427734 nb_pixel_total : 45874 time to create 1 rle with old method : 0.04865002632141113 time for calcul the mask position with numpy : 0.03730058670043945 nb_pixel_total : 1953 time to create 1 rle with old method : 0.002133607864379883 time for calcul the mask position with numpy : 0.03813958168029785 nb_pixel_total : 12328 time to create 1 rle with old method : 0.0135345458984375 time for calcul the mask position with numpy : 0.038729190826416016 nb_pixel_total : 41630 time to create 1 rle with old method : 0.04591798782348633 time for calcul the mask position with numpy : 0.03818869590759277 nb_pixel_total : 3664 time to create 1 rle with old method : 0.0047893524169921875 time for calcul the mask position with numpy : 0.03997302055358887 nb_pixel_total : 178344 time to create 1 rle with new method : 0.58583664894104 time for calcul the mask position with numpy : 0.040270090103149414 nb_pixel_total : 17777 time to create 1 rle with old method : 0.0207822322845459 time for calcul the mask position with numpy : 0.04012107849121094 nb_pixel_total : 12714 time to create 1 rle with old method : 0.014723539352416992 time for calcul the mask position with numpy : 0.03994941711425781 nb_pixel_total : 1575 time to create 1 rle with old method : 0.0030472278594970703 time for calcul the mask position with numpy : 0.0474553108215332 nb_pixel_total : 360919 time to create 1 rle with new method : 0.8729348182678223 time for calcul the mask position with numpy : 0.04022502899169922 nb_pixel_total : 45874 time to create 1 rle with old method : 0.051378726959228516 time for calcul the mask position with numpy : 0.03926253318786621 nb_pixel_total : 35498 time to create 1 rle with old method : 0.03930163383483887 time for calcul the mask position with numpy : 0.039458274841308594 nb_pixel_total : 16656 time to create 1 rle with old method : 0.018495559692382812 time for calcul the mask position with numpy : 0.040345191955566406 nb_pixel_total : 11584 time to create 1 rle with old method : 0.018642902374267578 time for calcul the mask position with numpy : 0.04516935348510742 nb_pixel_total : 8713 time to create 1 rle with old method : 0.009840726852416992 time for calcul the mask position with numpy : 0.03937220573425293 nb_pixel_total : 1545 time to create 1 rle with old method : 0.0019330978393554688 time for calcul the mask position with numpy : 0.03916811943054199 nb_pixel_total : 27762 time to create 1 rle with old method : 0.030968189239501953 time for calcul the mask position with numpy : 0.03990650177001953 nb_pixel_total : 31940 time to create 1 rle with old method : 0.03522825241088867 time for calcul the mask position with numpy : 0.03816366195678711 nb_pixel_total : 37314 time to create 1 rle with old method : 0.04381537437438965 time for calcul the mask position with numpy : 0.04221987724304199 nb_pixel_total : 49273 time to create 1 rle with old method : 0.05411553382873535 time for calcul the mask position with numpy : 0.039124250411987305 nb_pixel_total : 2084 time to create 1 rle with old method : 0.002637624740600586 time for calcul the mask position with numpy : 0.03947114944458008 nb_pixel_total : 2560 time to create 1 rle with old method : 0.0029480457305908203 time for calcul the mask position with numpy : 0.038909912109375 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0012798309326171875 time for calcul the mask position with numpy : 0.03927254676818848 nb_pixel_total : 9068 time to create 1 rle with old method : 0.01012730598449707 time for calcul the mask position with numpy : 0.04058194160461426 nb_pixel_total : 183585 time to create 1 rle with new method : 1.6921741962432861 time for calcul the mask position with numpy : 0.0388185977935791 nb_pixel_total : 87 time to create 1 rle with old method : 0.00022602081298828125 time for calcul the mask position with numpy : 0.0386815071105957 nb_pixel_total : 129940 time to create 1 rle with old method : 0.1433720588684082 time for calcul the mask position with numpy : 0.04146528244018555 nb_pixel_total : 265100 time to create 1 rle with new method : 1.144639015197754 time for calcul the mask position with numpy : 0.03783011436462402 nb_pixel_total : 101939 time to create 1 rle with old method : 0.11021041870117188 time for calcul the mask position with numpy : 0.03872990608215332 nb_pixel_total : 13611 time to create 1 rle with old method : 0.014917135238647461 time for calcul the mask position with numpy : 0.039038658142089844 nb_pixel_total : 64785 time to create 1 rle with old method : 0.06922149658203125 time for calcul the mask position with numpy : 0.03864789009094238 nb_pixel_total : 38528 time to create 1 rle with old method : 0.04231977462768555 time for calcul the mask position with numpy : 0.03918814659118652 nb_pixel_total : 47589 time to create 1 rle with old method : 0.05100226402282715 time for calcul the mask position with numpy : 0.03802800178527832 nb_pixel_total : 39825 time to create 1 rle with old method : 0.04163503646850586 time for calcul the mask position with numpy : 0.03727269172668457 nb_pixel_total : 47678 time to create 1 rle with old method : 0.04970669746398926 time for calcul the mask position with numpy : 0.03740954399108887 nb_pixel_total : 10239 time to create 1 rle with old method : 0.010667085647583008 time for calcul the mask position with numpy : 0.03676962852478027 nb_pixel_total : 1221 time to create 1 rle with old method : 0.001506805419921875 time for calcul the mask position with numpy : 0.036871910095214844 nb_pixel_total : 67710 time to create 1 rle with old method : 0.0728757381439209 time for calcul the mask position with numpy : 0.03728079795837402 nb_pixel_total : 7988 time to create 1 rle with old method : 0.00841379165649414 time for calcul the mask position with numpy : 0.03792834281921387 nb_pixel_total : 31031 time to create 1 rle with old method : 0.05159807205200195 time for calcul the mask position with numpy : 0.045256614685058594 nb_pixel_total : 84547 time to create 1 rle with old method : 0.0892629623413086 time for calcul the mask position with numpy : 0.03940224647521973 nb_pixel_total : 27246 time to create 1 rle with old method : 0.030684947967529297 time for calcul the mask position with numpy : 0.0400998592376709 nb_pixel_total : 159 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.03942108154296875 nb_pixel_total : 2760 time to create 1 rle with old method : 0.003244638442993164 time for calcul the mask position with numpy : 0.04026365280151367 nb_pixel_total : 14823 time to create 1 rle with old method : 0.016272783279418945 time for calcul the mask position with numpy : 0.039858341217041016 nb_pixel_total : 168542 time to create 1 rle with new method : 0.801525354385376 time for calcul the mask position with numpy : 0.03873801231384277 nb_pixel_total : 38169 time to create 1 rle with old method : 0.04046988487243652 time for calcul the mask position with numpy : 0.03824281692504883 nb_pixel_total : 5 time to create 1 rle with old method : 5.0067901611328125e-05 time for calcul the mask position with numpy : 0.038907766342163086 nb_pixel_total : 452 time to create 1 rle with old method : 0.0012004375457763672 time for calcul the mask position with numpy : 0.042360544204711914 nb_pixel_total : 57718 time to create 1 rle with old method : 0.06426715850830078 time for calcul the mask position with numpy : 0.04457569122314453 nb_pixel_total : 96653 time to create 1 rle with old method : 0.13225364685058594 time for calcul the mask position with numpy : 0.04174375534057617 nb_pixel_total : 4681 time to create 1 rle with old method : 0.005556821823120117 time for calcul the mask position with numpy : 0.03963327407836914 nb_pixel_total : 211363 time to create 1 rle with new method : 0.7337195873260498 time for calcul the mask position with numpy : 0.03918766975402832 nb_pixel_total : 79962 time to create 1 rle with old method : 0.08962583541870117 time for calcul the mask position with numpy : 0.04048323631286621 nb_pixel_total : 96432 time to create 1 rle with old method : 0.10496759414672852 time for calcul the mask position with numpy : 0.03989052772521973 nb_pixel_total : 56119 time to create 1 rle with old method : 0.06295490264892578 time for calcul the mask position with numpy : 0.042627811431884766 nb_pixel_total : 8116 time to create 1 rle with old method : 0.009689569473266602 time for calcul the mask position with numpy : 0.0408625602722168 nb_pixel_total : 76500 time to create 1 rle with old method : 0.08282971382141113 time for calcul the mask position with numpy : 0.038516998291015625 nb_pixel_total : 76086 time to create 1 rle with old method : 0.08343172073364258 time for calcul the mask position with numpy : 0.03863930702209473 nb_pixel_total : 15193 time to create 1 rle with old method : 0.01619434356689453 time for calcul the mask position with numpy : 0.03731250762939453 nb_pixel_total : 25877 time to create 1 rle with old method : 0.026677608489990234 create new chi : 20.380438804626465 time to delete rle : 0.05104207992553711 batch 1 Loaded 111 chid ids of type : 4855 Number RLEs to save : 56885 TO DO : save crop sub photo not yet done ! save time : 3.3324732780456543 nb_obj : 106 nb_hashtags : 11 time to prepare the origin masks : 55.60652160644531 time for calcul the mask position with numpy : 0.3246734142303467 nb_pixel_total : 2902350 time to create 1 rle with new method : 1.0555996894836426 time for calcul the mask position with numpy : 0.043575286865234375 nb_pixel_total : 18687 time to create 1 rle with old method : 0.022000789642333984 time for calcul the mask position with numpy : 0.04067564010620117 nb_pixel_total : 44062 time to create 1 rle with old method : 0.04876136779785156 time for calcul the mask position with numpy : 0.04004096984863281 nb_pixel_total : 437 time to create 1 rle with old method : 0.0010225772857666016 time for calcul the mask position with numpy : 0.043447256088256836 nb_pixel_total : 106861 time to create 1 rle with old method : 0.11734461784362793 time for calcul the mask position with numpy : 0.038442373275756836 nb_pixel_total : 21954 time to create 1 rle with old method : 0.023113250732421875 time for calcul the mask position with numpy : 0.03723788261413574 nb_pixel_total : 665 time to create 1 rle with old method : 0.000888824462890625 time for calcul the mask position with numpy : 0.03865480422973633 nb_pixel_total : 117011 time to create 1 rle with old method : 0.12818169593811035 time for calcul the mask position with numpy : 0.04253673553466797 nb_pixel_total : 328188 time to create 1 rle with new method : 1.4284632205963135 time for calcul the mask position with numpy : 0.045830726623535156 nb_pixel_total : 439478 time to create 1 rle with new method : 1.3624975681304932 time for calcul the mask position with numpy : 0.03892946243286133 nb_pixel_total : 8892 time to create 1 rle with old method : 0.009877204895019531 time for calcul the mask position with numpy : 0.03827357292175293 nb_pixel_total : 1804 time to create 1 rle with old method : 0.002087831497192383 time for calcul the mask position with numpy : 0.03825950622558594 nb_pixel_total : 84869 time to create 1 rle with old method : 0.09233808517456055 time for calcul the mask position with numpy : 0.03795504570007324 nb_pixel_total : 5423 time to create 1 rle with old method : 0.005944490432739258 time for calcul the mask position with numpy : 0.03857588768005371 nb_pixel_total : 40357 time to create 1 rle with old method : 0.04332375526428223 time for calcul the mask position with numpy : 0.03856611251831055 nb_pixel_total : 13014 time to create 1 rle with old method : 0.014007806777954102 time for calcul the mask position with numpy : 0.03918814659118652 nb_pixel_total : 77138 time to create 1 rle with old method : 0.08289074897766113 time for calcul the mask position with numpy : 0.03954577445983887 nb_pixel_total : 59488 time to create 1 rle with old method : 0.06585359573364258 time for calcul the mask position with numpy : 0.0403292179107666 nb_pixel_total : 10783 time to create 1 rle with old method : 0.012268543243408203 time for calcul the mask position with numpy : 0.04105877876281738 nb_pixel_total : 169102 time to create 1 rle with new method : 1.0110480785369873 time for calcul the mask position with numpy : 0.0383458137512207 nb_pixel_total : 28982 time to create 1 rle with old method : 0.030607223510742188 time for calcul the mask position with numpy : 0.03718304634094238 nb_pixel_total : 14401 time to create 1 rle with old method : 0.01578378677368164 time for calcul the mask position with numpy : 0.03895211219787598 nb_pixel_total : 71570 time to create 1 rle with old method : 0.07817602157592773 time for calcul the mask position with numpy : 0.04008936882019043 nb_pixel_total : 291628 time to create 1 rle with new method : 0.8227014541625977 time for calcul the mask position with numpy : 0.03846287727355957 nb_pixel_total : 34845 time to create 1 rle with old method : 0.03825235366821289 time for calcul the mask position with numpy : 0.04003405570983887 nb_pixel_total : 72093 time to create 1 rle with old method : 0.07801938056945801 time for calcul the mask position with numpy : 0.03877615928649902 nb_pixel_total : 25754 time to create 1 rle with old method : 0.02669501304626465 time for calcul the mask position with numpy : 0.03782320022583008 nb_pixel_total : 11717 time to create 1 rle with old method : 0.012791156768798828 time for calcul the mask position with numpy : 0.040888309478759766 nb_pixel_total : 243710 time to create 1 rle with new method : 0.8352022171020508 time for calcul the mask position with numpy : 0.039259910583496094 nb_pixel_total : 2725 time to create 1 rle with old method : 0.0033638477325439453 time for calcul the mask position with numpy : 0.03835129737854004 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009174346923828125 time for calcul the mask position with numpy : 0.03849506378173828 nb_pixel_total : 20111 time to create 1 rle with old method : 0.022016286849975586 time for calcul the mask position with numpy : 0.03842639923095703 nb_pixel_total : 19 time to create 1 rle with old method : 0.00018835067749023438 time for calcul the mask position with numpy : 0.03745436668395996 nb_pixel_total : 62401 time to create 1 rle with old method : 0.06631612777709961 time for calcul the mask position with numpy : 0.03965425491333008 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.040409088134765625 nb_pixel_total : 197210 time to create 1 rle with new method : 0.8457107543945312 time for calcul the mask position with numpy : 0.0415804386138916 nb_pixel_total : 37340 time to create 1 rle with old method : 0.04215383529663086 time for calcul the mask position with numpy : 0.039182186126708984 nb_pixel_total : 1 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.037993431091308594 nb_pixel_total : 2943 time to create 1 rle with old method : 0.005940675735473633 time for calcul the mask position with numpy : 0.042209625244140625 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0029425621032714844 time for calcul the mask position with numpy : 0.0453643798828125 nb_pixel_total : 25807 time to create 1 rle with old method : 0.030176877975463867 time for calcul the mask position with numpy : 0.04018712043762207 nb_pixel_total : 5383 time to create 1 rle with old method : 0.0061893463134765625 time for calcul the mask position with numpy : 0.0398409366607666 nb_pixel_total : 47798 time to create 1 rle with old method : 0.055269718170166016 time for calcul the mask position with numpy : 0.040375709533691406 nb_pixel_total : 28980 time to create 1 rle with old method : 0.0325777530670166 time for calcul the mask position with numpy : 0.039972543716430664 nb_pixel_total : 20800 time to create 1 rle with old method : 0.023627519607543945 time for calcul the mask position with numpy : 0.04016828536987305 nb_pixel_total : 1316 time to create 1 rle with old method : 0.00177001953125 time for calcul the mask position with numpy : 0.039716243743896484 nb_pixel_total : 3534 time to create 1 rle with old method : 0.004292011260986328 time for calcul the mask position with numpy : 0.04002690315246582 nb_pixel_total : 251723 time to create 1 rle with new method : 0.7632594108581543 time for calcul the mask position with numpy : 0.040402889251708984 nb_pixel_total : 77173 time to create 1 rle with old method : 0.08652663230895996 time for calcul the mask position with numpy : 0.03926372528076172 nb_pixel_total : 28684 time to create 1 rle with old method : 0.03231549263000488 time for calcul the mask position with numpy : 0.03959846496582031 nb_pixel_total : 13142 time to create 1 rle with old method : 0.014525175094604492 time for calcul the mask position with numpy : 0.039563655853271484 nb_pixel_total : 21796 time to create 1 rle with old method : 0.02411174774169922 time for calcul the mask position with numpy : 0.03918099403381348 nb_pixel_total : 2057 time to create 1 rle with old method : 0.0025446414947509766 time for calcul the mask position with numpy : 0.03982901573181152 nb_pixel_total : 158586 time to create 1 rle with new method : 0.851677417755127 time for calcul the mask position with numpy : 0.040377140045166016 nb_pixel_total : 19279 time to create 1 rle with old method : 0.021586179733276367 time for calcul the mask position with numpy : 0.040654897689819336 nb_pixel_total : 18289 time to create 1 rle with old method : 0.021340131759643555 time for calcul the mask position with numpy : 0.040102481842041016 nb_pixel_total : 1513 time to create 1 rle with old method : 0.0019559860229492188 time for calcul the mask position with numpy : 0.03987598419189453 nb_pixel_total : 12824 time to create 1 rle with old method : 0.01468205451965332 time for calcul the mask position with numpy : 0.04244208335876465 nb_pixel_total : 277947 time to create 1 rle with new method : 1.8609745502471924 time for calcul the mask position with numpy : 0.03786635398864746 nb_pixel_total : 8335 time to create 1 rle with old method : 0.009766578674316406 time for calcul the mask position with numpy : 0.03780055046081543 nb_pixel_total : 36743 time to create 1 rle with old method : 0.04064512252807617 time for calcul the mask position with numpy : 0.04346060752868652 nb_pixel_total : 21700 time to create 1 rle with old method : 0.034441471099853516 time for calcul the mask position with numpy : 0.04330253601074219 nb_pixel_total : 65187 time to create 1 rle with old method : 0.07111454010009766 time for calcul the mask position with numpy : 0.03847622871398926 nb_pixel_total : 28042 time to create 1 rle with old method : 0.030425548553466797 time for calcul the mask position with numpy : 0.03993654251098633 nb_pixel_total : 12758 time to create 1 rle with old method : 0.014388322830200195 time for calcul the mask position with numpy : 0.040183305740356445 nb_pixel_total : 14031 time to create 1 rle with old method : 0.017630338668823242 time for calcul the mask position with numpy : 0.04094290733337402 nb_pixel_total : 7158 time to create 1 rle with old method : 0.008435249328613281 time for calcul the mask position with numpy : 0.04002094268798828 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009033679962158203 time for calcul the mask position with numpy : 0.04011988639831543 nb_pixel_total : 38708 time to create 1 rle with old method : 0.04374384880065918 time for calcul the mask position with numpy : 0.03998684883117676 nb_pixel_total : 1116 time to create 1 rle with old method : 0.001500844955444336 time for calcul the mask position with numpy : 0.04026317596435547 nb_pixel_total : 13553 time to create 1 rle with old method : 0.015308380126953125 time for calcul the mask position with numpy : 0.03991222381591797 nb_pixel_total : 23898 time to create 1 rle with old method : 0.026312589645385742 time for calcul the mask position with numpy : 0.0375514030456543 nb_pixel_total : 33673 time to create 1 rle with old method : 0.037421226501464844 time for calcul the mask position with numpy : 0.039964914321899414 nb_pixel_total : 18405 time to create 1 rle with old method : 0.019974708557128906 time for calcul the mask position with numpy : 0.03860759735107422 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007262229919433594 time for calcul the mask position with numpy : 0.04944467544555664 nb_pixel_total : 794529 time to create 1 rle with new method : 0.951056957244873 time for calcul the mask position with numpy : 0.039640188217163086 nb_pixel_total : 64333 time to create 1 rle with old method : 0.07140278816223145 time for calcul the mask position with numpy : 0.039139509201049805 nb_pixel_total : 14882 time to create 1 rle with old method : 0.016927480697631836 time for calcul the mask position with numpy : 0.040535688400268555 nb_pixel_total : 140047 time to create 1 rle with old method : 0.15353822708129883 time for calcul the mask position with numpy : 0.041258811950683594 nb_pixel_total : 185882 time to create 1 rle with new method : 0.9540338516235352 time for calcul the mask position with numpy : 0.040019989013671875 nb_pixel_total : 9225 time to create 1 rle with old method : 0.010903120040893555 time for calcul the mask position with numpy : 0.04017162322998047 nb_pixel_total : 51015 time to create 1 rle with old method : 0.057244300842285156 time for calcul the mask position with numpy : 0.04045534133911133 nb_pixel_total : 66534 time to create 1 rle with old method : 0.07667136192321777 time for calcul the mask position with numpy : 0.04245257377624512 nb_pixel_total : 319600 time to create 1 rle with new method : 0.708071231842041 time for calcul the mask position with numpy : 0.04571986198425293 nb_pixel_total : 6908 time to create 1 rle with old method : 0.011633634567260742 time for calcul the mask position with numpy : 0.043959856033325195 nb_pixel_total : 11752 time to create 1 rle with old method : 0.013253927230834961 time for calcul the mask position with numpy : 0.04035639762878418 nb_pixel_total : 18508 time to create 1 rle with old method : 0.021132230758666992 time for calcul the mask position with numpy : 0.04125857353210449 nb_pixel_total : 120321 time to create 1 rle with old method : 0.13391804695129395 time for calcul the mask position with numpy : 0.04198336601257324 nb_pixel_total : 53235 time to create 1 rle with old method : 0.06032204627990723 time for calcul the mask position with numpy : 0.046616315841674805 nb_pixel_total : 274436 time to create 1 rle with new method : 0.9685697555541992 time for calcul the mask position with numpy : 0.04013490676879883 nb_pixel_total : 33847 time to create 1 rle with old method : 0.03662753105163574 time for calcul the mask position with numpy : 0.03972935676574707 nb_pixel_total : 25926 time to create 1 rle with old method : 0.028415203094482422 time for calcul the mask position with numpy : 0.03875374794006348 nb_pixel_total : 121305 time to create 1 rle with old method : 0.1298832893371582 time for calcul the mask position with numpy : 0.037940025329589844 nb_pixel_total : 8945 time to create 1 rle with old method : 0.009807348251342773 time for calcul the mask position with numpy : 0.03927755355834961 nb_pixel_total : 112208 time to create 1 rle with old method : 0.12270665168762207 time for calcul the mask position with numpy : 0.03913068771362305 nb_pixel_total : 106401 time to create 1 rle with old method : 0.11170768737792969 time for calcul the mask position with numpy : 0.038419246673583984 nb_pixel_total : 30988 time to create 1 rle with old method : 0.033020734786987305 time for calcul the mask position with numpy : 0.039498090744018555 nb_pixel_total : 39133 time to create 1 rle with old method : 0.0417633056640625 time for calcul the mask position with numpy : 0.039382219314575195 nb_pixel_total : 13650 time to create 1 rle with old method : 0.015122175216674805 time for calcul the mask position with numpy : 0.03860306739807129 nb_pixel_total : 26329 time to create 1 rle with old method : 0.029224634170532227 time for calcul the mask position with numpy : 0.039716243743896484 nb_pixel_total : 66022 time to create 1 rle with old method : 0.07298564910888672 time for calcul the mask position with numpy : 0.04014873504638672 nb_pixel_total : 23844 time to create 1 rle with old method : 0.025755882263183594 time for calcul the mask position with numpy : 0.03789877891540527 nb_pixel_total : 24081 time to create 1 rle with old method : 0.026513338088989258 time for calcul the mask position with numpy : 0.04039597511291504 nb_pixel_total : 33011 time to create 1 rle with old method : 0.03714871406555176 time for calcul the mask position with numpy : 0.04016876220703125 nb_pixel_total : 13800 time to create 1 rle with old method : 0.01575779914855957 time for calcul the mask position with numpy : 0.040238142013549805 nb_pixel_total : 4797 time to create 1 rle with old method : 0.005545377731323242 time for calcul the mask position with numpy : 0.04028797149658203 nb_pixel_total : 7236 time to create 1 rle with old method : 0.00819087028503418 create new chi : 22.676748037338257 time to delete rle : 0.005552053451538086 batch 1 Loaded 109 chid ids of type : 4855 Number RLEs to save : 59054 TO DO : save crop sub photo not yet done ! save time : 3.521615743637085 nb_obj : 65 nb_hashtags : 9 time to prepare the origin masks : 41.47351861000061 time for calcul the mask position with numpy : 0.07579278945922852 nb_pixel_total : 2296438 time to create 1 rle with new method : 1.0929031372070312 time for calcul the mask position with numpy : 0.04077458381652832 nb_pixel_total : 3059 time to create 1 rle with old method : 0.004034280776977539 time for calcul the mask position with numpy : 0.04275250434875488 nb_pixel_total : 257965 time to create 1 rle with new method : 0.8669078350067139 time for calcul the mask position with numpy : 0.05069088935852051 nb_pixel_total : 52251 time to create 1 rle with old method : 0.06256484985351562 time for calcul the mask position with numpy : 0.03958630561828613 nb_pixel_total : 5072 time to create 1 rle with old method : 0.005489349365234375 time for calcul the mask position with numpy : 0.05863761901855469 nb_pixel_total : 1317517 time to create 1 rle with new method : 1.3456110954284668 time for calcul the mask position with numpy : 0.04981589317321777 nb_pixel_total : 727012 time to create 1 rle with new method : 0.697504997253418 time for calcul the mask position with numpy : 0.04018211364746094 nb_pixel_total : 33705 time to create 1 rle with old method : 0.03709053993225098 time for calcul the mask position with numpy : 0.039960384368896484 nb_pixel_total : 85187 time to create 1 rle with old method : 0.09414196014404297 time for calcul the mask position with numpy : 0.04056143760681152 nb_pixel_total : 3363 time to create 1 rle with old method : 0.004081249237060547 time for calcul the mask position with numpy : 0.040242910385131836 nb_pixel_total : 19716 time to create 1 rle with old method : 0.022307634353637695 time for calcul the mask position with numpy : 0.041658639907836914 nb_pixel_total : 80434 time to create 1 rle with old method : 0.09221434593200684 time for calcul the mask position with numpy : 0.04074859619140625 nb_pixel_total : 13587 time to create 1 rle with old method : 0.01653885841369629 time for calcul the mask position with numpy : 0.04263758659362793 nb_pixel_total : 62160 time to create 1 rle with old method : 0.07031536102294922 time for calcul the mask position with numpy : 0.040192604064941406 nb_pixel_total : 18498 time to create 1 rle with old method : 0.020515918731689453 time for calcul the mask position with numpy : 0.03923916816711426 nb_pixel_total : 8020 time to create 1 rle with old method : 0.009076356887817383 time for calcul the mask position with numpy : 0.03925728797912598 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003876686096191406 time for calcul the mask position with numpy : 0.041555166244506836 nb_pixel_total : 158796 time to create 1 rle with new method : 1.282092809677124 time for calcul the mask position with numpy : 0.04207444190979004 nb_pixel_total : 47777 time to create 1 rle with old method : 0.05518484115600586 time for calcul the mask position with numpy : 0.042737483978271484 nb_pixel_total : 80129 time to create 1 rle with old method : 0.09163475036621094 time for calcul the mask position with numpy : 0.0523526668548584 nb_pixel_total : 745811 time to create 1 rle with new method : 1.5521266460418701 time for calcul the mask position with numpy : 0.04012131690979004 nb_pixel_total : 32112 time to create 1 rle with old method : 0.034726858139038086 time for calcul the mask position with numpy : 0.04113888740539551 nb_pixel_total : 31228 time to create 1 rle with old method : 0.05042219161987305 time for calcul the mask position with numpy : 0.03966379165649414 nb_pixel_total : 3216 time to create 1 rle with old method : 0.003496885299682617 time for calcul the mask position with numpy : 0.038364410400390625 nb_pixel_total : 8325 time to create 1 rle with old method : 0.008977651596069336 time for calcul the mask position with numpy : 0.03881978988647461 nb_pixel_total : 19433 time to create 1 rle with old method : 0.02130579948425293 time for calcul the mask position with numpy : 0.03885173797607422 nb_pixel_total : 1893 time to create 1 rle with old method : 0.0023276805877685547 time for calcul the mask position with numpy : 0.0393681526184082 nb_pixel_total : 28866 time to create 1 rle with old method : 0.03247809410095215 time for calcul the mask position with numpy : 0.0433964729309082 nb_pixel_total : 311689 time to create 1 rle with new method : 1.186598300933838 time for calcul the mask position with numpy : 0.039316415786743164 nb_pixel_total : 25790 time to create 1 rle with old method : 0.02846217155456543 time for calcul the mask position with numpy : 0.03950667381286621 nb_pixel_total : 28137 time to create 1 rle with old method : 0.030658960342407227 time for calcul the mask position with numpy : 0.03935647010803223 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0015339851379394531 time for calcul the mask position with numpy : 0.038393259048461914 nb_pixel_total : 92596 time to create 1 rle with old method : 0.1014864444732666 time for calcul the mask position with numpy : 0.038463592529296875 nb_pixel_total : 3538 time to create 1 rle with old method : 0.004428863525390625 time for calcul the mask position with numpy : 0.039553165435791016 nb_pixel_total : 273747 time to create 1 rle with new method : 1.2641818523406982 time for calcul the mask position with numpy : 0.037645816802978516 nb_pixel_total : 5569 time to create 1 rle with old method : 0.006308794021606445 time for calcul the mask position with numpy : 0.0376744270324707 nb_pixel_total : 68285 time to create 1 rle with old method : 0.07079291343688965 time for calcul the mask position with numpy : 0.03699135780334473 nb_pixel_total : 15962 time to create 1 rle with old method : 0.017409324645996094 time for calcul the mask position with numpy : 0.038137197494506836 nb_pixel_total : 15819 time to create 1 rle with old method : 0.31312084197998047 time for calcul the mask position with numpy : 0.04497647285461426 nb_pixel_total : 657226 time to create 1 rle with new method : 0.6606590747833252 time for calcul the mask position with numpy : 0.04126095771789551 nb_pixel_total : 22715 time to create 1 rle with old method : 0.024469614028930664 time for calcul the mask position with numpy : 0.037613630294799805 nb_pixel_total : 25347 time to create 1 rle with old method : 0.0265352725982666 time for calcul the mask position with numpy : 0.0380096435546875 nb_pixel_total : 179934 time to create 1 rle with new method : 1.0458731651306152 time for calcul the mask position with numpy : 0.03973650932312012 nb_pixel_total : 48960 time to create 1 rle with old method : 0.05344891548156738 time for calcul the mask position with numpy : 0.039960384368896484 nb_pixel_total : 48308 time to create 1 rle with old method : 0.053830623626708984 time for calcul the mask position with numpy : 0.03894209861755371 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0019447803497314453 time for calcul the mask position with numpy : 0.0398712158203125 nb_pixel_total : 110407 time to create 1 rle with old method : 0.1244664192199707 time for calcul the mask position with numpy : 0.03940558433532715 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005614757537841797 time for calcul the mask position with numpy : 0.040177345275878906 nb_pixel_total : 51302 time to create 1 rle with old method : 0.05574464797973633 time for calcul the mask position with numpy : 0.03958439826965332 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0025038719177246094 time for calcul the mask position with numpy : 0.05182147026062012 nb_pixel_total : 573513 time to create 1 rle with new method : 1.064392328262329 time for calcul the mask position with numpy : 0.039811134338378906 nb_pixel_total : 230 time to create 1 rle with old method : 0.0004801750183105469 time for calcul the mask position with numpy : 0.03882598876953125 nb_pixel_total : 13956 time to create 1 rle with old method : 0.014958858489990234 time for calcul the mask position with numpy : 0.038665771484375 nb_pixel_total : 102 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.039295196533203125 nb_pixel_total : 64123 time to create 1 rle with old method : 0.07095718383789062 time for calcul the mask position with numpy : 0.04096531867980957 nb_pixel_total : 621 time to create 1 rle with old method : 0.0011756420135498047 time for calcul the mask position with numpy : 0.05167055130004883 nb_pixel_total : 477166 time to create 1 rle with new method : 0.5391192436218262 time for calcul the mask position with numpy : 0.03888106346130371 nb_pixel_total : 560 time to create 1 rle with old method : 0.0008342266082763672 time for calcul the mask position with numpy : 0.039638519287109375 nb_pixel_total : 30743 time to create 1 rle with old method : 0.037544965744018555 time for calcul the mask position with numpy : 0.0400087833404541 nb_pixel_total : 183178 time to create 1 rle with new method : 1.0300021171569824 time for calcul the mask position with numpy : 0.0395817756652832 nb_pixel_total : 12708 time to create 1 rle with old method : 0.013925790786743164 time for calcul the mask position with numpy : 0.038970232009887695 nb_pixel_total : 77926 time to create 1 rle with old method : 0.08285355567932129 time for calcul the mask position with numpy : 0.03908658027648926 nb_pixel_total : 80971 time to create 1 rle with old method : 0.08547377586364746 time for calcul the mask position with numpy : 0.038449764251708984 nb_pixel_total : 49222 time to create 1 rle with old method : 0.05186057090759277 time for calcul the mask position with numpy : 0.03818511962890625 nb_pixel_total : 3898 time to create 1 rle with old method : 0.0049321651458740234 time for calcul the mask position with numpy : 0.03896021842956543 nb_pixel_total : 34392 time to create 1 rle with old method : 0.03747057914733887 create new chi : 18.934993028640747 time to delete rle : 0.004518270492553711 batch 1 Loaded 68 chid ids of type : 4855 Number RLEs to save : 41165 TO DO : save crop sub photo not yet done ! save time : 2.4509634971618652 nb_obj : 104 nb_hashtags : 10 time to prepare the origin masks : 58.32985877990723 time for calcul the mask position with numpy : 0.29845237731933594 nb_pixel_total : 3322764 time to create 1 rle with new method : 0.9157974720001221 time for calcul the mask position with numpy : 0.040018320083618164 nb_pixel_total : 365 time to create 1 rle with old method : 0.0008158683776855469 time for calcul the mask position with numpy : 0.04241371154785156 nb_pixel_total : 183196 time to create 1 rle with new method : 0.9111599922180176 time for calcul the mask position with numpy : 0.040445804595947266 nb_pixel_total : 4315 time to create 1 rle with old method : 0.0056476593017578125 time for calcul the mask position with numpy : 0.043851613998413086 nb_pixel_total : 167158 time to create 1 rle with new method : 0.6417098045349121 time for calcul the mask position with numpy : 0.04661417007446289 nb_pixel_total : 710202 time to create 1 rle with new method : 0.5548708438873291 time for calcul the mask position with numpy : 0.04064822196960449 nb_pixel_total : 76989 time to create 1 rle with old method : 0.08826112747192383 time for calcul the mask position with numpy : 0.03999471664428711 nb_pixel_total : 245 time to create 1 rle with old method : 0.0008795261383056641 time for calcul the mask position with numpy : 0.040113210678100586 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003726482391357422 time for calcul the mask position with numpy : 0.04405069351196289 nb_pixel_total : 639029 time to create 1 rle with new method : 0.6994123458862305 time for calcul the mask position with numpy : 0.041608572006225586 nb_pixel_total : 284874 time to create 1 rle with new method : 0.7751731872558594 time for calcul the mask position with numpy : 0.04385805130004883 nb_pixel_total : 13024 time to create 1 rle with old method : 0.014616966247558594 time for calcul the mask position with numpy : 0.04026651382446289 nb_pixel_total : 102065 time to create 1 rle with old method : 0.11284112930297852 time for calcul the mask position with numpy : 0.04004836082458496 nb_pixel_total : 9267 time to create 1 rle with old method : 0.01064443588256836 time for calcul the mask position with numpy : 0.04001140594482422 nb_pixel_total : 29419 time to create 1 rle with old method : 0.03310894966125488 time for calcul the mask position with numpy : 0.04012131690979004 nb_pixel_total : 40777 time to create 1 rle with old method : 0.04584550857543945 time for calcul the mask position with numpy : 0.040026187896728516 nb_pixel_total : 2892 time to create 1 rle with old method : 0.003571033477783203 time for calcul the mask position with numpy : 0.039816856384277344 nb_pixel_total : 4307 time to create 1 rle with old method : 0.00496673583984375 time for calcul the mask position with numpy : 0.04011702537536621 nb_pixel_total : 42738 time to create 1 rle with old method : 0.04803013801574707 time for calcul the mask position with numpy : 0.040085554122924805 nb_pixel_total : 40018 time to create 1 rle with old method : 0.04500770568847656 time for calcul the mask position with numpy : 0.04022669792175293 nb_pixel_total : 60597 time to create 1 rle with old method : 0.06887125968933105 time for calcul the mask position with numpy : 0.0401616096496582 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013388872146606445 time for calcul the mask position with numpy : 0.04018402099609375 nb_pixel_total : 53274 time to create 1 rle with old method : 0.05957841873168945 time for calcul the mask position with numpy : 0.04039597511291504 nb_pixel_total : 266 time to create 1 rle with old method : 0.0005316734313964844 time for calcul the mask position with numpy : 0.04217195510864258 nb_pixel_total : 210066 time to create 1 rle with new method : 0.7086002826690674 time for calcul the mask position with numpy : 0.03905916213989258 nb_pixel_total : 12713 time to create 1 rle with old method : 0.01426076889038086 time for calcul the mask position with numpy : 0.039797306060791016 nb_pixel_total : 48238 time to create 1 rle with old method : 0.05314278602600098 time for calcul the mask position with numpy : 0.03998088836669922 nb_pixel_total : 185 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.03944706916809082 nb_pixel_total : 29162 time to create 1 rle with old method : 0.03200364112854004 time for calcul the mask position with numpy : 0.039110422134399414 nb_pixel_total : 81 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.03971052169799805 nb_pixel_total : 144439 time to create 1 rle with old method : 0.15499472618103027 time for calcul the mask position with numpy : 0.038889169692993164 nb_pixel_total : 52680 time to create 1 rle with old method : 0.055861473083496094 time for calcul the mask position with numpy : 0.03856158256530762 nb_pixel_total : 115810 time to create 1 rle with old method : 0.12284731864929199 time for calcul the mask position with numpy : 0.039541006088256836 nb_pixel_total : 12003 time to create 1 rle with old method : 0.013703584671020508 time for calcul the mask position with numpy : 0.0400385856628418 nb_pixel_total : 15028 time to create 1 rle with old method : 0.016863346099853516 time for calcul the mask position with numpy : 0.03995871543884277 nb_pixel_total : 874 time to create 1 rle with old method : 0.001110076904296875 time for calcul the mask position with numpy : 0.04040980339050293 nb_pixel_total : 77377 time to create 1 rle with old method : 0.08542704582214355 time for calcul the mask position with numpy : 0.03969073295593262 nb_pixel_total : 46312 time to create 1 rle with old method : 0.051735877990722656 time for calcul the mask position with numpy : 0.0401613712310791 nb_pixel_total : 18200 time to create 1 rle with old method : 0.020393848419189453 time for calcul the mask position with numpy : 0.03927445411682129 nb_pixel_total : 181 time to create 1 rle with old method : 0.0005214214324951172 time for calcul the mask position with numpy : 0.03913474082946777 nb_pixel_total : 20089 time to create 1 rle with old method : 0.022273778915405273 time for calcul the mask position with numpy : 0.03899383544921875 nb_pixel_total : 77861 time to create 1 rle with old method : 0.08882617950439453 time for calcul the mask position with numpy : 0.04005837440490723 nb_pixel_total : 40703 time to create 1 rle with old method : 0.04572296142578125 time for calcul the mask position with numpy : 0.03986644744873047 nb_pixel_total : 4985 time to create 1 rle with old method : 0.006052255630493164 time for calcul the mask position with numpy : 0.0398862361907959 nb_pixel_total : 5474 time to create 1 rle with old method : 0.006369352340698242 time for calcul the mask position with numpy : 0.04012918472290039 nb_pixel_total : 13946 time to create 1 rle with old method : 0.015807390213012695 time for calcul the mask position with numpy : 0.040342092514038086 nb_pixel_total : 28436 time to create 1 rle with old method : 0.04442453384399414 time for calcul the mask position with numpy : 0.04647183418273926 nb_pixel_total : 44981 time to create 1 rle with old method : 0.059354543685913086 time for calcul the mask position with numpy : 0.04024052619934082 nb_pixel_total : 52067 time to create 1 rle with old method : 0.05799365043640137 time for calcul the mask position with numpy : 0.04001140594482422 nb_pixel_total : 13007 time to create 1 rle with old method : 0.014614582061767578 time for calcul the mask position with numpy : 0.04016613960266113 nb_pixel_total : 58475 time to create 1 rle with old method : 0.06542325019836426 time for calcul the mask position with numpy : 0.04038596153259277 nb_pixel_total : 93446 time to create 1 rle with old method : 0.10678482055664062 time for calcul the mask position with numpy : 0.03941082954406738 nb_pixel_total : 30712 time to create 1 rle with old method : 0.0337216854095459 time for calcul the mask position with numpy : 0.04016304016113281 nb_pixel_total : 47706 time to create 1 rle with old method : 0.053145408630371094 time for calcul the mask position with numpy : 0.03953289985656738 nb_pixel_total : 13745 time to create 1 rle with old method : 0.014955282211303711 time for calcul the mask position with numpy : 0.039453983306884766 nb_pixel_total : 84142 time to create 1 rle with old method : 0.09160685539245605 time for calcul the mask position with numpy : 0.038995981216430664 nb_pixel_total : 22 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.03881955146789551 nb_pixel_total : 50031 time to create 1 rle with old method : 0.053198814392089844 time for calcul the mask position with numpy : 0.03925585746765137 nb_pixel_total : 45914 time to create 1 rle with old method : 0.050080060958862305 time for calcul the mask position with numpy : 0.039714813232421875 nb_pixel_total : 4418 time to create 1 rle with old method : 0.005249500274658203 time for calcul the mask position with numpy : 0.03940701484680176 nb_pixel_total : 10033 time to create 1 rle with old method : 0.0115203857421875 time for calcul the mask position with numpy : 0.0406031608581543 nb_pixel_total : 146662 time to create 1 rle with old method : 0.16298580169677734 time for calcul the mask position with numpy : 0.04247307777404785 nb_pixel_total : 21 time to create 1 rle with old method : 6.985664367675781e-05 time for calcul the mask position with numpy : 0.04004549980163574 nb_pixel_total : 25269 time to create 1 rle with old method : 0.02849102020263672 time for calcul the mask position with numpy : 0.04007363319396973 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.03968095779418945 nb_pixel_total : 89989 time to create 1 rle with old method : 0.10793852806091309 time for calcul the mask position with numpy : 0.03998851776123047 nb_pixel_total : 3987 time to create 1 rle with old method : 0.004702329635620117 time for calcul the mask position with numpy : 0.03980302810668945 nb_pixel_total : 7495 time to create 1 rle with old method : 0.008940696716308594 time for calcul the mask position with numpy : 0.04087638854980469 nb_pixel_total : 234181 time to create 1 rle with new method : 0.8281886577606201 time for calcul the mask position with numpy : 0.04000663757324219 nb_pixel_total : 4907 time to create 1 rle with old method : 0.005775928497314453 time for calcul the mask position with numpy : 0.04004192352294922 nb_pixel_total : 64419 time to create 1 rle with old method : 0.07217979431152344 time for calcul the mask position with numpy : 0.041571855545043945 nb_pixel_total : 367303 time to create 1 rle with new method : 0.7138745784759521 time for calcul the mask position with numpy : 0.04013681411743164 nb_pixel_total : 57442 time to create 1 rle with old method : 0.06427597999572754 time for calcul the mask position with numpy : 0.03997397422790527 nb_pixel_total : 7277 time to create 1 rle with old method : 0.008318901062011719 time for calcul the mask position with numpy : 0.04012250900268555 nb_pixel_total : 81082 time to create 1 rle with old method : 0.0909123420715332 time for calcul the mask position with numpy : 0.04012942314147949 nb_pixel_total : 18544 time to create 1 rle with old method : 0.020992517471313477 time for calcul the mask position with numpy : 0.040221214294433594 nb_pixel_total : 68549 time to create 1 rle with old method : 0.08414316177368164 time for calcul the mask position with numpy : 0.046297311782836914 nb_pixel_total : 145187 time to create 1 rle with old method : 0.20252728462219238 time for calcul the mask position with numpy : 0.045975685119628906 nb_pixel_total : 32295 time to create 1 rle with old method : 0.03714466094970703 time for calcul the mask position with numpy : 0.04029726982116699 nb_pixel_total : 9990 time to create 1 rle with old method : 0.01149439811706543 time for calcul the mask position with numpy : 0.04055500030517578 nb_pixel_total : 26791 time to create 1 rle with old method : 0.03203582763671875 time for calcul the mask position with numpy : 0.040183305740356445 nb_pixel_total : 15149 time to create 1 rle with old method : 0.017283201217651367 time for calcul the mask position with numpy : 0.041166067123413086 nb_pixel_total : 75115 time to create 1 rle with old method : 0.08567619323730469 time for calcul the mask position with numpy : 0.040766239166259766 nb_pixel_total : 6763 time to create 1 rle with old method : 0.00803065299987793 time for calcul the mask position with numpy : 0.04194831848144531 nb_pixel_total : 35193 time to create 1 rle with old method : 0.04148387908935547 time for calcul the mask position with numpy : 0.04267096519470215 nb_pixel_total : 3762 time to create 1 rle with old method : 0.005016803741455078 time for calcul the mask position with numpy : 0.04073047637939453 nb_pixel_total : 16064 time to create 1 rle with old method : 0.01831841468811035 time for calcul the mask position with numpy : 0.04111361503601074 nb_pixel_total : 104650 time to create 1 rle with old method : 0.11665511131286621 time for calcul the mask position with numpy : 0.04008126258850098 nb_pixel_total : 15707 time to create 1 rle with old method : 0.023634672164916992 time for calcul the mask position with numpy : 0.050719499588012695 nb_pixel_total : 197844 time to create 1 rle with new method : 0.8969278335571289 time for calcul the mask position with numpy : 0.040309906005859375 nb_pixel_total : 1475 time to create 1 rle with old method : 0.001992940902709961 time for calcul the mask position with numpy : 0.04093146324157715 nb_pixel_total : 28579 time to create 1 rle with old method : 0.03496408462524414 time for calcul the mask position with numpy : 0.04114079475402832 nb_pixel_total : 104160 time to create 1 rle with old method : 0.12009024620056152 time for calcul the mask position with numpy : 0.04059267044067383 nb_pixel_total : 47620 time to create 1 rle with old method : 0.05334043502807617 time for calcul the mask position with numpy : 0.04185605049133301 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009868144989013672 time for calcul the mask position with numpy : 0.04180550575256348 nb_pixel_total : 97685 time to create 1 rle with old method : 0.10945940017700195 time for calcul the mask position with numpy : 0.040743112564086914 nb_pixel_total : 37663 time to create 1 rle with old method : 0.04781532287597656 time for calcul the mask position with numpy : 0.04506278038024902 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0016944408416748047 time for calcul the mask position with numpy : 0.04321646690368652 nb_pixel_total : 38305 time to create 1 rle with old method : 0.04457831382751465 time for calcul the mask position with numpy : 0.040749311447143555 nb_pixel_total : 87396 time to create 1 rle with old method : 0.09751319885253906 time for calcul the mask position with numpy : 0.04056572914123535 nb_pixel_total : 43522 time to create 1 rle with old method : 0.04925942420959473 time for calcul the mask position with numpy : 0.04056906700134277 nb_pixel_total : 44767 time to create 1 rle with old method : 0.05114436149597168 time for calcul the mask position with numpy : 0.04192757606506348 nb_pixel_total : 11606 time to create 1 rle with old method : 0.0186917781829834 time for calcul the mask position with numpy : 0.040195465087890625 nb_pixel_total : 3907 time to create 1 rle with old method : 0.004563570022583008 time for calcul the mask position with numpy : 0.040315866470336914 nb_pixel_total : 564 time to create 1 rle with old method : 0.0009365081787109375 create new chi : 16.696139097213745 time to delete rle : 0.0048065185546875 batch 1 Loaded 106 chid ids of type : 4855 Number RLEs to save : 52013 TO DO : save crop sub photo not yet done ! save time : 3.285182476043701 map_output_result : {1360028131: (0.49905219447998317, 'Should be the crop_list due to order', 0.31880554976542086), 1360028094: (0.49905219447998317, 'Should be the crop_list due to order', 0.5377176053750252), 1360027797: (0.49905219447998317, 'Should be the crop_list due to order', 0.7481416798712179), 1360027792: (0.49905219447998317, 'Should be the crop_list due to order', 0.3915439429082687)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 4 /1360028131.Didn't retrieve data . /1360028094.Didn't retrieve data . /1360027797.Didn't retrieve data . /1360027792.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016360044479370117 save_final save missing photos in datou_result : time spend for datou_step_exec : 301.40141558647156 time spend to save output : 0.018595218658447266 total time spend for step 5 : 301.42001080513 step6:crop_condition Wed May 21 16:29:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 394 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3015255 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837785_3385930 we have uploaded 43 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.56286096572876 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 3015255 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837815_3385930 we have uploaded 57 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.159468412399292 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3015255 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837835_3385930 we have uploaded 27 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.438305616378784 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3015255 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837847_3385930 we have uploaded 16 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.737530469894409 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837855_3385930 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5936517715454102 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3015255 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837861_3385930 we have uploaded 21 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.767158269882202 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837869_3385930 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.9323551654815674 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 3015255 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837920_3385930 we have uploaded 59 photos in the portfolio 3015255 time of upload the photos Elapsed time : 16.441619396209717 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837938_3385930 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6571168899536133 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837941_3385930 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.705387830734253 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3015255 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747837989_3385930 we have uploaded 38 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.406924724578857 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 277 /1360055888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360055999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360056423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 835 time used for this insertion : 0.12116098403930664 save_final save missing photos in datou_result : time spend for datou_step_exec : 242.93698167800903 time spend to save output : 0.4655437469482422 total time spend for step 6 : 243.40252542495728 step7:ventilate_hashtags_in_portfolio Wed May 21 16:33:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23212383 get user id for portfolio 23212383 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23212383 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23212383 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23212383 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23212383 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/23214845,23214846,23214847,23214848,23214849,23214854,23214856,23214857,23214858,23214859,23214860,23214861,23214863,23214864,23214865,23214866,23214867,23214868,23214870,23214872?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=23212383 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 1 /23212383. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01625967025756836 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.626129627227783 time spend to save output : 0.017496824264526367 total time spend for step 7 : 4.64362645149231 step8:final Wed May 21 16:33:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360028131: ('0.5180130902790399',), 1360028094: ('0.5180130902790399',), 1360027797: ('0.5180130902790399',), 1360027792: ('0.5180130902790399',)} new output for save of step final : {1360028131: ('0.5180130902790399',), 1360028094: ('0.5180130902790399',), 1360027797: ('0.5180130902790399',), 1360027792: ('0.5180130902790399',)} [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 4 /1360028131.Didn't retrieve data . /1360028094.Didn't retrieve data . /1360027797.Didn't retrieve data . /1360027792.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012424468994140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.21956992149353027 time spend to save output : 0.022512435913085938 total time spend for step 8 : 0.2420823574066162 step9:velours_tree Wed May 21 16:33:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 6.625198125839233 time spend to save output : 5.3882598876953125e-05 total time spend for step 9 : 6.62525200843811 step10:send_mail_cod Wed May 21 16:33:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23212383_21-05-2025_16_33_34.pdf 23214817 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148171747838014 23214818 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148181747838015 23214819 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148191747838017 23214820 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148201747838018 23214821 imagette232148211747838020 23214822 change filename to text .imagette232148221747838020 23214823 imagette232148231747838020 23214824 imagette232148241747838020 23214825 imagette232148251747838020 23214826 imagette232148261747838020 23214827 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148271747838020 23214828 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148281747838021 23214829 imagette232148291747838021 23214830 imagette232148301747838021 23214831 imagette232148311747838021 23214832 imagette232148321747838021 23214833 imagette232148331747838021 23214834 change filename to text .imagette232148341747838021 23214835 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148351747838021 23214837 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232148371747838022 23214838 imagette232148381747838023 23214839 imagette232148391747838023 23214840 imagette232148401747838024 23214841 imagette232148411747838024 23214842 imagette232148421747838024 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23212383 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23214845,23214846,23214847,23214848,23214849,23214854,23214856,23214857,23214858,23214859,23214860,23214861,23214863,23214864,23214865,23214866,23214867,23214868,23214870,23214872?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=23212383 your option no_mail is active, we will not send the real mail to your client args[1360028131] : ((1360028131, 1505.302889650059, 2107751945), (1360028131, -0.22935576716898456, 496442774), '0.5180130902790399') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360028094] : ((1360028094, 894.150128574819, 2107751945), (1360028094, -0.3387316927839259, 496442774), '0.5180130902790399') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360027797] : ((1360027797, 631.6927940479427, 492688767), (1360027797, -0.3607465953777008, 496442774), '0.5180130902790399') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360027792] : ((1360027792, 2166.9592541614456, 492609224), (1360027792, -0.40814312859847157, 496442774), '0.5180130902790399') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5180130902790399 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23212383_21-05-2025_16_33_34.pdf results_Auto_P23212383_21-05-2025_16_33_34.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23212383_21-05-2025_16_33_34.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','23212383','results_Auto_P23212383_21-05-2025_16_33_34.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23212383_21-05-2025_16_33_34.pdf','pdf','','1.87','0.5180130902790399') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012711763381958008 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.197813272476196 time spend to save output : 0.013201475143432617 total time spend for step 10 : 12.211014747619629 step11:split_time_score Wed May 21 16:33:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21052025 23212383 Nombre de photos uploadées : 4 / 23040 (0%) 21052025 23212383 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 21052025 23212383 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00021386146545410156 elapsed_time : insert_dashboard_record_day_entry 0.023936986923217773 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.5180130902790399 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23212383_21-05-2025_16_33_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23212383 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23212383 AND mptpi.`type`=4855 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23212385_21-05-2025_16_04_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23212385 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21052025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 1 /23212383Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028131', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360028094', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027797', None, None, None, None, None, '2924663') ('4741', None, None, None, None, None, None, None, '2924663') ('4741', '23212383', '1360027792', None, None, None, None, None, '2924663') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01494288444519043 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.2789454460144043 time spend to save output : 0.0152740478515625 total time spend for step 11 : 0.2942194938659668 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 473.37user 204.66system 12:22.75elapsed 91%CPU (0avgtext+0avgdata 7103620maxresident)k 1778480inputs+437800outputs (28445major+39014019minor)pagefaults 0swaps