python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2929779 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2922449'] with mtr_portfolio_ids : ['23208872'] and first list_photo_ids : [] new path : /proc/2929779/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.919987678527832 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed May 21 14:21:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 14:21:30.591920: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 14:21:30.623318: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 14:21:30.625601: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc6f4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 14:21:30.625664: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 14:21:30.629822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 14:21:30.769670: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3fa9d0d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 14:21:30.769728: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 14:21:30.771300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:21:30.771754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:21:30.774975: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:21:30.777567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:21:30.777995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:21:30.781320: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:21:30.782786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:21:30.788532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:21:30.790178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:21:30.790283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:21:30.791122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 14:21:30.791142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 14:21:30.791152: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 14:21:30.792537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 14:21:31.064791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:21:31.064937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:21:31.064971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:21:31.065002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:21:31.065033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:21:31.065062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:21:31.065091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:21:31.065121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:21:31.067354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:21:31.068775: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:21:31.068803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:21:31.068817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:21:31.068830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:21:31.068858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:21:31.068872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:21:31.068885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:21:31.068897: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:21:31.070050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:21:31.070083: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 14:21:31.070091: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 14:21:31.070098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 14:21:31.071309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-21 14:21:42.382567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:21:42.553428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.36016 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.51250 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.05547 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19609 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 2930025 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.15703296661376953 nb_pixel_total : 363171 time to create 1 rle with new method : 0.027606725692749023 length of segment : 541 time for calcul the mask position with numpy : 0.001071929931640625 nb_pixel_total : 87216 time to create 1 rle with old method : 0.10051155090332031 length of segment : 257 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 76235 time to create 1 rle with old method : 0.08623528480529785 length of segment : 265 time for calcul the mask position with numpy : 0.0003528594970703125 nb_pixel_total : 13998 time to create 1 rle with old method : 0.015972375869750977 length of segment : 225 time for calcul the mask position with numpy : 0.0002810955047607422 nb_pixel_total : 13991 time to create 1 rle with old method : 0.016636133193969727 length of segment : 83 time for calcul the mask position with numpy : 0.00029754638671875 nb_pixel_total : 11908 time to create 1 rle with old method : 0.014566898345947266 length of segment : 149 time for calcul the mask position with numpy : 0.0003180503845214844 nb_pixel_total : 15325 time to create 1 rle with old method : 0.01808619499206543 length of segment : 127 time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 33376 time to create 1 rle with old method : 0.039962053298950195 length of segment : 161 time for calcul the mask position with numpy : 0.00018310546875 nb_pixel_total : 10918 time to create 1 rle with old method : 0.012195110321044922 length of segment : 120 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 15343 time to create 1 rle with old method : 0.016962766647338867 length of segment : 250 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 13968 time to create 1 rle with old method : 0.015624284744262695 length of segment : 181 time for calcul the mask position with numpy : 0.0008955001831054688 nb_pixel_total : 62552 time to create 1 rle with old method : 0.06964731216430664 length of segment : 248 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 37167 time to create 1 rle with old method : 0.0417027473449707 length of segment : 380 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 18325 time to create 1 rle with old method : 0.02075958251953125 length of segment : 234 time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 72188 time to create 1 rle with old method : 0.08021306991577148 length of segment : 253 time for calcul the mask position with numpy : 0.0009615421295166016 nb_pixel_total : 38748 time to create 1 rle with old method : 0.06432914733886719 length of segment : 334 time for calcul the mask position with numpy : 0.0005495548248291016 nb_pixel_total : 28089 time to create 1 rle with old method : 0.031061887741088867 length of segment : 232 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 25835 time to create 1 rle with old method : 0.02886056900024414 length of segment : 151 time for calcul the mask position with numpy : 0.00040984153747558594 nb_pixel_total : 20158 time to create 1 rle with old method : 0.021606922149658203 length of segment : 220 time for calcul the mask position with numpy : 0.0024750232696533203 nb_pixel_total : 117243 time to create 1 rle with old method : 0.14703607559204102 length of segment : 268 time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 14431 time to create 1 rle with old method : 0.016375064849853516 length of segment : 200 time for calcul the mask position with numpy : 0.00019478797912597656 nb_pixel_total : 10803 time to create 1 rle with old method : 0.012330055236816406 length of segment : 160 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 3071 time to create 1 rle with old method : 0.0038330554962158203 length of segment : 63 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 33192 time to create 1 rle with old method : 0.036946773529052734 length of segment : 177 time for calcul the mask position with numpy : 0.00017762184143066406 nb_pixel_total : 7280 time to create 1 rle with old method : 0.00838017463684082 length of segment : 126 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 39327 time to create 1 rle with old method : 0.04419565200805664 length of segment : 190 time for calcul the mask position with numpy : 0.0019850730895996094 nb_pixel_total : 140557 time to create 1 rle with old method : 0.153489351272583 length of segment : 321 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 25876 time to create 1 rle with old method : 0.028592586517333984 length of segment : 206 time for calcul the mask position with numpy : 0.000934600830078125 nb_pixel_total : 51176 time to create 1 rle with old method : 0.06033587455749512 length of segment : 370 time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 20546 time to create 1 rle with old method : 0.0240781307220459 length of segment : 163 time for calcul the mask position with numpy : 0.0005562305450439453 nb_pixel_total : 29325 time to create 1 rle with old method : 0.03248095512390137 length of segment : 265 time for calcul the mask position with numpy : 0.0008249282836914062 nb_pixel_total : 28791 time to create 1 rle with old method : 0.032250404357910156 length of segment : 404 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 18705 time to create 1 rle with old method : 0.020777225494384766 length of segment : 199 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 12009 time to create 1 rle with old method : 0.013831615447998047 length of segment : 148 time for calcul the mask position with numpy : 0.0030317306518554688 nb_pixel_total : 167245 time to create 1 rle with new method : 0.013051986694335938 length of segment : 663 time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 20600 time to create 1 rle with old method : 0.023426532745361328 length of segment : 206 time for calcul the mask position with numpy : 0.0004894733428955078 nb_pixel_total : 27457 time to create 1 rle with old method : 0.03025031089782715 length of segment : 214 time for calcul the mask position with numpy : 0.0007894039154052734 nb_pixel_total : 32235 time to create 1 rle with old method : 0.03548908233642578 length of segment : 250 time for calcul the mask position with numpy : 0.0006933212280273438 nb_pixel_total : 49381 time to create 1 rle with old method : 0.053987741470336914 length of segment : 208 time for calcul the mask position with numpy : 0.0012292861938476562 nb_pixel_total : 62274 time to create 1 rle with old method : 0.07124590873718262 length of segment : 262 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 258467 time to create 1 rle with new method : 0.01324605941772461 length of segment : 433 time for calcul the mask position with numpy : 0.0013344287872314453 nb_pixel_total : 63330 time to create 1 rle with old method : 0.06849551200866699 length of segment : 478 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 16064 time to create 1 rle with old method : 0.018094301223754883 length of segment : 276 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 13640 time to create 1 rle with old method : 0.015024423599243164 length of segment : 251 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 18563 time to create 1 rle with old method : 0.024428844451904297 length of segment : 142 time for calcul the mask position with numpy : 0.0008533000946044922 nb_pixel_total : 19705 time to create 1 rle with old method : 0.02242112159729004 length of segment : 299 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 16486 time to create 1 rle with old method : 0.017480850219726562 length of segment : 214 time for calcul the mask position with numpy : 0.000982522964477539 nb_pixel_total : 26573 time to create 1 rle with old method : 0.030699491500854492 length of segment : 250 time for calcul the mask position with numpy : 0.0018725395202636719 nb_pixel_total : 93212 time to create 1 rle with old method : 0.11943912506103516 length of segment : 371 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 5209 time to create 1 rle with old method : 0.006110668182373047 length of segment : 107 time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 14635 time to create 1 rle with old method : 0.016837596893310547 length of segment : 130 time for calcul the mask position with numpy : 0.0004889965057373047 nb_pixel_total : 12966 time to create 1 rle with old method : 0.014955282211303711 length of segment : 116 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 22484 time to create 1 rle with old method : 0.024787425994873047 length of segment : 188 time for calcul the mask position with numpy : 0.003180980682373047 nb_pixel_total : 104864 time to create 1 rle with old method : 0.11183810234069824 length of segment : 486 time for calcul the mask position with numpy : 0.03210091590881348 nb_pixel_total : 639439 time to create 1 rle with new method : 0.45743250846862793 length of segment : 804 time for calcul the mask position with numpy : 0.005861759185791016 nb_pixel_total : 183514 time to create 1 rle with new method : 0.011422157287597656 length of segment : 382 time for calcul the mask position with numpy : 0.014192819595336914 nb_pixel_total : 711414 time to create 1 rle with new method : 0.045059919357299805 length of segment : 1333 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 6795 time to create 1 rle with old method : 0.0075299739837646484 length of segment : 76 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 14033 time to create 1 rle with old method : 0.016216039657592773 length of segment : 137 time for calcul the mask position with numpy : 0.0032618045806884766 nb_pixel_total : 179605 time to create 1 rle with new method : 0.0075991153717041016 length of segment : 371 time for calcul the mask position with numpy : 0.0008671283721923828 nb_pixel_total : 34306 time to create 1 rle with old method : 0.05222439765930176 length of segment : 187 time for calcul the mask position with numpy : 0.0009930133819580078 nb_pixel_total : 37780 time to create 1 rle with old method : 0.04238438606262207 length of segment : 227 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 13055 time to create 1 rle with old method : 0.014752626419067383 length of segment : 128 time for calcul the mask position with numpy : 0.0024518966674804688 nb_pixel_total : 108554 time to create 1 rle with old method : 0.11986780166625977 length of segment : 479 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 4378 time to create 1 rle with old method : 0.005228519439697266 length of segment : 130 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 13777 time to create 1 rle with old method : 0.015297889709472656 length of segment : 130 time for calcul the mask position with numpy : 0.00044655799865722656 nb_pixel_total : 13682 time to create 1 rle with old method : 0.015872478485107422 length of segment : 174 time for calcul the mask position with numpy : 0.0008664131164550781 nb_pixel_total : 24752 time to create 1 rle with old method : 0.027657747268676758 length of segment : 257 time for calcul the mask position with numpy : 0.0026297569274902344 nb_pixel_total : 108700 time to create 1 rle with old method : 0.11704754829406738 length of segment : 299 time for calcul the mask position with numpy : 0.0012221336364746094 nb_pixel_total : 33111 time to create 1 rle with old method : 0.035658836364746094 length of segment : 359 time for calcul the mask position with numpy : 0.0005397796630859375 nb_pixel_total : 14065 time to create 1 rle with old method : 0.015690088272094727 length of segment : 113 time for calcul the mask position with numpy : 0.0006463527679443359 nb_pixel_total : 36301 time to create 1 rle with old method : 0.04369711875915527 length of segment : 218 time for calcul the mask position with numpy : 0.0009200572967529297 nb_pixel_total : 20490 time to create 1 rle with old method : 0.02243185043334961 length of segment : 197 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 11819 time to create 1 rle with old method : 0.013162374496459961 length of segment : 110 time for calcul the mask position with numpy : 0.0007388591766357422 nb_pixel_total : 24586 time to create 1 rle with old method : 0.026755571365356445 length of segment : 243 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 35630 time to create 1 rle with old method : 0.037567138671875 length of segment : 248 time spent for convertir_results : 6.532113075256348 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 76 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 45.347407579422 time spend to save output : 0.12467551231384277 total time spend for step 1 : 45.47208309173584 step2:mask_detect Wed May 21 14:22:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 14:22:15.850838: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 14:22:15.875363: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 14:22:15.877534: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc6f0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 14:22:15.877597: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 14:22:15.881404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 14:22:16.128582: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40c1a340 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 14:22:16.128625: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 14:22:16.129934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:22:16.133694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:22:16.137996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:22:16.140683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:22:16.141048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:22:16.144588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:22:16.145824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:22:16.151257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:22:16.152708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:22:16.152770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:22:16.153474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 14:22:16.153488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 14:22:16.153496: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 14:22:16.154778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 14:22:16.338558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:22:16.338683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:22:16.338716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:22:16.338745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:22:16.338774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:22:16.338802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:22:16.338834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:22:16.338862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:22:16.340584: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:22:16.341670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 14:22:16.341707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 14:22:16.341727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:22:16.341746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 14:22:16.341765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 14:22:16.341784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 14:22:16.341802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 14:22:16.341821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 14:22:16.343127: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 14:22:16.343156: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 14:22:16.343165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 14:22:16.343173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 14:22:16.344461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-21 14:22:28.145937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 14:22:28.360688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.36016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 93 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.51250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 85 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.05547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 78 Detection mask done ! Trying to reset tf kernel 2931817 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.018494606018066406 nb_pixel_total : 31928 time to create 1 rle with old method : 0.035785675048828125 length of segment : 250 time for calcul the mask position with numpy : 0.0012099742889404297 nb_pixel_total : 46061 time to create 1 rle with old method : 0.05450797080993652 length of segment : 166 time for calcul the mask position with numpy : 0.0024259090423583984 nb_pixel_total : 63740 time to create 1 rle with old method : 0.09465456008911133 length of segment : 241 time for calcul the mask position with numpy : 0.0007803440093994141 nb_pixel_total : 14515 time to create 1 rle with old method : 0.02596139907836914 length of segment : 98 time for calcul the mask position with numpy : 0.00072479248046875 nb_pixel_total : 13682 time to create 1 rle with old method : 0.036150217056274414 length of segment : 150 time for calcul the mask position with numpy : 0.008993864059448242 nb_pixel_total : 209645 time to create 1 rle with new method : 0.028653621673583984 length of segment : 704 time for calcul the mask position with numpy : 0.003255605697631836 nb_pixel_total : 54303 time to create 1 rle with old method : 0.10106444358825684 length of segment : 305 time for calcul the mask position with numpy : 0.005207538604736328 nb_pixel_total : 130294 time to create 1 rle with old method : 0.2338271141052246 length of segment : 418 time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 9095 time to create 1 rle with old method : 0.018136262893676758 length of segment : 101 time for calcul the mask position with numpy : 0.010334253311157227 nb_pixel_total : 211997 time to create 1 rle with new method : 0.03023815155029297 length of segment : 728 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 25948 time to create 1 rle with old method : 0.028656482696533203 length of segment : 152 time for calcul the mask position with numpy : 0.0004782676696777344 nb_pixel_total : 12349 time to create 1 rle with old method : 0.014270544052124023 length of segment : 219 time for calcul the mask position with numpy : 0.0010428428649902344 nb_pixel_total : 38230 time to create 1 rle with old method : 0.04420971870422363 length of segment : 304 time for calcul the mask position with numpy : 0.0010867118835449219 nb_pixel_total : 41743 time to create 1 rle with old method : 0.04863476753234863 length of segment : 193 time for calcul the mask position with numpy : 0.0039637088775634766 nb_pixel_total : 110545 time to create 1 rle with old method : 0.13112330436706543 length of segment : 402 time for calcul the mask position with numpy : 0.0016198158264160156 nb_pixel_total : 48075 time to create 1 rle with old method : 0.05376291275024414 length of segment : 359 time for calcul the mask position with numpy : 0.0014996528625488281 nb_pixel_total : 50970 time to create 1 rle with old method : 0.05914115905761719 length of segment : 298 time for calcul the mask position with numpy : 0.007592439651489258 nb_pixel_total : 361492 time to create 1 rle with new method : 0.029168367385864258 length of segment : 551 time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 10253 time to create 1 rle with old method : 0.011567831039428711 length of segment : 141 time for calcul the mask position with numpy : 0.0013518333435058594 nb_pixel_total : 50756 time to create 1 rle with old method : 0.056726932525634766 length of segment : 218 time for calcul the mask position with numpy : 0.0011601448059082031 nb_pixel_total : 39865 time to create 1 rle with old method : 0.04445600509643555 length of segment : 314 time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 27819 time to create 1 rle with old method : 0.03089737892150879 length of segment : 184 time for calcul the mask position with numpy : 0.0031156539916992188 nb_pixel_total : 87787 time to create 1 rle with old method : 0.1011807918548584 length of segment : 393 time for calcul the mask position with numpy : 0.0015020370483398438 nb_pixel_total : 49364 time to create 1 rle with old method : 0.053534507751464844 length of segment : 341 time for calcul the mask position with numpy : 0.004342317581176758 nb_pixel_total : 165303 time to create 1 rle with new method : 0.014658451080322266 length of segment : 555 time for calcul the mask position with numpy : 0.003314495086669922 nb_pixel_total : 96658 time to create 1 rle with old method : 0.10466742515563965 length of segment : 353 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 8024 time to create 1 rle with old method : 0.008861303329467773 length of segment : 100 time for calcul the mask position with numpy : 0.0017552375793457031 nb_pixel_total : 80479 time to create 1 rle with old method : 0.09067988395690918 length of segment : 265 time for calcul the mask position with numpy : 0.0010502338409423828 nb_pixel_total : 36429 time to create 1 rle with old method : 0.04100513458251953 length of segment : 223 time for calcul the mask position with numpy : 0.004920244216918945 nb_pixel_total : 168999 time to create 1 rle with new method : 0.010918617248535156 length of segment : 583 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 37346 time to create 1 rle with old method : 0.041706085205078125 length of segment : 285 time for calcul the mask position with numpy : 0.0003933906555175781 nb_pixel_total : 16665 time to create 1 rle with old method : 0.018888473510742188 length of segment : 147 time for calcul the mask position with numpy : 0.0016596317291259766 nb_pixel_total : 76821 time to create 1 rle with old method : 0.09979677200317383 length of segment : 223 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 11629 time to create 1 rle with old method : 0.013592720031738281 length of segment : 126 time for calcul the mask position with numpy : 0.0006656646728515625 nb_pixel_total : 14978 time to create 1 rle with old method : 0.018205881118774414 length of segment : 161 time for calcul the mask position with numpy : 0.007506132125854492 nb_pixel_total : 265180 time to create 1 rle with new method : 0.03823137283325195 length of segment : 672 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 35768 time to create 1 rle with old method : 0.040694475173950195 length of segment : 157 time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 15220 time to create 1 rle with old method : 0.018477678298950195 length of segment : 151 time for calcul the mask position with numpy : 0.00234222412109375 nb_pixel_total : 114101 time to create 1 rle with old method : 0.1311335563659668 length of segment : 264 time for calcul the mask position with numpy : 0.0007815361022949219 nb_pixel_total : 31103 time to create 1 rle with old method : 0.03552699089050293 length of segment : 196 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 4110 time to create 1 rle with old method : 0.007123231887817383 length of segment : 82 time for calcul the mask position with numpy : 0.0015354156494140625 nb_pixel_total : 46096 time to create 1 rle with old method : 0.0618891716003418 length of segment : 249 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 9624 time to create 1 rle with old method : 0.011468887329101562 length of segment : 149 time for calcul the mask position with numpy : 0.040483951568603516 nb_pixel_total : 804840 time to create 1 rle with new method : 0.2366633415222168 length of segment : 1092 time for calcul the mask position with numpy : 0.0015709400177001953 nb_pixel_total : 36494 time to create 1 rle with old method : 0.046597957611083984 length of segment : 338 time for calcul the mask position with numpy : 0.0050601959228515625 nb_pixel_total : 184195 time to create 1 rle with new method : 0.013025999069213867 length of segment : 415 time for calcul the mask position with numpy : 0.008280277252197266 nb_pixel_total : 339298 time to create 1 rle with new method : 0.02992105484008789 length of segment : 707 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 29478 time to create 1 rle with old method : 0.03277301788330078 length of segment : 243 time for calcul the mask position with numpy : 0.015516519546508789 nb_pixel_total : 395406 time to create 1 rle with new method : 0.4018592834472656 length of segment : 1052 time for calcul the mask position with numpy : 0.00037550926208496094 nb_pixel_total : 15218 time to create 1 rle with old method : 0.01717996597290039 length of segment : 139 time for calcul the mask position with numpy : 0.0014197826385498047 nb_pixel_total : 49503 time to create 1 rle with old method : 0.05455732345581055 length of segment : 341 time for calcul the mask position with numpy : 0.001699686050415039 nb_pixel_total : 49069 time to create 1 rle with old method : 0.0557863712310791 length of segment : 243 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 16194 time to create 1 rle with old method : 0.018311500549316406 length of segment : 226 time for calcul the mask position with numpy : 0.0011742115020751953 nb_pixel_total : 47904 time to create 1 rle with old method : 0.07057476043701172 length of segment : 303 time for calcul the mask position with numpy : 0.0004711151123046875 nb_pixel_total : 16652 time to create 1 rle with old method : 0.019133329391479492 length of segment : 143 time for calcul the mask position with numpy : 0.0029697418212890625 nb_pixel_total : 67466 time to create 1 rle with old method : 0.07462191581726074 length of segment : 667 time for calcul the mask position with numpy : 0.001875162124633789 nb_pixel_total : 87009 time to create 1 rle with old method : 0.09439229965209961 length of segment : 281 time for calcul the mask position with numpy : 0.0030281543731689453 nb_pixel_total : 156728 time to create 1 rle with new method : 0.006825685501098633 length of segment : 359 time for calcul the mask position with numpy : 0.003195047378540039 nb_pixel_total : 156414 time to create 1 rle with new method : 0.008993148803710938 length of segment : 477 time for calcul the mask position with numpy : 0.0017554759979248047 nb_pixel_total : 62167 time to create 1 rle with old method : 0.06663799285888672 length of segment : 255 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 19168 time to create 1 rle with old method : 0.021445512771606445 length of segment : 228 time for calcul the mask position with numpy : 0.001928567886352539 nb_pixel_total : 70749 time to create 1 rle with old method : 0.07819318771362305 length of segment : 428 time for calcul the mask position with numpy : 0.0019409656524658203 nb_pixel_total : 55194 time to create 1 rle with old method : 0.06486153602600098 length of segment : 336 time for calcul the mask position with numpy : 0.002142667770385742 nb_pixel_total : 83707 time to create 1 rle with old method : 0.12164044380187988 length of segment : 286 time for calcul the mask position with numpy : 0.0032558441162109375 nb_pixel_total : 132803 time to create 1 rle with old method : 0.14726638793945312 length of segment : 506 time for calcul the mask position with numpy : 0.023070812225341797 nb_pixel_total : 321771 time to create 1 rle with new method : 0.02909374237060547 length of segment : 686 time for calcul the mask position with numpy : 0.001209259033203125 nb_pixel_total : 41543 time to create 1 rle with old method : 0.044963836669921875 length of segment : 219 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 17576 time to create 1 rle with old method : 0.030362367630004883 length of segment : 197 time for calcul the mask position with numpy : 0.0032896995544433594 nb_pixel_total : 90030 time to create 1 rle with old method : 0.10440373420715332 length of segment : 498 time for calcul the mask position with numpy : 0.0008485317230224609 nb_pixel_total : 30273 time to create 1 rle with old method : 0.03375077247619629 length of segment : 250 time for calcul the mask position with numpy : 0.007511138916015625 nb_pixel_total : 158890 time to create 1 rle with new method : 0.03386235237121582 length of segment : 540 time for calcul the mask position with numpy : 0.0031173229217529297 nb_pixel_total : 80227 time to create 1 rle with old method : 0.09690117835998535 length of segment : 471 time for calcul the mask position with numpy : 0.003582477569580078 nb_pixel_total : 99338 time to create 1 rle with old method : 0.11232328414916992 length of segment : 282 time for calcul the mask position with numpy : 0.005368471145629883 nb_pixel_total : 214550 time to create 1 rle with new method : 0.01795339584350586 length of segment : 1276 time for calcul the mask position with numpy : 0.0018610954284667969 nb_pixel_total : 77488 time to create 1 rle with old method : 0.08695864677429199 length of segment : 258 time for calcul the mask position with numpy : 0.0011544227600097656 nb_pixel_total : 36000 time to create 1 rle with old method : 0.04038643836975098 length of segment : 200 time for calcul the mask position with numpy : 0.011948108673095703 nb_pixel_total : 354337 time to create 1 rle with new method : 0.07315278053283691 length of segment : 820 time for calcul the mask position with numpy : 0.00482177734375 nb_pixel_total : 234027 time to create 1 rle with new method : 0.014273405075073242 length of segment : 571 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 27934 time to create 1 rle with old method : 0.031678199768066406 length of segment : 200 time for calcul the mask position with numpy : 0.001573324203491211 nb_pixel_total : 50744 time to create 1 rle with old method : 0.05749964714050293 length of segment : 212 time for calcul the mask position with numpy : 0.0059299468994140625 nb_pixel_total : 325542 time to create 1 rle with new method : 0.017417430877685547 length of segment : 619 time for calcul the mask position with numpy : 0.0022737979888916016 nb_pixel_total : 85420 time to create 1 rle with old method : 0.10093498229980469 length of segment : 310 time for calcul the mask position with numpy : 0.0023200511932373047 nb_pixel_total : 64950 time to create 1 rle with old method : 0.09278583526611328 length of segment : 287 time for calcul the mask position with numpy : 0.0023860931396484375 nb_pixel_total : 64472 time to create 1 rle with old method : 0.08680510520935059 length of segment : 240 time for calcul the mask position with numpy : 0.0010848045349121094 nb_pixel_total : 29099 time to create 1 rle with old method : 0.04007863998413086 length of segment : 197 time for calcul the mask position with numpy : 0.00795292854309082 nb_pixel_total : 87351 time to create 1 rle with old method : 0.11282920837402344 length of segment : 451 time for calcul the mask position with numpy : 0.0030798912048339844 nb_pixel_total : 155056 time to create 1 rle with new method : 0.008192777633666992 length of segment : 480 time for calcul the mask position with numpy : 0.0015594959259033203 nb_pixel_total : 60764 time to create 1 rle with old method : 0.06780362129211426 length of segment : 357 time for calcul the mask position with numpy : 0.0033349990844726562 nb_pixel_total : 67227 time to create 1 rle with old method : 0.07764291763305664 length of segment : 464 time for calcul the mask position with numpy : 0.0013325214385986328 nb_pixel_total : 60432 time to create 1 rle with old method : 0.06806421279907227 length of segment : 230 time for calcul the mask position with numpy : 0.011935710906982422 nb_pixel_total : 368864 time to create 1 rle with new method : 0.08237743377685547 length of segment : 704 time for calcul the mask position with numpy : 0.0021028518676757812 nb_pixel_total : 65890 time to create 1 rle with old method : 0.07290077209472656 length of segment : 246 time for calcul the mask position with numpy : 0.0024580955505371094 nb_pixel_total : 69126 time to create 1 rle with old method : 0.07823777198791504 length of segment : 373 time for calcul the mask position with numpy : 0.016758441925048828 nb_pixel_total : 795900 time to create 1 rle with new method : 0.29244279861450195 length of segment : 873 time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 26433 time to create 1 rle with old method : 0.030435800552368164 length of segment : 210 time for calcul the mask position with numpy : 0.0026459693908691406 nb_pixel_total : 121566 time to create 1 rle with old method : 0.13419723510742188 length of segment : 346 time for calcul the mask position with numpy : 0.0042307376861572266 nb_pixel_total : 197364 time to create 1 rle with new method : 0.010843276977539062 length of segment : 562 time for calcul the mask position with numpy : 0.001001119613647461 nb_pixel_total : 36808 time to create 1 rle with old method : 0.04118490219116211 length of segment : 282 time for calcul the mask position with numpy : 0.005210399627685547 nb_pixel_total : 275984 time to create 1 rle with new method : 0.023002147674560547 length of segment : 758 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 24000 time to create 1 rle with old method : 0.026800870895385742 length of segment : 204 time for calcul the mask position with numpy : 0.0011894702911376953 nb_pixel_total : 37470 time to create 1 rle with old method : 0.045063018798828125 length of segment : 231 time for calcul the mask position with numpy : 0.0017235279083251953 nb_pixel_total : 65689 time to create 1 rle with old method : 0.07396578788757324 length of segment : 406 time for calcul the mask position with numpy : 0.003132343292236328 nb_pixel_total : 140229 time to create 1 rle with old method : 0.16848397254943848 length of segment : 597 time for calcul the mask position with numpy : 0.004419565200805664 nb_pixel_total : 169338 time to create 1 rle with new method : 0.011702775955200195 length of segment : 579 time for calcul the mask position with numpy : 0.0007121562957763672 nb_pixel_total : 21931 time to create 1 rle with old method : 0.024507999420166016 length of segment : 191 time for calcul the mask position with numpy : 0.0009262561798095703 nb_pixel_total : 39160 time to create 1 rle with old method : 0.0436251163482666 length of segment : 265 time for calcul the mask position with numpy : 0.008514881134033203 nb_pixel_total : 326388 time to create 1 rle with new method : 0.04655933380126953 length of segment : 681 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 11684 time to create 1 rle with old method : 0.01323699951171875 length of segment : 234 time for calcul the mask position with numpy : 0.0007314682006835938 nb_pixel_total : 28672 time to create 1 rle with old method : 0.03200840950012207 length of segment : 211 time for calcul the mask position with numpy : 0.0004782676696777344 nb_pixel_total : 18533 time to create 1 rle with old method : 0.020685434341430664 length of segment : 176 time for calcul the mask position with numpy : 0.0011487007141113281 nb_pixel_total : 37660 time to create 1 rle with old method : 0.06143617630004883 length of segment : 294 time for calcul the mask position with numpy : 0.0021653175354003906 nb_pixel_total : 72090 time to create 1 rle with old method : 0.08858227729797363 length of segment : 427 time for calcul the mask position with numpy : 0.0013115406036376953 nb_pixel_total : 45256 time to create 1 rle with old method : 0.05290508270263672 length of segment : 372 time for calcul the mask position with numpy : 0.002489805221557617 nb_pixel_total : 113488 time to create 1 rle with old method : 0.15085697174072266 length of segment : 435 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 13737 time to create 1 rle with old method : 0.015727758407592773 length of segment : 154 time for calcul the mask position with numpy : 0.006160736083984375 nb_pixel_total : 240022 time to create 1 rle with new method : 0.020008325576782227 length of segment : 1050 time for calcul the mask position with numpy : 0.0007238388061523438 nb_pixel_total : 26335 time to create 1 rle with old method : 0.029146432876586914 length of segment : 204 time for calcul the mask position with numpy : 0.002100706100463867 nb_pixel_total : 85105 time to create 1 rle with old method : 0.09591054916381836 length of segment : 435 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 77226 time to create 1 rle with old method : 0.08760976791381836 length of segment : 346 time for calcul the mask position with numpy : 0.0028896331787109375 nb_pixel_total : 143554 time to create 1 rle with old method : 0.157057523727417 length of segment : 407 time for calcul the mask position with numpy : 0.004475831985473633 nb_pixel_total : 158931 time to create 1 rle with new method : 0.011394262313842773 length of segment : 437 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 14992 time to create 1 rle with old method : 0.02065730094909668 length of segment : 168 time for calcul the mask position with numpy : 0.0018508434295654297 nb_pixel_total : 64559 time to create 1 rle with old method : 0.10244417190551758 length of segment : 372 time for calcul the mask position with numpy : 0.0010008811950683594 nb_pixel_total : 46608 time to create 1 rle with old method : 0.05270195007324219 length of segment : 167 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 10037 time to create 1 rle with old method : 0.011486053466796875 length of segment : 127 time for calcul the mask position with numpy : 0.0004050731658935547 nb_pixel_total : 13187 time to create 1 rle with old method : 0.014913082122802734 length of segment : 164 time for calcul the mask position with numpy : 0.015370845794677734 nb_pixel_total : 629525 time to create 1 rle with new method : 0.07925868034362793 length of segment : 1380 time for calcul the mask position with numpy : 0.0011553764343261719 nb_pixel_total : 38448 time to create 1 rle with old method : 0.05344414710998535 length of segment : 277 time for calcul the mask position with numpy : 0.002574443817138672 nb_pixel_total : 106366 time to create 1 rle with old method : 0.11212563514709473 length of segment : 364 time for calcul the mask position with numpy : 0.0008575916290283203 nb_pixel_total : 21747 time to create 1 rle with old method : 0.024080753326416016 length of segment : 179 time for calcul the mask position with numpy : 0.0022089481353759766 nb_pixel_total : 60559 time to create 1 rle with old method : 0.0651707649230957 length of segment : 430 time for calcul the mask position with numpy : 0.018004894256591797 nb_pixel_total : 672773 time to create 1 rle with new method : 0.1080322265625 length of segment : 1381 time for calcul the mask position with numpy : 0.0022819042205810547 nb_pixel_total : 110742 time to create 1 rle with old method : 0.1239476203918457 length of segment : 352 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 13584 time to create 1 rle with old method : 0.01549386978149414 length of segment : 103 time for calcul the mask position with numpy : 0.0006935596466064453 nb_pixel_total : 33960 time to create 1 rle with old method : 0.03835463523864746 length of segment : 347 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 5428 time to create 1 rle with old method : 0.006512165069580078 length of segment : 186 time for calcul the mask position with numpy : 0.0035660266876220703 nb_pixel_total : 152591 time to create 1 rle with new method : 0.010900020599365234 length of segment : 528 time for calcul the mask position with numpy : 0.007489442825317383 nb_pixel_total : 326547 time to create 1 rle with new method : 0.03789830207824707 length of segment : 568 time for calcul the mask position with numpy : 0.01205134391784668 nb_pixel_total : 403573 time to create 1 rle with new method : 0.06929326057434082 length of segment : 866 time for calcul the mask position with numpy : 0.01153254508972168 nb_pixel_total : 278507 time to create 1 rle with new method : 0.07061147689819336 length of segment : 768 time for calcul the mask position with numpy : 0.0039386749267578125 nb_pixel_total : 106612 time to create 1 rle with old method : 0.1446988582611084 length of segment : 356 time for calcul the mask position with numpy : 0.0009093284606933594 nb_pixel_total : 44284 time to create 1 rle with old method : 0.05396151542663574 length of segment : 213 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 30828 time to create 1 rle with old method : 0.04872608184814453 length of segment : 253 time for calcul the mask position with numpy : 0.0020148754119873047 nb_pixel_total : 34911 time to create 1 rle with old method : 0.04867672920227051 length of segment : 256 time for calcul the mask position with numpy : 0.0010514259338378906 nb_pixel_total : 29099 time to create 1 rle with old method : 0.04040956497192383 length of segment : 253 time for calcul the mask position with numpy : 0.0054302215576171875 nb_pixel_total : 186562 time to create 1 rle with new method : 0.01631450653076172 length of segment : 556 time for calcul the mask position with numpy : 0.0017025470733642578 nb_pixel_total : 92951 time to create 1 rle with old method : 0.1034698486328125 length of segment : 256 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 14070 time to create 1 rle with old method : 0.015470266342163086 length of segment : 110 time for calcul the mask position with numpy : 0.00128936767578125 nb_pixel_total : 53352 time to create 1 rle with old method : 0.06146597862243652 length of segment : 200 time for calcul the mask position with numpy : 0.0004601478576660156 nb_pixel_total : 18585 time to create 1 rle with old method : 0.02056288719177246 length of segment : 230 time for calcul the mask position with numpy : 0.0006463527679443359 nb_pixel_total : 28884 time to create 1 rle with old method : 0.03173542022705078 length of segment : 242 time for calcul the mask position with numpy : 0.0015609264373779297 nb_pixel_total : 66558 time to create 1 rle with old method : 0.07381796836853027 length of segment : 233 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 30977 time to create 1 rle with old method : 0.035485029220581055 length of segment : 152 time for calcul the mask position with numpy : 0.0009758472442626953 nb_pixel_total : 16358 time to create 1 rle with old method : 0.01831960678100586 length of segment : 255 time for calcul the mask position with numpy : 0.0044515132904052734 nb_pixel_total : 167737 time to create 1 rle with new method : 0.0157318115234375 length of segment : 905 time for calcul the mask position with numpy : 0.002040863037109375 nb_pixel_total : 51383 time to create 1 rle with old method : 0.06822991371154785 length of segment : 398 time for calcul the mask position with numpy : 0.006168842315673828 nb_pixel_total : 252945 time to create 1 rle with new method : 0.02818894386291504 length of segment : 603 time for calcul the mask position with numpy : 0.0019867420196533203 nb_pixel_total : 41555 time to create 1 rle with old method : 0.05574345588684082 length of segment : 324 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 12785 time to create 1 rle with old method : 0.015008926391601562 length of segment : 113 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 24031 time to create 1 rle with old method : 0.027464866638183594 length of segment : 167 time for calcul the mask position with numpy : 0.004926443099975586 nb_pixel_total : 248156 time to create 1 rle with new method : 0.014960527420043945 length of segment : 712 time for calcul the mask position with numpy : 0.0008318424224853516 nb_pixel_total : 31447 time to create 1 rle with old method : 0.05033397674560547 length of segment : 255 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 47367 time to create 1 rle with old method : 0.05262899398803711 length of segment : 209 time for calcul the mask position with numpy : 0.00045180320739746094 nb_pixel_total : 19554 time to create 1 rle with old method : 0.022037267684936523 length of segment : 128 time for calcul the mask position with numpy : 0.0029878616333007812 nb_pixel_total : 105771 time to create 1 rle with old method : 0.11634254455566406 length of segment : 507 time for calcul the mask position with numpy : 0.0014195442199707031 nb_pixel_total : 61467 time to create 1 rle with old method : 0.0678095817565918 length of segment : 255 time for calcul the mask position with numpy : 0.002350330352783203 nb_pixel_total : 105286 time to create 1 rle with old method : 0.1163780689239502 length of segment : 373 time for calcul the mask position with numpy : 0.003355264663696289 nb_pixel_total : 120585 time to create 1 rle with old method : 0.1294717788696289 length of segment : 412 time for calcul the mask position with numpy : 0.00331878662109375 nb_pixel_total : 129050 time to create 1 rle with old method : 0.14039134979248047 length of segment : 523 time for calcul the mask position with numpy : 0.0013141632080078125 nb_pixel_total : 34213 time to create 1 rle with old method : 0.03745388984680176 length of segment : 247 time for calcul the mask position with numpy : 0.002627849578857422 nb_pixel_total : 107257 time to create 1 rle with old method : 0.1169884204864502 length of segment : 382 time for calcul the mask position with numpy : 0.007490873336791992 nb_pixel_total : 314802 time to create 1 rle with new method : 0.04877972602844238 length of segment : 689 time for calcul the mask position with numpy : 0.0023200511932373047 nb_pixel_total : 117240 time to create 1 rle with old method : 0.12525177001953125 length of segment : 559 time for calcul the mask position with numpy : 0.0013751983642578125 nb_pixel_total : 53445 time to create 1 rle with old method : 0.05684638023376465 length of segment : 424 time for calcul the mask position with numpy : 0.002988576889038086 nb_pixel_total : 124977 time to create 1 rle with old method : 0.13356661796569824 length of segment : 576 time for calcul the mask position with numpy : 0.0014808177947998047 nb_pixel_total : 49175 time to create 1 rle with old method : 0.05225682258605957 length of segment : 390 time for calcul the mask position with numpy : 0.0024623870849609375 nb_pixel_total : 122280 time to create 1 rle with old method : 0.13643670082092285 length of segment : 373 time for calcul the mask position with numpy : 0.0038902759552001953 nb_pixel_total : 182939 time to create 1 rle with new method : 0.012846946716308594 length of segment : 834 time for calcul the mask position with numpy : 0.013158559799194336 nb_pixel_total : 658060 time to create 1 rle with new method : 0.059000253677368164 length of segment : 794 time for calcul the mask position with numpy : 0.009949207305908203 nb_pixel_total : 574377 time to create 1 rle with new method : 0.16872310638427734 length of segment : 755 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 15882 time to create 1 rle with old method : 0.01658344268798828 length of segment : 167 time for calcul the mask position with numpy : 0.009796857833862305 nb_pixel_total : 539334 time to create 1 rle with new method : 0.047968149185180664 length of segment : 749 time for calcul the mask position with numpy : 0.003927469253540039 nb_pixel_total : 223592 time to create 1 rle with new method : 0.01138448715209961 length of segment : 325 time for calcul the mask position with numpy : 0.1465139389038086 nb_pixel_total : 1321266 time to create 1 rle with new method : 0.12421107292175293 length of segment : 1495 time for calcul the mask position with numpy : 0.0008218288421630859 nb_pixel_total : 47875 time to create 1 rle with old method : 0.05142855644226074 length of segment : 223 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 49157 time to create 1 rle with old method : 0.0548243522644043 length of segment : 263 time for calcul the mask position with numpy : 0.0018193721771240234 nb_pixel_total : 105827 time to create 1 rle with old method : 0.11391139030456543 length of segment : 375 time for calcul the mask position with numpy : 0.0019385814666748047 nb_pixel_total : 100640 time to create 1 rle with old method : 0.10727930068969727 length of segment : 437 time for calcul the mask position with numpy : 0.0009739398956298828 nb_pixel_total : 47989 time to create 1 rle with old method : 0.05283403396606445 length of segment : 247 time for calcul the mask position with numpy : 0.01526498794555664 nb_pixel_total : 776100 time to create 1 rle with new method : 0.08384919166564941 length of segment : 997 time for calcul the mask position with numpy : 0.007995843887329102 nb_pixel_total : 274055 time to create 1 rle with new method : 0.03298163414001465 length of segment : 821 time for calcul the mask position with numpy : 0.0009322166442871094 nb_pixel_total : 51476 time to create 1 rle with old method : 0.05770087242126465 length of segment : 400 time for calcul the mask position with numpy : 0.003508329391479492 nb_pixel_total : 230050 time to create 1 rle with new method : 0.00897216796875 length of segment : 433 time for calcul the mask position with numpy : 0.0028095245361328125 nb_pixel_total : 177047 time to create 1 rle with new method : 0.007486104965209961 length of segment : 444 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 34306 time to create 1 rle with old method : 0.03762650489807129 length of segment : 234 time for calcul the mask position with numpy : 0.003113269805908203 nb_pixel_total : 120181 time to create 1 rle with old method : 0.12937283515930176 length of segment : 385 time for calcul the mask position with numpy : 0.0025992393493652344 nb_pixel_total : 140815 time to create 1 rle with old method : 0.15482640266418457 length of segment : 366 time for calcul the mask position with numpy : 0.00157928466796875 nb_pixel_total : 80488 time to create 1 rle with old method : 0.09612393379211426 length of segment : 244 time for calcul the mask position with numpy : 0.001531362533569336 nb_pixel_total : 67200 time to create 1 rle with old method : 0.07460689544677734 length of segment : 304 time for calcul the mask position with numpy : 0.00044417381286621094 nb_pixel_total : 16694 time to create 1 rle with old method : 0.028432607650756836 length of segment : 109 time for calcul the mask position with numpy : 0.001617431640625 nb_pixel_total : 67069 time to create 1 rle with old method : 0.0732274055480957 length of segment : 563 time for calcul the mask position with numpy : 0.0056269168853759766 nb_pixel_total : 312236 time to create 1 rle with new method : 0.01485586166381836 length of segment : 623 time for calcul the mask position with numpy : 0.009315729141235352 nb_pixel_total : 493792 time to create 1 rle with new method : 0.05858325958251953 length of segment : 1171 time for calcul the mask position with numpy : 0.0025184154510498047 nb_pixel_total : 127214 time to create 1 rle with old method : 0.13938522338867188 length of segment : 397 time for calcul the mask position with numpy : 0.0007183551788330078 nb_pixel_total : 42339 time to create 1 rle with old method : 0.0471196174621582 length of segment : 263 time for calcul the mask position with numpy : 0.0036191940307617188 nb_pixel_total : 187594 time to create 1 rle with new method : 0.010655879974365234 length of segment : 588 time for calcul the mask position with numpy : 0.0006940364837646484 nb_pixel_total : 31465 time to create 1 rle with old method : 0.03452348709106445 length of segment : 183 time for calcul the mask position with numpy : 0.00445866584777832 nb_pixel_total : 215884 time to create 1 rle with new method : 0.013381004333496094 length of segment : 666 time for calcul the mask position with numpy : 0.005567312240600586 nb_pixel_total : 254426 time to create 1 rle with new method : 0.016946792602539062 length of segment : 654 time for calcul the mask position with numpy : 0.0008358955383300781 nb_pixel_total : 42908 time to create 1 rle with old method : 0.04647111892700195 length of segment : 162 time for calcul the mask position with numpy : 0.0012378692626953125 nb_pixel_total : 63621 time to create 1 rle with old method : 0.07030177116394043 length of segment : 239 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 21888 time to create 1 rle with old method : 0.024950027465820312 length of segment : 271 time for calcul the mask position with numpy : 0.024806499481201172 nb_pixel_total : 366021 time to create 1 rle with new method : 0.2716805934906006 length of segment : 957 time for calcul the mask position with numpy : 0.018370389938354492 nb_pixel_total : 888497 time to create 1 rle with new method : 0.09756827354431152 length of segment : 1064 time for calcul the mask position with numpy : 0.0013027191162109375 nb_pixel_total : 80900 time to create 1 rle with old method : 0.08987951278686523 length of segment : 459 time for calcul the mask position with numpy : 0.0019032955169677734 nb_pixel_total : 86380 time to create 1 rle with old method : 0.09739971160888672 length of segment : 326 time for calcul the mask position with numpy : 0.0030765533447265625 nb_pixel_total : 190223 time to create 1 rle with new method : 0.00817108154296875 length of segment : 582 time for calcul the mask position with numpy : 0.001463174819946289 nb_pixel_total : 72750 time to create 1 rle with old method : 0.08057045936584473 length of segment : 444 time for calcul the mask position with numpy : 0.0008828639984130859 nb_pixel_total : 51397 time to create 1 rle with old method : 0.05772972106933594 length of segment : 323 time for calcul the mask position with numpy : 0.002109527587890625 nb_pixel_total : 123191 time to create 1 rle with old method : 0.13766145706176758 length of segment : 330 time for calcul the mask position with numpy : 0.0013930797576904297 nb_pixel_total : 81043 time to create 1 rle with old method : 0.08733224868774414 length of segment : 284 time for calcul the mask position with numpy : 0.012172937393188477 nb_pixel_total : 431059 time to create 1 rle with new method : 0.08759117126464844 length of segment : 1780 time for calcul the mask position with numpy : 0.0018832683563232422 nb_pixel_total : 94605 time to create 1 rle with old method : 0.10522031784057617 length of segment : 287 time for calcul the mask position with numpy : 0.002328157424926758 nb_pixel_total : 137991 time to create 1 rle with old method : 0.14818549156188965 length of segment : 356 time for calcul the mask position with numpy : 0.0006093978881835938 nb_pixel_total : 23947 time to create 1 rle with old method : 0.02616429328918457 length of segment : 336 time for calcul the mask position with numpy : 0.001706838607788086 nb_pixel_total : 90874 time to create 1 rle with old method : 0.09717178344726562 length of segment : 307 time for calcul the mask position with numpy : 0.002256631851196289 nb_pixel_total : 115256 time to create 1 rle with old method : 0.12487244606018066 length of segment : 380 time for calcul the mask position with numpy : 0.0016622543334960938 nb_pixel_total : 67226 time to create 1 rle with old method : 0.07538723945617676 length of segment : 380 time for calcul the mask position with numpy : 0.0018987655639648438 nb_pixel_total : 108368 time to create 1 rle with old method : 0.1200873851776123 length of segment : 373 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 43302 time to create 1 rle with old method : 0.04784703254699707 length of segment : 264 time for calcul the mask position with numpy : 0.004541635513305664 nb_pixel_total : 235124 time to create 1 rle with new method : 0.011555671691894531 length of segment : 435 time for calcul the mask position with numpy : 0.0013604164123535156 nb_pixel_total : 48350 time to create 1 rle with old method : 0.05217432975769043 length of segment : 258 time for calcul the mask position with numpy : 0.0013689994812011719 nb_pixel_total : 52228 time to create 1 rle with old method : 0.05798983573913574 length of segment : 267 time for calcul the mask position with numpy : 0.0009026527404785156 nb_pixel_total : 46504 time to create 1 rle with old method : 0.049614906311035156 length of segment : 184 time for calcul the mask position with numpy : 0.0022215843200683594 nb_pixel_total : 64607 time to create 1 rle with old method : 0.08781027793884277 length of segment : 456 time for calcul the mask position with numpy : 0.002139568328857422 nb_pixel_total : 68858 time to create 1 rle with old method : 0.10322809219360352 length of segment : 363 time for calcul the mask position with numpy : 0.0008282661437988281 nb_pixel_total : 38399 time to create 1 rle with old method : 0.04267382621765137 length of segment : 276 time for calcul the mask position with numpy : 0.013283967971801758 nb_pixel_total : 682502 time to create 1 rle with new method : 0.06457757949829102 length of segment : 1295 time for calcul the mask position with numpy : 0.0006079673767089844 nb_pixel_total : 29172 time to create 1 rle with old method : 0.03247666358947754 length of segment : 210 time for calcul the mask position with numpy : 0.0009832382202148438 nb_pixel_total : 45084 time to create 1 rle with old method : 0.04732656478881836 length of segment : 280 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 4036 time to create 1 rle with old method : 0.0051500797271728516 length of segment : 162 time for calcul the mask position with numpy : 0.003317594528198242 nb_pixel_total : 140775 time to create 1 rle with old method : 0.15157580375671387 length of segment : 416 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 15754 time to create 1 rle with old method : 0.017972230911254883 length of segment : 114 time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 11001 time to create 1 rle with old method : 0.012776374816894531 length of segment : 105 time for calcul the mask position with numpy : 0.0029587745666503906 nb_pixel_total : 146718 time to create 1 rle with old method : 0.1653122901916504 length of segment : 430 time for calcul the mask position with numpy : 0.001954793930053711 nb_pixel_total : 87725 time to create 1 rle with old method : 0.09739208221435547 length of segment : 292 time for calcul the mask position with numpy : 0.0009489059448242188 nb_pixel_total : 40204 time to create 1 rle with old method : 0.05988335609436035 length of segment : 203 time for calcul the mask position with numpy : 0.0017254352569580078 nb_pixel_total : 81163 time to create 1 rle with old method : 0.09052824974060059 length of segment : 381 time for calcul the mask position with numpy : 0.007286787033081055 nb_pixel_total : 367133 time to create 1 rle with new method : 0.03695058822631836 length of segment : 603 time for calcul the mask position with numpy : 0.0029871463775634766 nb_pixel_total : 164745 time to create 1 rle with new method : 0.006473064422607422 length of segment : 365 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 15110 time to create 1 rle with old method : 0.016875743865966797 length of segment : 159 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 47784 time to create 1 rle with old method : 0.05421090126037598 length of segment : 276 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 19087 time to create 1 rle with old method : 0.022188663482666016 length of segment : 149 time for calcul the mask position with numpy : 0.0009667873382568359 nb_pixel_total : 44886 time to create 1 rle with old method : 0.050017595291137695 length of segment : 214 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 12754 time to create 1 rle with old method : 0.014587640762329102 length of segment : 129 time for calcul the mask position with numpy : 0.0030252933502197266 nb_pixel_total : 94926 time to create 1 rle with old method : 0.11423420906066895 length of segment : 521 time for calcul the mask position with numpy : 0.002483367919921875 nb_pixel_total : 85555 time to create 1 rle with old method : 0.09465146064758301 length of segment : 669 time for calcul the mask position with numpy : 0.0004649162292480469 nb_pixel_total : 13072 time to create 1 rle with old method : 0.014798402786254883 length of segment : 143 time for calcul the mask position with numpy : 0.0011053085327148438 nb_pixel_total : 40833 time to create 1 rle with old method : 0.04670977592468262 length of segment : 224 time for calcul the mask position with numpy : 0.001255035400390625 nb_pixel_total : 46087 time to create 1 rle with old method : 0.0523829460144043 length of segment : 246 time for calcul the mask position with numpy : 0.0012302398681640625 nb_pixel_total : 50646 time to create 1 rle with old method : 0.09175753593444824 length of segment : 219 time for calcul the mask position with numpy : 0.0010933876037597656 nb_pixel_total : 25458 time to create 1 rle with old method : 0.029456138610839844 length of segment : 238 time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 15202 time to create 1 rle with old method : 0.0176236629486084 length of segment : 145 time for calcul the mask position with numpy : 0.0016689300537109375 nb_pixel_total : 90728 time to create 1 rle with old method : 0.10272955894470215 length of segment : 338 time for calcul the mask position with numpy : 0.0035049915313720703 nb_pixel_total : 183681 time to create 1 rle with new method : 0.00992441177368164 length of segment : 479 time for calcul the mask position with numpy : 0.001695871353149414 nb_pixel_total : 53429 time to create 1 rle with old method : 0.05917072296142578 length of segment : 283 time for calcul the mask position with numpy : 0.003931283950805664 nb_pixel_total : 229752 time to create 1 rle with new method : 0.010963916778564453 length of segment : 573 time for calcul the mask position with numpy : 0.00048279762268066406 nb_pixel_total : 7355 time to create 1 rle with old method : 0.008403778076171875 length of segment : 105 time for calcul the mask position with numpy : 0.0007610321044921875 nb_pixel_total : 30798 time to create 1 rle with old method : 0.033048391342163086 length of segment : 228 time for calcul the mask position with numpy : 0.0010631084442138672 nb_pixel_total : 57785 time to create 1 rle with old method : 0.06423115730285645 length of segment : 357 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 28501 time to create 1 rle with old method : 0.03102707862854004 length of segment : 309 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 18134 time to create 1 rle with old method : 0.02017068862915039 length of segment : 208 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 10078 time to create 1 rle with old method : 0.011900901794433594 length of segment : 122 time for calcul the mask position with numpy : 0.005051612854003906 nb_pixel_total : 212294 time to create 1 rle with new method : 0.013410329818725586 length of segment : 468 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 21530 time to create 1 rle with old method : 0.03579545021057129 length of segment : 144 time for calcul the mask position with numpy : 0.002721548080444336 nb_pixel_total : 84433 time to create 1 rle with old method : 0.10248923301696777 length of segment : 290 time for calcul the mask position with numpy : 0.006669521331787109 nb_pixel_total : 287202 time to create 1 rle with new method : 0.0175325870513916 length of segment : 546 time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 18282 time to create 1 rle with old method : 0.02053523063659668 length of segment : 153 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 10136 time to create 1 rle with old method : 0.011663198471069336 length of segment : 148 time for calcul the mask position with numpy : 0.001842498779296875 nb_pixel_total : 50136 time to create 1 rle with old method : 0.05416417121887207 length of segment : 429 time for calcul the mask position with numpy : 0.0013420581817626953 nb_pixel_total : 58629 time to create 1 rle with old method : 0.06554746627807617 length of segment : 235 time for calcul the mask position with numpy : 0.0031850337982177734 nb_pixel_total : 157392 time to create 1 rle with new method : 0.008186817169189453 length of segment : 904 time for calcul the mask position with numpy : 0.0010581016540527344 nb_pixel_total : 44474 time to create 1 rle with old method : 0.0496213436126709 length of segment : 267 time for calcul the mask position with numpy : 0.0010766983032226562 nb_pixel_total : 57687 time to create 1 rle with old method : 0.06476688385009766 length of segment : 152 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 18948 time to create 1 rle with old method : 0.021304607391357422 length of segment : 159 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 29510 time to create 1 rle with old method : 0.03526902198791504 length of segment : 269 time for calcul the mask position with numpy : 0.0020804405212402344 nb_pixel_total : 97466 time to create 1 rle with old method : 0.11711430549621582 length of segment : 616 time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 37041 time to create 1 rle with old method : 0.042008399963378906 length of segment : 219 time for calcul the mask position with numpy : 0.0021240711212158203 nb_pixel_total : 97259 time to create 1 rle with old method : 0.11006522178649902 length of segment : 226 time for calcul the mask position with numpy : 0.001832723617553711 nb_pixel_total : 87300 time to create 1 rle with old method : 0.0963280200958252 length of segment : 437 time for calcul the mask position with numpy : 0.0008299350738525391 nb_pixel_total : 35331 time to create 1 rle with old method : 0.03965282440185547 length of segment : 191 time for calcul the mask position with numpy : 0.002199888229370117 nb_pixel_total : 102251 time to create 1 rle with old method : 0.11107993125915527 length of segment : 565 time for calcul the mask position with numpy : 0.0011591911315917969 nb_pixel_total : 43245 time to create 1 rle with old method : 0.04749107360839844 length of segment : 181 time for calcul the mask position with numpy : 0.0025603771209716797 nb_pixel_total : 111252 time to create 1 rle with old method : 0.12082672119140625 length of segment : 348 time for calcul the mask position with numpy : 0.003016233444213867 nb_pixel_total : 144915 time to create 1 rle with old method : 0.1583855152130127 length of segment : 491 time for calcul the mask position with numpy : 0.0010325908660888672 nb_pixel_total : 53009 time to create 1 rle with old method : 0.05920839309692383 length of segment : 271 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 24039 time to create 1 rle with old method : 0.02673649787902832 length of segment : 186 time for calcul the mask position with numpy : 0.0015621185302734375 nb_pixel_total : 65696 time to create 1 rle with old method : 0.0724172592163086 length of segment : 274 time for calcul the mask position with numpy : 0.0019345283508300781 nb_pixel_total : 112918 time to create 1 rle with old method : 0.1252608299255371 length of segment : 238 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 46828 time to create 1 rle with old method : 0.05257225036621094 length of segment : 267 time for calcul the mask position with numpy : 0.0035567283630371094 nb_pixel_total : 104826 time to create 1 rle with old method : 0.11615347862243652 length of segment : 412 time for calcul the mask position with numpy : 0.001535654067993164 nb_pixel_total : 49636 time to create 1 rle with old method : 0.05507349967956543 length of segment : 325 time for calcul the mask position with numpy : 0.0006513595581054688 nb_pixel_total : 32363 time to create 1 rle with old method : 0.0390470027923584 length of segment : 224 time for calcul the mask position with numpy : 0.0005590915679931641 nb_pixel_total : 20247 time to create 1 rle with old method : 0.034340620040893555 length of segment : 134 time for calcul the mask position with numpy : 0.0018527507781982422 nb_pixel_total : 80223 time to create 1 rle with old method : 0.09025859832763672 length of segment : 339 time for calcul the mask position with numpy : 0.0017886161804199219 nb_pixel_total : 84130 time to create 1 rle with old method : 0.09490704536437988 length of segment : 305 time for calcul the mask position with numpy : 0.003347635269165039 nb_pixel_total : 168052 time to create 1 rle with new method : 0.0096282958984375 length of segment : 372 time for calcul the mask position with numpy : 0.0017194747924804688 nb_pixel_total : 72469 time to create 1 rle with old method : 0.07979893684387207 length of segment : 332 time spent for convertir_results : 41.335569858551025 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 384 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 123.22463989257812 time spend to save output : 0.20537972450256348 total time spend for step 2 : 123.43001961708069 step3:blur_detection Wed May 21 14:24:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 3120) 1505.302889650059 (3120, 3120) 894.150128574819 (3120, 3120) 631.6927940479427 (3120, 3120) 2166.9592541614456 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.01526784896850586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.013920783996582031 save missing photos in datou_result : time spend for datou_step_exec : 1.2146525382995605 time spend to save output : 0.03369426727294922 total time spend for step 3 : 1.2483468055725098 step4:brightness Wed May 21 14:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747830086_2929779_1360028131_477c65af02099469b0c8c713b52ee4ec.jpg treat image : temp/1747830086_2929779_1360028094_7a11b0f2f56761dbdad1267343a64bd5.jpg treat image : temp/1747830086_2929779_1360027797_31f2fab930b3c9f9438f52f1a2328580.jpg treat image : temp/1747830086_2929779_1360027792_fa5d6d15f4cc61d1a7f18c9b1a7dedab.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011891841888427734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.012009382247924805 save missing photos in datou_result : time spend for datou_step_exec : 4.6814680099487305 time spend to save output : 0.028250932693481445 total time spend for step 4 : 4.709718942642212 step5:rle_unique_nms_with_priority Wed May 21 14:24:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 384 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 103 nb_hashtags : 10 time to prepare the origin masks : 51.73593616485596 time for calcul the mask position with numpy : 0.16593050956726074 nb_pixel_total : 3130076 time to create 1 rle with new method : 1.058504343032837 time for calcul the mask position with numpy : 0.03970789909362793 nb_pixel_total : 362434 time to create 1 rle with new method : 1.1229743957519531 time for calcul the mask position with numpy : 0.03714704513549805 nb_pixel_total : 13881 time to create 1 rle with old method : 0.014830350875854492 time for calcul the mask position with numpy : 0.0374913215637207 nb_pixel_total : 11324 time to create 1 rle with old method : 0.011846065521240234 time for calcul the mask position with numpy : 0.03711128234863281 nb_pixel_total : 14400 time to create 1 rle with old method : 0.015007495880126953 time for calcul the mask position with numpy : 0.04090309143066406 nb_pixel_total : 758381 time to create 1 rle with new method : 0.9530885219573975 time for calcul the mask position with numpy : 0.03743314743041992 nb_pixel_total : 125871 time to create 1 rle with old method : 0.1350545883178711 time for calcul the mask position with numpy : 0.03866314888000488 nb_pixel_total : 16115 time to create 1 rle with old method : 0.017413616180419922 time for calcul the mask position with numpy : 0.03742694854736328 nb_pixel_total : 11088 time to create 1 rle with old method : 0.01310873031616211 time for calcul the mask position with numpy : 0.03818154335021973 nb_pixel_total : 50850 time to create 1 rle with old method : 0.05375862121582031 time for calcul the mask position with numpy : 0.037802934646606445 nb_pixel_total : 122056 time to create 1 rle with old method : 0.1341843605041504 time for calcul the mask position with numpy : 0.04470944404602051 nb_pixel_total : 15204 time to create 1 rle with old method : 0.017609596252441406 time for calcul the mask position with numpy : 0.041518449783325195 nb_pixel_total : 338867 time to create 1 rle with new method : 0.9714796543121338 time for calcul the mask position with numpy : 0.03985738754272461 nb_pixel_total : 9566 time to create 1 rle with old method : 0.010697126388549805 time for calcul the mask position with numpy : 0.03962850570678711 nb_pixel_total : 628 time to create 1 rle with old method : 0.00075531005859375 time for calcul the mask position with numpy : 0.03912234306335449 nb_pixel_total : 35914 time to create 1 rle with old method : 0.03878641128540039 time for calcul the mask position with numpy : 0.039101362228393555 nb_pixel_total : 13920 time to create 1 rle with old method : 0.0163421630859375 time for calcul the mask position with numpy : 0.03879833221435547 nb_pixel_total : 64498 time to create 1 rle with old method : 0.06998801231384277 time for calcul the mask position with numpy : 0.038413047790527344 nb_pixel_total : 54808 time to create 1 rle with old method : 0.05912375450134277 time for calcul the mask position with numpy : 0.03875923156738281 nb_pixel_total : 324 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.03887677192687988 nb_pixel_total : 31866 time to create 1 rle with old method : 0.03476262092590332 time for calcul the mask position with numpy : 0.0394895076751709 nb_pixel_total : 17517 time to create 1 rle with old method : 0.01990795135498047 time for calcul the mask position with numpy : 0.04046130180358887 nb_pixel_total : 210632 time to create 1 rle with new method : 1.242443561553955 time for calcul the mask position with numpy : 0.03876352310180664 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0020470619201660156 time for calcul the mask position with numpy : 0.03852128982543945 nb_pixel_total : 70648 time to create 1 rle with old method : 0.07511186599731445 time for calcul the mask position with numpy : 0.03849053382873535 nb_pixel_total : 36353 time to create 1 rle with old method : 0.03952765464782715 time for calcul the mask position with numpy : 0.03977155685424805 nb_pixel_total : 36381 time to create 1 rle with old method : 0.04034852981567383 time for calcul the mask position with numpy : 0.0397953987121582 nb_pixel_total : 16510 time to create 1 rle with old method : 0.01843094825744629 time for calcul the mask position with numpy : 0.03954458236694336 nb_pixel_total : 8218 time to create 1 rle with old method : 0.009634017944335938 time for calcul the mask position with numpy : 0.043993234634399414 nb_pixel_total : 87488 time to create 1 rle with old method : 0.1008753776550293 time for calcul the mask position with numpy : 0.03997516632080078 nb_pixel_total : 54391 time to create 1 rle with old method : 0.060289859771728516 time for calcul the mask position with numpy : 0.0403444766998291 nb_pixel_total : 49175 time to create 1 rle with old method : 0.05492424964904785 time for calcul the mask position with numpy : 0.040358781814575195 nb_pixel_total : 47986 time to create 1 rle with old method : 0.05348920822143555 time for calcul the mask position with numpy : 0.04006457328796387 nb_pixel_total : 61550 time to create 1 rle with old method : 0.0716855525970459 time for calcul the mask position with numpy : 0.039703369140625 nb_pixel_total : 4467 time to create 1 rle with old method : 0.005147457122802734 time for calcul the mask position with numpy : 0.040399789810180664 nb_pixel_total : 87138 time to create 1 rle with old method : 0.09456443786621094 time for calcul the mask position with numpy : 0.039350032806396484 nb_pixel_total : 93965 time to create 1 rle with old method : 0.10213899612426758 time for calcul the mask position with numpy : 0.04112505912780762 nb_pixel_total : 18632 time to create 1 rle with old method : 0.020490646362304688 time for calcul the mask position with numpy : 0.03923964500427246 nb_pixel_total : 63456 time to create 1 rle with old method : 0.0699012279510498 time for calcul the mask position with numpy : 0.045491933822631836 nb_pixel_total : 40445 time to create 1 rle with old method : 0.05594635009765625 time for calcul the mask position with numpy : 0.03760504722595215 nb_pixel_total : 48578 time to create 1 rle with old method : 0.051636457443237305 time for calcul the mask position with numpy : 0.03743457794189453 nb_pixel_total : 80157 time to create 1 rle with old method : 0.08419227600097656 time for calcul the mask position with numpy : 0.037471771240234375 nb_pixel_total : 4088 time to create 1 rle with old method : 0.0044918060302734375 time for calcul the mask position with numpy : 0.03926444053649902 nb_pixel_total : 110092 time to create 1 rle with old method : 0.11744904518127441 time for calcul the mask position with numpy : 0.039376020431518555 nb_pixel_total : 152035 time to create 1 rle with new method : 0.8524572849273682 time for calcul the mask position with numpy : 0.03719043731689453 nb_pixel_total : 1287 time to create 1 rle with old method : 0.001459360122680664 time for calcul the mask position with numpy : 0.038481950759887695 nb_pixel_total : 45874 time to create 1 rle with old method : 0.05002164840698242 time for calcul the mask position with numpy : 0.03901553153991699 nb_pixel_total : 1953 time to create 1 rle with old method : 0.002297639846801758 time for calcul the mask position with numpy : 0.03889155387878418 nb_pixel_total : 12328 time to create 1 rle with old method : 0.01361083984375 time for calcul the mask position with numpy : 0.043956756591796875 nb_pixel_total : 41630 time to create 1 rle with old method : 0.046393632888793945 time for calcul the mask position with numpy : 0.048990726470947266 nb_pixel_total : 3664 time to create 1 rle with old method : 0.009963512420654297 time for calcul the mask position with numpy : 0.057619571685791016 nb_pixel_total : 178344 time to create 1 rle with new method : 1.5981359481811523 time for calcul the mask position with numpy : 0.0423281192779541 nb_pixel_total : 17777 time to create 1 rle with old method : 0.020029306411743164 time for calcul the mask position with numpy : 0.038439035415649414 nb_pixel_total : 12714 time to create 1 rle with old method : 0.014269113540649414 time for calcul the mask position with numpy : 0.0385284423828125 nb_pixel_total : 1575 time to create 1 rle with old method : 0.002095460891723633 time for calcul the mask position with numpy : 0.04030156135559082 nb_pixel_total : 360919 time to create 1 rle with new method : 0.8908483982086182 time for calcul the mask position with numpy : 0.039102792739868164 nb_pixel_total : 45874 time to create 1 rle with old method : 0.049245357513427734 time for calcul the mask position with numpy : 0.038954973220825195 nb_pixel_total : 35498 time to create 1 rle with old method : 0.03821372985839844 time for calcul the mask position with numpy : 0.039542436599731445 nb_pixel_total : 16656 time to create 1 rle with old method : 0.017961502075195312 time for calcul the mask position with numpy : 0.0400393009185791 nb_pixel_total : 11584 time to create 1 rle with old method : 0.012904882431030273 time for calcul the mask position with numpy : 0.04030418395996094 nb_pixel_total : 8713 time to create 1 rle with old method : 0.009973287582397461 time for calcul the mask position with numpy : 0.04119873046875 nb_pixel_total : 1545 time to create 1 rle with old method : 0.001966238021850586 time for calcul the mask position with numpy : 0.04443025588989258 nb_pixel_total : 27762 time to create 1 rle with old method : 0.04492616653442383 time for calcul the mask position with numpy : 0.04029273986816406 nb_pixel_total : 31940 time to create 1 rle with old method : 0.03570103645324707 time for calcul the mask position with numpy : 0.03941082954406738 nb_pixel_total : 37314 time to create 1 rle with old method : 0.04243946075439453 time for calcul the mask position with numpy : 0.03960609436035156 nb_pixel_total : 49273 time to create 1 rle with old method : 0.05300593376159668 time for calcul the mask position with numpy : 0.0388791561126709 nb_pixel_total : 2084 time to create 1 rle with old method : 0.002494335174560547 time for calcul the mask position with numpy : 0.03910708427429199 nb_pixel_total : 2560 time to create 1 rle with old method : 0.002833843231201172 time for calcul the mask position with numpy : 0.039893388748168945 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0013818740844726562 time for calcul the mask position with numpy : 0.04084610939025879 nb_pixel_total : 9068 time to create 1 rle with old method : 0.011107683181762695 time for calcul the mask position with numpy : 0.04145383834838867 nb_pixel_total : 183585 time to create 1 rle with new method : 1.0176610946655273 time for calcul the mask position with numpy : 0.041930437088012695 nb_pixel_total : 129940 time to create 1 rle with old method : 0.15571284294128418 time for calcul the mask position with numpy : 0.04334616661071777 nb_pixel_total : 265100 time to create 1 rle with new method : 0.9101157188415527 time for calcul the mask position with numpy : 0.04004359245300293 nb_pixel_total : 101940 time to create 1 rle with old method : 0.11263370513916016 time for calcul the mask position with numpy : 0.0387723445892334 nb_pixel_total : 13611 time to create 1 rle with old method : 0.014617919921875 time for calcul the mask position with numpy : 0.0395050048828125 nb_pixel_total : 64785 time to create 1 rle with old method : 0.06987452507019043 time for calcul the mask position with numpy : 0.03960537910461426 nb_pixel_total : 38528 time to create 1 rle with old method : 0.041262149810791016 time for calcul the mask position with numpy : 0.0403599739074707 nb_pixel_total : 47589 time to create 1 rle with old method : 0.052840471267700195 time for calcul the mask position with numpy : 0.04082489013671875 nb_pixel_total : 39825 time to create 1 rle with old method : 0.044414520263671875 time for calcul the mask position with numpy : 0.03975629806518555 nb_pixel_total : 47678 time to create 1 rle with old method : 0.05224609375 time for calcul the mask position with numpy : 0.04018712043762207 nb_pixel_total : 10239 time to create 1 rle with old method : 0.011439085006713867 time for calcul the mask position with numpy : 0.040004730224609375 nb_pixel_total : 1221 time to create 1 rle with old method : 0.001659393310546875 time for calcul the mask position with numpy : 0.04056239128112793 nb_pixel_total : 67710 time to create 1 rle with old method : 0.07548165321350098 time for calcul the mask position with numpy : 0.04016590118408203 nb_pixel_total : 7988 time to create 1 rle with old method : 0.008734464645385742 time for calcul the mask position with numpy : 0.0407412052154541 nb_pixel_total : 31031 time to create 1 rle with old method : 0.034111738204956055 time for calcul the mask position with numpy : 0.040319204330444336 nb_pixel_total : 84547 time to create 1 rle with old method : 0.09277892112731934 time for calcul the mask position with numpy : 0.04046893119812012 nb_pixel_total : 27246 time to create 1 rle with old method : 0.03167390823364258 time for calcul the mask position with numpy : 0.040090322494506836 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0034558773040771484 time for calcul the mask position with numpy : 0.039621591567993164 nb_pixel_total : 14823 time to create 1 rle with old method : 0.016611814498901367 time for calcul the mask position with numpy : 0.04056072235107422 nb_pixel_total : 168542 time to create 1 rle with new method : 1.209221601486206 time for calcul the mask position with numpy : 0.04582834243774414 nb_pixel_total : 38169 time to create 1 rle with old method : 0.042290449142456055 time for calcul the mask position with numpy : 0.039040327072143555 nb_pixel_total : 5 time to create 1 rle with old method : 4.267692565917969e-05 time for calcul the mask position with numpy : 0.04009056091308594 nb_pixel_total : 57812 time to create 1 rle with old method : 0.06440114974975586 time for calcul the mask position with numpy : 0.04031181335449219 nb_pixel_total : 96653 time to create 1 rle with old method : 0.1051781177520752 time for calcul the mask position with numpy : 0.04012656211853027 nb_pixel_total : 4681 time to create 1 rle with old method : 0.005796909332275391 time for calcul the mask position with numpy : 0.043410539627075195 nb_pixel_total : 211363 time to create 1 rle with new method : 1.2253546714782715 time for calcul the mask position with numpy : 0.04005312919616699 nb_pixel_total : 79962 time to create 1 rle with old method : 0.08844733238220215 time for calcul the mask position with numpy : 0.04100203514099121 nb_pixel_total : 96432 time to create 1 rle with old method : 0.10728907585144043 time for calcul the mask position with numpy : 0.03952980041503906 nb_pixel_total : 56119 time to create 1 rle with old method : 0.06243157386779785 time for calcul the mask position with numpy : 0.039678335189819336 nb_pixel_total : 8116 time to create 1 rle with old method : 0.00948190689086914 time for calcul the mask position with numpy : 0.040194034576416016 nb_pixel_total : 76500 time to create 1 rle with old method : 0.08376526832580566 time for calcul the mask position with numpy : 0.03978919982910156 nb_pixel_total : 76086 time to create 1 rle with old method : 0.0836191177368164 time for calcul the mask position with numpy : 0.03976011276245117 nb_pixel_total : 15193 time to create 1 rle with old method : 0.01684427261352539 time for calcul the mask position with numpy : 0.039253950119018555 nb_pixel_total : 25877 time to create 1 rle with old method : 0.028025150299072266 create new chi : 21.539172887802124 time to delete rle : 0.02931070327758789 batch 1 Loaded 104 chid ids of type : 4855 Number RLEs to save : 56280 TO DO : save crop sub photo not yet done ! save time : 3.3640201091766357 nb_obj : 105 nb_hashtags : 11 time to prepare the origin masks : 56.163240909576416 time for calcul the mask position with numpy : 0.06833052635192871 nb_pixel_total : 2902484 time to create 1 rle with new method : 0.9700007438659668 time for calcul the mask position with numpy : 0.04051923751831055 nb_pixel_total : 18727 time to create 1 rle with old method : 0.02110147476196289 time for calcul the mask position with numpy : 0.04013395309448242 nb_pixel_total : 44062 time to create 1 rle with old method : 0.04852581024169922 time for calcul the mask position with numpy : 0.0406041145324707 nb_pixel_total : 106159 time to create 1 rle with old method : 0.11652708053588867 time for calcul the mask position with numpy : 0.040427207946777344 nb_pixel_total : 22919 time to create 1 rle with old method : 0.027053356170654297 time for calcul the mask position with numpy : 0.03931093215942383 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008714199066162109 time for calcul the mask position with numpy : 0.04017448425292969 nb_pixel_total : 117011 time to create 1 rle with old method : 0.1547832489013672 time for calcul the mask position with numpy : 0.041342973709106445 nb_pixel_total : 328188 time to create 1 rle with new method : 1.0488455295562744 time for calcul the mask position with numpy : 0.04929685592651367 nb_pixel_total : 439478 time to create 1 rle with new method : 1.0824007987976074 time for calcul the mask position with numpy : 0.03887176513671875 nb_pixel_total : 8892 time to create 1 rle with old method : 0.010038614273071289 time for calcul the mask position with numpy : 0.03884720802307129 nb_pixel_total : 1804 time to create 1 rle with old method : 0.0021657943725585938 time for calcul the mask position with numpy : 0.039283037185668945 nb_pixel_total : 84869 time to create 1 rle with old method : 0.09251928329467773 time for calcul the mask position with numpy : 0.03848743438720703 nb_pixel_total : 5423 time to create 1 rle with old method : 0.005899906158447266 time for calcul the mask position with numpy : 0.03736472129821777 nb_pixel_total : 40357 time to create 1 rle with old method : 0.042351484298706055 time for calcul the mask position with numpy : 0.038136959075927734 nb_pixel_total : 13014 time to create 1 rle with old method : 0.014308452606201172 time for calcul the mask position with numpy : 0.03788304328918457 nb_pixel_total : 77138 time to create 1 rle with old method : 0.08089113235473633 time for calcul the mask position with numpy : 0.037312984466552734 nb_pixel_total : 59488 time to create 1 rle with old method : 0.06430435180664062 time for calcul the mask position with numpy : 0.039324283599853516 nb_pixel_total : 10783 time to create 1 rle with old method : 0.011706352233886719 time for calcul the mask position with numpy : 0.039423465728759766 nb_pixel_total : 169102 time to create 1 rle with new method : 0.9344978332519531 time for calcul the mask position with numpy : 0.03872942924499512 nb_pixel_total : 28982 time to create 1 rle with old method : 0.03162860870361328 time for calcul the mask position with numpy : 0.039751529693603516 nb_pixel_total : 14401 time to create 1 rle with old method : 0.01553797721862793 time for calcul the mask position with numpy : 0.03895282745361328 nb_pixel_total : 71570 time to create 1 rle with old method : 0.09403181076049805 time for calcul the mask position with numpy : 0.0451657772064209 nb_pixel_total : 291628 time to create 1 rle with new method : 1.0541298389434814 time for calcul the mask position with numpy : 0.039775848388671875 nb_pixel_total : 34845 time to create 1 rle with old method : 0.03843259811401367 time for calcul the mask position with numpy : 0.040254831314086914 nb_pixel_total : 72093 time to create 1 rle with old method : 0.08002734184265137 time for calcul the mask position with numpy : 0.04030036926269531 nb_pixel_total : 25754 time to create 1 rle with old method : 0.028374671936035156 time for calcul the mask position with numpy : 0.038820743560791016 nb_pixel_total : 11717 time to create 1 rle with old method : 0.012984514236450195 time for calcul the mask position with numpy : 0.04197120666503906 nb_pixel_total : 243710 time to create 1 rle with new method : 1.1111445426940918 time for calcul the mask position with numpy : 0.03907489776611328 nb_pixel_total : 2725 time to create 1 rle with old method : 0.003207683563232422 time for calcul the mask position with numpy : 0.03915762901306152 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009167194366455078 time for calcul the mask position with numpy : 0.03946232795715332 nb_pixel_total : 20111 time to create 1 rle with old method : 0.021581172943115234 time for calcul the mask position with numpy : 0.03956937789916992 nb_pixel_total : 19 time to create 1 rle with old method : 0.00016498565673828125 time for calcul the mask position with numpy : 0.04001259803771973 nb_pixel_total : 62401 time to create 1 rle with old method : 0.06920027732849121 time for calcul the mask position with numpy : 0.03927278518676758 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.041257381439208984 nb_pixel_total : 197210 time to create 1 rle with new method : 0.8316774368286133 time for calcul the mask position with numpy : 0.040497541427612305 nb_pixel_total : 37340 time to create 1 rle with old method : 0.0405430793762207 time for calcul the mask position with numpy : 0.04539132118225098 nb_pixel_total : 1 time to create 1 rle with old method : 2.956390380859375e-05 time for calcul the mask position with numpy : 0.0450289249420166 nb_pixel_total : 2943 time to create 1 rle with old method : 0.0031440258026123047 time for calcul the mask position with numpy : 0.03773331642150879 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0019843578338623047 time for calcul the mask position with numpy : 0.03841400146484375 nb_pixel_total : 25807 time to create 1 rle with old method : 0.02844691276550293 time for calcul the mask position with numpy : 0.04001212120056152 nb_pixel_total : 5383 time to create 1 rle with old method : 0.006044626235961914 time for calcul the mask position with numpy : 0.03969097137451172 nb_pixel_total : 47798 time to create 1 rle with old method : 0.053145408630371094 time for calcul the mask position with numpy : 0.041867971420288086 nb_pixel_total : 28980 time to create 1 rle with old method : 0.03277015686035156 time for calcul the mask position with numpy : 0.0394132137298584 nb_pixel_total : 20800 time to create 1 rle with old method : 0.023508310317993164 time for calcul the mask position with numpy : 0.04209709167480469 nb_pixel_total : 1316 time to create 1 rle with old method : 0.002146005630493164 time for calcul the mask position with numpy : 0.03973102569580078 nb_pixel_total : 3534 time to create 1 rle with old method : 0.004180431365966797 time for calcul the mask position with numpy : 0.041162967681884766 nb_pixel_total : 251723 time to create 1 rle with new method : 1.3650596141815186 time for calcul the mask position with numpy : 0.04154086112976074 nb_pixel_total : 77173 time to create 1 rle with old method : 0.08490633964538574 time for calcul the mask position with numpy : 0.039788007736206055 nb_pixel_total : 28684 time to create 1 rle with old method : 0.031713008880615234 time for calcul the mask position with numpy : 0.03966879844665527 nb_pixel_total : 13142 time to create 1 rle with old method : 0.018146991729736328 time for calcul the mask position with numpy : 0.04984688758850098 nb_pixel_total : 21796 time to create 1 rle with old method : 0.033753395080566406 time for calcul the mask position with numpy : 0.03998613357543945 nb_pixel_total : 2057 time to create 1 rle with old method : 0.0025987625122070312 time for calcul the mask position with numpy : 0.04144859313964844 nb_pixel_total : 158586 time to create 1 rle with new method : 0.9735698699951172 time for calcul the mask position with numpy : 0.03975558280944824 nb_pixel_total : 19279 time to create 1 rle with old method : 0.02159428596496582 time for calcul the mask position with numpy : 0.03993630409240723 nb_pixel_total : 18289 time to create 1 rle with old method : 0.020660877227783203 time for calcul the mask position with numpy : 0.04054617881774902 nb_pixel_total : 1513 time to create 1 rle with old method : 0.0020339488983154297 time for calcul the mask position with numpy : 0.04013848304748535 nb_pixel_total : 12824 time to create 1 rle with old method : 0.01446986198425293 time for calcul the mask position with numpy : 0.0428774356842041 nb_pixel_total : 277947 time to create 1 rle with new method : 0.8438570499420166 time for calcul the mask position with numpy : 0.040009498596191406 nb_pixel_total : 8335 time to create 1 rle with old method : 0.009745121002197266 time for calcul the mask position with numpy : 0.04150986671447754 nb_pixel_total : 36743 time to create 1 rle with old method : 0.041585445404052734 time for calcul the mask position with numpy : 0.040355682373046875 nb_pixel_total : 21700 time to create 1 rle with old method : 0.02423405647277832 time for calcul the mask position with numpy : 0.04056119918823242 nb_pixel_total : 65187 time to create 1 rle with old method : 0.07164621353149414 time for calcul the mask position with numpy : 0.04062199592590332 nb_pixel_total : 28042 time to create 1 rle with old method : 0.0306549072265625 time for calcul the mask position with numpy : 0.04027247428894043 nb_pixel_total : 12758 time to create 1 rle with old method : 0.015752315521240234 time for calcul the mask position with numpy : 0.0404820442199707 nb_pixel_total : 14031 time to create 1 rle with old method : 0.015732765197753906 time for calcul the mask position with numpy : 0.04037594795227051 nb_pixel_total : 7158 time to create 1 rle with old method : 0.008354663848876953 time for calcul the mask position with numpy : 0.04024934768676758 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009047985076904297 time for calcul the mask position with numpy : 0.040488243103027344 nb_pixel_total : 38708 time to create 1 rle with old method : 0.04222989082336426 time for calcul the mask position with numpy : 0.039541006088256836 nb_pixel_total : 1116 time to create 1 rle with old method : 0.0014185905456542969 time for calcul the mask position with numpy : 0.03949475288391113 nb_pixel_total : 13553 time to create 1 rle with old method : 0.015063047409057617 time for calcul the mask position with numpy : 0.03928661346435547 nb_pixel_total : 23898 time to create 1 rle with old method : 0.027056455612182617 time for calcul the mask position with numpy : 0.03976297378540039 nb_pixel_total : 33673 time to create 1 rle with old method : 0.03683972358703613 time for calcul the mask position with numpy : 0.03867506980895996 nb_pixel_total : 18405 time to create 1 rle with old method : 0.019489288330078125 time for calcul the mask position with numpy : 0.03859376907348633 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006778240203857422 time for calcul the mask position with numpy : 0.04332280158996582 nb_pixel_total : 794529 time to create 1 rle with new method : 0.9021456241607666 time for calcul the mask position with numpy : 0.040633440017700195 nb_pixel_total : 64333 time to create 1 rle with old method : 0.07061505317687988 time for calcul the mask position with numpy : 0.03906559944152832 nb_pixel_total : 14882 time to create 1 rle with old method : 0.01628708839416504 time for calcul the mask position with numpy : 0.03924751281738281 nb_pixel_total : 140047 time to create 1 rle with old method : 0.15708613395690918 time for calcul the mask position with numpy : 0.04006624221801758 nb_pixel_total : 185882 time to create 1 rle with new method : 0.9591352939605713 time for calcul the mask position with numpy : 0.039751529693603516 nb_pixel_total : 9225 time to create 1 rle with old method : 0.010661840438842773 time for calcul the mask position with numpy : 0.0388178825378418 nb_pixel_total : 51015 time to create 1 rle with old method : 0.056539297103881836 time for calcul the mask position with numpy : 0.03960895538330078 nb_pixel_total : 66534 time to create 1 rle with old method : 0.07234501838684082 time for calcul the mask position with numpy : 0.040508270263671875 nb_pixel_total : 319600 time to create 1 rle with new method : 0.8035585880279541 time for calcul the mask position with numpy : 0.04959249496459961 nb_pixel_total : 6908 time to create 1 rle with old method : 0.009849309921264648 time for calcul the mask position with numpy : 0.04052257537841797 nb_pixel_total : 11752 time to create 1 rle with old method : 0.01363515853881836 time for calcul the mask position with numpy : 0.040212154388427734 nb_pixel_total : 18508 time to create 1 rle with old method : 0.020795106887817383 time for calcul the mask position with numpy : 0.04054880142211914 nb_pixel_total : 120321 time to create 1 rle with old method : 0.13669490814208984 time for calcul the mask position with numpy : 0.04012179374694824 nb_pixel_total : 53235 time to create 1 rle with old method : 0.06257414817810059 time for calcul the mask position with numpy : 0.04257845878601074 nb_pixel_total : 274436 time to create 1 rle with new method : 0.9547512531280518 time for calcul the mask position with numpy : 0.03842449188232422 nb_pixel_total : 33847 time to create 1 rle with old method : 0.03761005401611328 time for calcul the mask position with numpy : 0.03961825370788574 nb_pixel_total : 25926 time to create 1 rle with old method : 0.028658628463745117 time for calcul the mask position with numpy : 0.040785789489746094 nb_pixel_total : 121305 time to create 1 rle with old method : 0.13834524154663086 time for calcul the mask position with numpy : 0.05190706253051758 nb_pixel_total : 8945 time to create 1 rle with old method : 0.010959625244140625 time for calcul the mask position with numpy : 0.040460824966430664 nb_pixel_total : 112208 time to create 1 rle with old method : 0.12720012664794922 time for calcul the mask position with numpy : 0.03950691223144531 nb_pixel_total : 106401 time to create 1 rle with old method : 0.11382222175598145 time for calcul the mask position with numpy : 0.040505170822143555 nb_pixel_total : 30988 time to create 1 rle with old method : 0.03442120552062988 time for calcul the mask position with numpy : 0.03979611396789551 nb_pixel_total : 39133 time to create 1 rle with old method : 0.043184757232666016 time for calcul the mask position with numpy : 0.03914189338684082 nb_pixel_total : 13650 time to create 1 rle with old method : 0.014816761016845703 time for calcul the mask position with numpy : 0.03918790817260742 nb_pixel_total : 26329 time to create 1 rle with old method : 0.028816938400268555 time for calcul the mask position with numpy : 0.04005789756774902 nb_pixel_total : 66022 time to create 1 rle with old method : 0.07624673843383789 time for calcul the mask position with numpy : 0.03932023048400879 nb_pixel_total : 23844 time to create 1 rle with old method : 0.026952028274536133 time for calcul the mask position with numpy : 0.039223432540893555 nb_pixel_total : 24081 time to create 1 rle with old method : 0.027538776397705078 time for calcul the mask position with numpy : 0.03962278366088867 nb_pixel_total : 33011 time to create 1 rle with old method : 0.036313772201538086 time for calcul the mask position with numpy : 0.03936576843261719 nb_pixel_total : 13800 time to create 1 rle with old method : 0.015192747116088867 time for calcul the mask position with numpy : 0.03923487663269043 nb_pixel_total : 4797 time to create 1 rle with old method : 0.0054209232330322266 time for calcul the mask position with numpy : 0.03971076011657715 nb_pixel_total : 7236 time to create 1 rle with old method : 0.007943153381347656 create new chi : 21.895328044891357 time to delete rle : 0.007322788238525391 batch 1 Loaded 106 chid ids of type : 4855 Number RLEs to save : 58801 TO DO : save crop sub photo not yet done ! save time : 3.4159793853759766 nb_obj : 60 nb_hashtags : 9 time to prepare the origin masks : 39.106727838516235 time for calcul the mask position with numpy : 1.783458948135376 nb_pixel_total : 2299223 time to create 1 rle with new method : 0.885296106338501 time for calcul the mask position with numpy : 0.0403895378112793 nb_pixel_total : 3059 time to create 1 rle with old method : 0.004170894622802734 time for calcul the mask position with numpy : 0.04259324073791504 nb_pixel_total : 257965 time to create 1 rle with new method : 0.8068840503692627 time for calcul the mask position with numpy : 0.039604902267456055 nb_pixel_total : 52251 time to create 1 rle with old method : 0.05794954299926758 time for calcul the mask position with numpy : 0.03974199295043945 nb_pixel_total : 5072 time to create 1 rle with old method : 0.00583958625793457 time for calcul the mask position with numpy : 0.18688488006591797 nb_pixel_total : 1317517 time to create 1 rle with new method : 0.987595796585083 time for calcul the mask position with numpy : 0.046159982681274414 nb_pixel_total : 727012 time to create 1 rle with new method : 0.938683032989502 time for calcul the mask position with numpy : 0.04022049903869629 nb_pixel_total : 33705 time to create 1 rle with old method : 0.03828310966491699 time for calcul the mask position with numpy : 0.040845394134521484 nb_pixel_total : 85187 time to create 1 rle with old method : 0.09536504745483398 time for calcul the mask position with numpy : 0.03918004035949707 nb_pixel_total : 3363 time to create 1 rle with old method : 0.003793001174926758 time for calcul the mask position with numpy : 0.04010152816772461 nb_pixel_total : 19716 time to create 1 rle with old method : 0.02224445343017578 time for calcul the mask position with numpy : 0.040132761001586914 nb_pixel_total : 80434 time to create 1 rle with old method : 0.09073042869567871 time for calcul the mask position with numpy : 0.039940595626831055 nb_pixel_total : 13587 time to create 1 rle with old method : 0.015439987182617188 time for calcul the mask position with numpy : 0.04015064239501953 nb_pixel_total : 62160 time to create 1 rle with old method : 0.06975102424621582 time for calcul the mask position with numpy : 0.03986024856567383 nb_pixel_total : 18498 time to create 1 rle with old method : 0.022336244583129883 time for calcul the mask position with numpy : 0.04112696647644043 nb_pixel_total : 8020 time to create 1 rle with old method : 0.009493112564086914 time for calcul the mask position with numpy : 0.04281282424926758 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003418922424316406 time for calcul the mask position with numpy : 0.0440669059753418 nb_pixel_total : 158796 time to create 1 rle with new method : 0.8116230964660645 time for calcul the mask position with numpy : 0.03943157196044922 nb_pixel_total : 47777 time to create 1 rle with old method : 0.05329322814941406 time for calcul the mask position with numpy : 0.03916287422180176 nb_pixel_total : 80129 time to create 1 rle with old method : 0.09322094917297363 time for calcul the mask position with numpy : 0.04363727569580078 nb_pixel_total : 745811 time to create 1 rle with new method : 1.0236647129058838 time for calcul the mask position with numpy : 0.03947162628173828 nb_pixel_total : 32112 time to create 1 rle with old method : 0.03542065620422363 time for calcul the mask position with numpy : 0.04028749465942383 nb_pixel_total : 31228 time to create 1 rle with old method : 0.03492450714111328 time for calcul the mask position with numpy : 0.04146122932434082 nb_pixel_total : 3216 time to create 1 rle with old method : 0.005381107330322266 time for calcul the mask position with numpy : 0.0453639030456543 nb_pixel_total : 8325 time to create 1 rle with old method : 0.013943195343017578 time for calcul the mask position with numpy : 0.03981947898864746 nb_pixel_total : 19433 time to create 1 rle with old method : 0.0214383602142334 time for calcul the mask position with numpy : 0.03926444053649902 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002269268035888672 time for calcul the mask position with numpy : 0.03929948806762695 nb_pixel_total : 28866 time to create 1 rle with old method : 0.0336918830871582 time for calcul the mask position with numpy : 0.04155111312866211 nb_pixel_total : 311689 time to create 1 rle with new method : 0.593578577041626 time for calcul the mask position with numpy : 0.03882288932800293 nb_pixel_total : 25790 time to create 1 rle with old method : 0.031243324279785156 time for calcul the mask position with numpy : 0.03992748260498047 nb_pixel_total : 28137 time to create 1 rle with old method : 0.03162121772766113 time for calcul the mask position with numpy : 0.039630889892578125 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0015637874603271484 time for calcul the mask position with numpy : 0.03954124450683594 nb_pixel_total : 92618 time to create 1 rle with old method : 0.10059881210327148 time for calcul the mask position with numpy : 0.03943943977355957 nb_pixel_total : 3538 time to create 1 rle with old method : 0.004536867141723633 time for calcul the mask position with numpy : 0.04004693031311035 nb_pixel_total : 273747 time to create 1 rle with new method : 0.6892623901367188 time for calcul the mask position with numpy : 0.03888726234436035 nb_pixel_total : 5569 time to create 1 rle with old method : 0.006609201431274414 time for calcul the mask position with numpy : 0.038320064544677734 nb_pixel_total : 68285 time to create 1 rle with old method : 0.07506036758422852 time for calcul the mask position with numpy : 0.03869938850402832 nb_pixel_total : 15962 time to create 1 rle with old method : 0.01777172088623047 time for calcul the mask position with numpy : 0.03856992721557617 nb_pixel_total : 15819 time to create 1 rle with old method : 0.016968250274658203 time for calcul the mask position with numpy : 0.046013593673706055 nb_pixel_total : 657226 time to create 1 rle with new method : 0.7826521396636963 time for calcul the mask position with numpy : 0.038880348205566406 nb_pixel_total : 22991 time to create 1 rle with old method : 0.026108264923095703 time for calcul the mask position with numpy : 0.04025077819824219 nb_pixel_total : 25347 time to create 1 rle with old method : 0.028286457061767578 time for calcul the mask position with numpy : 0.039815425872802734 nb_pixel_total : 180232 time to create 1 rle with new method : 0.7836551666259766 time for calcul the mask position with numpy : 0.04071760177612305 nb_pixel_total : 48960 time to create 1 rle with old method : 0.07324361801147461 time for calcul the mask position with numpy : 0.042587995529174805 nb_pixel_total : 48723 time to create 1 rle with old method : 0.06958746910095215 time for calcul the mask position with numpy : 0.04540753364562988 nb_pixel_total : 110669 time to create 1 rle with old method : 0.1247105598449707 time for calcul the mask position with numpy : 0.039838552474975586 nb_pixel_total : 51302 time to create 1 rle with old method : 0.06112027168273926 time for calcul the mask position with numpy : 0.03942584991455078 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0017402172088623047 time for calcul the mask position with numpy : 0.04577755928039551 nb_pixel_total : 573513 time to create 1 rle with new method : 0.6772077083587646 time for calcul the mask position with numpy : 0.039153337478637695 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005929470062255859 time for calcul the mask position with numpy : 0.039743661880493164 nb_pixel_total : 14154 time to create 1 rle with old method : 0.01614522933959961 time for calcul the mask position with numpy : 0.04026675224304199 nb_pixel_total : 64123 time to create 1 rle with old method : 0.07120227813720703 time for calcul the mask position with numpy : 0.04342389106750488 nb_pixel_total : 477578 time to create 1 rle with new method : 1.0045342445373535 time for calcul the mask position with numpy : 0.03905177116394043 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.04050302505493164 nb_pixel_total : 31912 time to create 1 rle with old method : 0.0391077995300293 time for calcul the mask position with numpy : 0.04066205024719238 nb_pixel_total : 183178 time to create 1 rle with new method : 0.894963264465332 time for calcul the mask position with numpy : 0.0397186279296875 nb_pixel_total : 12708 time to create 1 rle with old method : 0.014402627944946289 time for calcul the mask position with numpy : 0.04059123992919922 nb_pixel_total : 77926 time to create 1 rle with old method : 0.09838271141052246 time for calcul the mask position with numpy : 0.046521902084350586 nb_pixel_total : 80971 time to create 1 rle with old method : 0.09053850173950195 time for calcul the mask position with numpy : 0.040077924728393555 nb_pixel_total : 49222 time to create 1 rle with old method : 0.055341482162475586 time for calcul the mask position with numpy : 0.04175734519958496 nb_pixel_total : 34392 time to create 1 rle with old method : 0.03764033317565918 create new chi : 17.515058279037476 time to delete rle : 0.0034716129302978516 batch 1 Loaded 61 chid ids of type : 4855 Number RLEs to save : 40205 TO DO : save crop sub photo not yet done ! save time : 2.4030380249023438 nb_obj : 101 nb_hashtags : 10 time to prepare the origin masks : 54.89373064041138 time for calcul the mask position with numpy : 0.3474764823913574 nb_pixel_total : 3323138 time to create 1 rle with new method : 1.0888135433197021 time for calcul the mask position with numpy : 0.03949904441833496 nb_pixel_total : 365 time to create 1 rle with old method : 0.0008697509765625 time for calcul the mask position with numpy : 0.043538570404052734 nb_pixel_total : 183196 time to create 1 rle with new method : 0.5698378086090088 time for calcul the mask position with numpy : 0.03987932205200195 nb_pixel_total : 4458 time to create 1 rle with old method : 0.005461215972900391 time for calcul the mask position with numpy : 0.041139841079711914 nb_pixel_total : 167158 time to create 1 rle with new method : 0.985468864440918 time for calcul the mask position with numpy : 0.04599809646606445 nb_pixel_total : 710202 time to create 1 rle with new method : 0.838538646697998 time for calcul the mask position with numpy : 0.04048633575439453 nb_pixel_total : 76989 time to create 1 rle with old method : 0.09811234474182129 time for calcul the mask position with numpy : 0.03926396369934082 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003597736358642578 time for calcul the mask position with numpy : 0.049799203872680664 nb_pixel_total : 639029 time to create 1 rle with new method : 0.7081968784332275 time for calcul the mask position with numpy : 0.042189836502075195 nb_pixel_total : 284874 time to create 1 rle with new method : 1.4080944061279297 time for calcul the mask position with numpy : 0.03945183753967285 nb_pixel_total : 13024 time to create 1 rle with old method : 0.014473438262939453 time for calcul the mask position with numpy : 0.03996753692626953 nb_pixel_total : 102065 time to create 1 rle with old method : 0.11006689071655273 time for calcul the mask position with numpy : 0.039020538330078125 nb_pixel_total : 9267 time to create 1 rle with old method : 0.01026773452758789 time for calcul the mask position with numpy : 0.03939533233642578 nb_pixel_total : 29419 time to create 1 rle with old method : 0.03207063674926758 time for calcul the mask position with numpy : 0.039682865142822266 nb_pixel_total : 40777 time to create 1 rle with old method : 0.04668092727661133 time for calcul the mask position with numpy : 0.03965044021606445 nb_pixel_total : 2892 time to create 1 rle with old method : 0.003540515899658203 time for calcul the mask position with numpy : 0.03903913497924805 nb_pixel_total : 4307 time to create 1 rle with old method : 0.004920244216918945 time for calcul the mask position with numpy : 0.03961038589477539 nb_pixel_total : 42738 time to create 1 rle with old method : 0.04935598373413086 time for calcul the mask position with numpy : 0.03969550132751465 nb_pixel_total : 40018 time to create 1 rle with old method : 0.043810367584228516 time for calcul the mask position with numpy : 0.043035030364990234 nb_pixel_total : 60597 time to create 1 rle with old method : 0.07134771347045898 time for calcul the mask position with numpy : 0.04088783264160156 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013148307800292969 time for calcul the mask position with numpy : 0.040047407150268555 nb_pixel_total : 53274 time to create 1 rle with old method : 0.058722734451293945 time for calcul the mask position with numpy : 0.04009056091308594 nb_pixel_total : 266 time to create 1 rle with old method : 0.0005102157592773438 time for calcul the mask position with numpy : 0.04027247428894043 nb_pixel_total : 210066 time to create 1 rle with new method : 0.6764302253723145 time for calcul the mask position with numpy : 0.03982353210449219 nb_pixel_total : 12713 time to create 1 rle with old method : 0.014041662216186523 time for calcul the mask position with numpy : 0.03998565673828125 nb_pixel_total : 48238 time to create 1 rle with old method : 0.05340433120727539 time for calcul the mask position with numpy : 0.040105581283569336 nb_pixel_total : 29162 time to create 1 rle with old method : 0.03242611885070801 time for calcul the mask position with numpy : 0.04001951217651367 nb_pixel_total : 81 time to create 1 rle with old method : 0.0002219676971435547 time for calcul the mask position with numpy : 0.04056715965270996 nb_pixel_total : 144468 time to create 1 rle with old method : 0.16030287742614746 time for calcul the mask position with numpy : 0.04003739356994629 nb_pixel_total : 52680 time to create 1 rle with old method : 0.05892205238342285 time for calcul the mask position with numpy : 0.04068922996520996 nb_pixel_total : 115810 time to create 1 rle with old method : 0.13972735404968262 time for calcul the mask position with numpy : 0.044208526611328125 nb_pixel_total : 12003 time to create 1 rle with old method : 0.015981197357177734 time for calcul the mask position with numpy : 0.04543042182922363 nb_pixel_total : 15028 time to create 1 rle with old method : 0.024752140045166016 time for calcul the mask position with numpy : 0.04337048530578613 nb_pixel_total : 874 time to create 1 rle with old method : 0.0013775825500488281 time for calcul the mask position with numpy : 0.04137277603149414 nb_pixel_total : 77377 time to create 1 rle with old method : 0.08625364303588867 time for calcul the mask position with numpy : 0.040251970291137695 nb_pixel_total : 46312 time to create 1 rle with old method : 0.05135774612426758 time for calcul the mask position with numpy : 0.04030919075012207 nb_pixel_total : 18200 time to create 1 rle with old method : 0.022364139556884766 time for calcul the mask position with numpy : 0.04033470153808594 nb_pixel_total : 20089 time to create 1 rle with old method : 0.022423505783081055 time for calcul the mask position with numpy : 0.041001081466674805 nb_pixel_total : 77861 time to create 1 rle with old method : 0.08532023429870605 time for calcul the mask position with numpy : 0.04028654098510742 nb_pixel_total : 40703 time to create 1 rle with old method : 0.04446840286254883 time for calcul the mask position with numpy : 0.03942751884460449 nb_pixel_total : 5050 time to create 1 rle with old method : 0.005909442901611328 time for calcul the mask position with numpy : 0.03981947898864746 nb_pixel_total : 5474 time to create 1 rle with old method : 0.006244659423828125 time for calcul the mask position with numpy : 0.041075944900512695 nb_pixel_total : 13946 time to create 1 rle with old method : 0.02215433120727539 time for calcul the mask position with numpy : 0.03967785835266113 nb_pixel_total : 28436 time to create 1 rle with old method : 0.036493778228759766 time for calcul the mask position with numpy : 0.04772043228149414 nb_pixel_total : 44981 time to create 1 rle with old method : 0.06693053245544434 time for calcul the mask position with numpy : 0.0398709774017334 nb_pixel_total : 52067 time to create 1 rle with old method : 0.058547258377075195 time for calcul the mask position with numpy : 0.03995227813720703 nb_pixel_total : 13007 time to create 1 rle with old method : 0.014608621597290039 time for calcul the mask position with numpy : 0.04099273681640625 nb_pixel_total : 58475 time to create 1 rle with old method : 0.06630897521972656 time for calcul the mask position with numpy : 0.041463613510131836 nb_pixel_total : 93446 time to create 1 rle with old method : 0.10403656959533691 time for calcul the mask position with numpy : 0.03987908363342285 nb_pixel_total : 30712 time to create 1 rle with old method : 0.03367209434509277 time for calcul the mask position with numpy : 0.04011416435241699 nb_pixel_total : 47706 time to create 1 rle with old method : 0.05304265022277832 time for calcul the mask position with numpy : 0.03959202766418457 nb_pixel_total : 13745 time to create 1 rle with old method : 0.015357732772827148 time for calcul the mask position with numpy : 0.040917158126831055 nb_pixel_total : 84142 time to create 1 rle with old method : 0.09440445899963379 time for calcul the mask position with numpy : 0.04058408737182617 nb_pixel_total : 22 time to create 1 rle with old method : 0.0004496574401855469 time for calcul the mask position with numpy : 0.04069685935974121 nb_pixel_total : 50031 time to create 1 rle with old method : 0.05539703369140625 time for calcul the mask position with numpy : 0.043503761291503906 nb_pixel_total : 45914 time to create 1 rle with old method : 0.050527095794677734 time for calcul the mask position with numpy : 0.03951096534729004 nb_pixel_total : 4418 time to create 1 rle with old method : 0.004994869232177734 time for calcul the mask position with numpy : 0.03978610038757324 nb_pixel_total : 10033 time to create 1 rle with old method : 0.011202335357666016 time for calcul the mask position with numpy : 0.040659427642822266 nb_pixel_total : 146662 time to create 1 rle with old method : 0.16180801391601562 time for calcul the mask position with numpy : 0.040456533432006836 nb_pixel_total : 21 time to create 1 rle with old method : 5.888938903808594e-05 time for calcul the mask position with numpy : 0.04064154624938965 nb_pixel_total : 25269 time to create 1 rle with old method : 0.02837395668029785 time for calcul the mask position with numpy : 0.039937496185302734 nb_pixel_total : 189 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.04041099548339844 nb_pixel_total : 89989 time to create 1 rle with old method : 0.1185007095336914 time for calcul the mask position with numpy : 0.04007720947265625 nb_pixel_total : 3987 time to create 1 rle with old method : 0.004784107208251953 time for calcul the mask position with numpy : 0.039566755294799805 nb_pixel_total : 7495 time to create 1 rle with old method : 0.009318828582763672 time for calcul the mask position with numpy : 0.04073309898376465 nb_pixel_total : 234181 time to create 1 rle with new method : 1.0252325534820557 time for calcul the mask position with numpy : 0.04030156135559082 nb_pixel_total : 4907 time to create 1 rle with old method : 0.005672454833984375 time for calcul the mask position with numpy : 0.04056906700134277 nb_pixel_total : 64419 time to create 1 rle with old method : 0.07205033302307129 time for calcul the mask position with numpy : 0.042043447494506836 nb_pixel_total : 367303 time to create 1 rle with new method : 0.9108340740203857 time for calcul the mask position with numpy : 0.04133152961730957 nb_pixel_total : 57442 time to create 1 rle with old method : 0.06348609924316406 time for calcul the mask position with numpy : 0.03949332237243652 nb_pixel_total : 7277 time to create 1 rle with old method : 0.008081436157226562 time for calcul the mask position with numpy : 0.04031705856323242 nb_pixel_total : 81082 time to create 1 rle with old method : 0.10413599014282227 time for calcul the mask position with numpy : 0.04575967788696289 nb_pixel_total : 18544 time to create 1 rle with old method : 0.023691892623901367 time for calcul the mask position with numpy : 0.040587425231933594 nb_pixel_total : 68549 time to create 1 rle with old method : 0.07603883743286133 time for calcul the mask position with numpy : 0.040442466735839844 nb_pixel_total : 145187 time to create 1 rle with old method : 0.1592414379119873 time for calcul the mask position with numpy : 0.039819955825805664 nb_pixel_total : 32295 time to create 1 rle with old method : 0.036284685134887695 time for calcul the mask position with numpy : 0.04000735282897949 nb_pixel_total : 9990 time to create 1 rle with old method : 0.011366128921508789 time for calcul the mask position with numpy : 0.03991508483886719 nb_pixel_total : 26791 time to create 1 rle with old method : 0.029980897903442383 time for calcul the mask position with numpy : 0.03959178924560547 nb_pixel_total : 15149 time to create 1 rle with old method : 0.01682448387145996 time for calcul the mask position with numpy : 0.0398859977722168 nb_pixel_total : 75115 time to create 1 rle with old method : 0.08296871185302734 time for calcul the mask position with numpy : 0.03978872299194336 nb_pixel_total : 6763 time to create 1 rle with old method : 0.009302616119384766 time for calcul the mask position with numpy : 0.03997373580932617 nb_pixel_total : 35193 time to create 1 rle with old method : 0.03944206237792969 time for calcul the mask position with numpy : 0.039954185485839844 nb_pixel_total : 3762 time to create 1 rle with old method : 0.0044939517974853516 time for calcul the mask position with numpy : 0.04011654853820801 nb_pixel_total : 16064 time to create 1 rle with old method : 0.01801466941833496 time for calcul the mask position with numpy : 0.040381431579589844 nb_pixel_total : 104650 time to create 1 rle with old method : 0.11924529075622559 time for calcul the mask position with numpy : 0.03908276557922363 nb_pixel_total : 15707 time to create 1 rle with old method : 0.019473791122436523 time for calcul the mask position with numpy : 0.0398099422454834 nb_pixel_total : 197844 time to create 1 rle with new method : 0.5581858158111572 time for calcul the mask position with numpy : 0.03979611396789551 nb_pixel_total : 1475 time to create 1 rle with old method : 0.0018384456634521484 time for calcul the mask position with numpy : 0.03880667686462402 nb_pixel_total : 28579 time to create 1 rle with old method : 0.03058147430419922 time for calcul the mask position with numpy : 0.03956437110900879 nb_pixel_total : 104160 time to create 1 rle with old method : 0.11463189125061035 time for calcul the mask position with numpy : 0.0396876335144043 nb_pixel_total : 47620 time to create 1 rle with old method : 0.05313515663146973 time for calcul the mask position with numpy : 0.04104208946228027 nb_pixel_total : 744 time to create 1 rle with old method : 0.0012409687042236328 time for calcul the mask position with numpy : 0.04160141944885254 nb_pixel_total : 97685 time to create 1 rle with old method : 0.13288569450378418 time for calcul the mask position with numpy : 0.04172515869140625 nb_pixel_total : 37663 time to create 1 rle with old method : 0.04194831848144531 time for calcul the mask position with numpy : 0.04044342041015625 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0016021728515625 time for calcul the mask position with numpy : 0.04037189483642578 nb_pixel_total : 38305 time to create 1 rle with old method : 0.04224729537963867 time for calcul the mask position with numpy : 0.04031229019165039 nb_pixel_total : 87396 time to create 1 rle with old method : 0.09577012062072754 time for calcul the mask position with numpy : 0.04319953918457031 nb_pixel_total : 43522 time to create 1 rle with old method : 0.04925537109375 time for calcul the mask position with numpy : 0.040247440338134766 nb_pixel_total : 44767 time to create 1 rle with old method : 0.050202131271362305 time for calcul the mask position with numpy : 0.040207624435424805 nb_pixel_total : 11606 time to create 1 rle with old method : 0.013227701187133789 time for calcul the mask position with numpy : 0.04009437561035156 nb_pixel_total : 3907 time to create 1 rle with old method : 0.0045893192291259766 time for calcul the mask position with numpy : 0.042478322982788086 nb_pixel_total : 564 time to create 1 rle with old method : 0.0012049674987792969 create new chi : 17.502941370010376 time to delete rle : 0.006672859191894531 batch 1 Loaded 102 chid ids of type : 4855 Number RLEs to save : 51736 TO DO : save crop sub photo not yet done ! save time : 3.1540260314941406 map_output_result : {1360028131: (0.49919552623072483, 'Should be the crop_list due to order', 0.3187861528199945), 1360028094: (0.49919552623072483, 'Should be the crop_list due to order', 0.5378815602236615), 1360027797: (0.49919552623072483, 'Should be the crop_list due to order', 0.7485322676762365), 1360027792: (0.49919552623072483, 'Should be the crop_list due to order', 0.391582124203007)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 4 /1360028131.Didn't retrieve data . /1360028094.Didn't retrieve data . /1360027797.Didn't retrieve data . /1360027792.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014086484909057617 save_final save missing photos in datou_result : time spend for datou_step_exec : 293.604656457901 time spend to save output : 0.015774250030517578 total time spend for step 5 : 293.6204307079315 step6:crop_condition Wed May 21 14:29:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 373 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3015255 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830583_2929779 we have uploaded 42 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.234651803970337 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3015255 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830612_2929779 we have uploaded 56 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.616374731063843 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3015255 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830633_2929779 we have uploaded 27 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.80837607383728 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3015255 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830648_2929779 we have uploaded 16 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.7666194438934326 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830654_2929779 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6653053760528564 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3015255 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830661_2929779 we have uploaded 21 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.9787139892578125 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830669_2929779 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.7232887744903564 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3015255 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830719_2929779 we have uploaded 56 photos in the portfolio 3015255 time of upload the photos Elapsed time : 23.622179746627808 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830744_2929779 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5328693389892578 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830747_2929779 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.927795648574829 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3015255 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747830793_2929779 we have uploaded 38 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.209902286529541 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 272 /1360038246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360038665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 820 time used for this insertion : 0.07542061805725098 save_final save missing photos in datou_result : time spend for datou_step_exec : 252.32581973075867 time spend to save output : 0.08128929138183594 total time spend for step 6 : 252.4071090221405 step7:ventilate_hashtags_in_portfolio Wed May 21 14:33:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23208872 get user id for portfolio 23208872 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23208872 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23208872 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23208872 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23208872 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/23210143,23210144,23210145,23210146,23210147,23210152,23210154,23210155,23210156,23210157,23210158,23210159,23210161,23210162,23210163,23210164,23210165,23210166,23210167,23210168?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=23208872 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 1 /23208872. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01269388198852539 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.242713689804077 time spend to save output : 0.01298379898071289 total time spend for step 7 : 4.25569748878479 step8:final Wed May 21 14:33:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360028131: ('0.5181579766979837',), 1360028094: ('0.5181579766979837',), 1360027797: ('0.5181579766979837',), 1360027792: ('0.5181579766979837',)} new output for save of step final : {1360028131: ('0.5181579766979837',), 1360028094: ('0.5181579766979837',), 1360027797: ('0.5181579766979837',), 1360027792: ('0.5181579766979837',)} [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 4 /1360028131.Didn't retrieve data . /1360028094.Didn't retrieve data . /1360027797.Didn't retrieve data . /1360027792.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012961387634277344 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11490130424499512 time spend to save output : 0.013264179229736328 total time spend for step 8 : 0.12816548347473145 step9:velours_tree Wed May 21 14:33:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.1535251140594482 time spend to save output : 4.0531158447265625e-05 total time spend for step 9 : 1.1535656452178955 step10:send_mail_cod Wed May 21 14:33:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23208872_21-05-2025_14_33_34.pdf 23210115 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101151747830814 23210116 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101161747830815 23210117 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101171747830817 23210118 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101181747830818 23210119 imagette232101191747830819 23210120 change filename to text .imagette232101201747830819 23210121 imagette232101211747830819 23210122 imagette232101221747830819 23210123 imagette232101231747830819 23210124 imagette232101241747830819 23210125 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101251747830819 23210126 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101261747830821 23210127 imagette232101271747830821 23210128 imagette232101281747830821 23210129 imagette232101291747830821 23210130 imagette232101301747830821 23210131 imagette232101311747830821 23210132 change filename to text .imagette232101321747830821 23210133 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101331747830821 23210135 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232101351747830822 23210136 imagette232101361747830823 23210137 imagette232101371747830823 23210138 imagette232101381747830823 23210139 imagette232101391747830823 23210140 imagette232101401747830823 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23208872 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23210143,23210144,23210145,23210146,23210147,23210152,23210154,23210155,23210156,23210157,23210158,23210159,23210161,23210162,23210163,23210164,23210165,23210166,23210167,23210168?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=23208872 your option no_mail is active, we will not send the real mail to your client args[1360028131] : ((1360028131, 1505.302889650059, 2107751945), (1360028131, -0.22935576716898456, 496442774), '0.5181579766979837') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360028094] : ((1360028094, 894.150128574819, 2107751945), (1360028094, -0.3387316927839259, 496442774), '0.5181579766979837') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360027797] : ((1360027797, 631.6927940479427, 492688767), (1360027797, -0.3607465953777008, 496442774), '0.5181579766979837') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1360027792] : ((1360027792, 2166.9592541614456, 492609224), (1360027792, -0.40814312859847157, 496442774), '0.5181579766979837') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5181579766979837 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23208872_21-05-2025_14_33_34.pdf results_Auto_P23208872_21-05-2025_14_33_34.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23208872_21-05-2025_14_33_34.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','23208872','results_Auto_P23208872_21-05-2025_14_33_34.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23208872_21-05-2025_14_33_34.pdf','pdf','','1.93','0.5181579766979837') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012661933898925781 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.242031812667847 time spend to save output : 0.012939929962158203 total time spend for step 10 : 12.254971742630005 step11:split_time_score Wed May 21 14:33:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21052025 23208872 Nombre de photos uploadées : 4 / 23040 (0%) 21052025 23208872 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 21052025 23208872 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00028228759765625 elapsed_time : insert_dashboard_record_day_entry 0.023718595504760742 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.5181579766979837 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23208872_21-05-2025_14_33_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23208872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23208872 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21052025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360028131, 1360028094, 1360027797, 1360027792] Looping around the photos to save general results len do output : 1 /23208872Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028131', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360028094', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027797', None, None, None, None, None, '2922449') ('4741', None, None, None, None, None, None, None, '2922449') ('4741', '23208872', '1360027792', None, None, None, None, None, '2922449') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012614250183105469 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.25014400482177734 time spend to save output : 0.012815475463867188 total time spend for step 11 : 0.26295948028564453 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 471.31user 196.56system 12:22.57elapsed 89%CPU (0avgtext+0avgdata 7074672maxresident)k 1142352inputs+437392outputs (12789major+36359531minor)pagefaults 0swaps