python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 219453 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2654459'] with mtr_portfolio_ids : ['21222677'] and first list_photo_ids : [] new path : /proc/219453/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.7721636295318604 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 10 19:21:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4860 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 19:21:36.075943: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 19:21:36.103161: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 19:21:36.105671: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6ee4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 19:21:36.105709: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 19:21:36.110585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 19:21:36.287121: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x39756050 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 19:21:36.287200: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 19:21:36.287972: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:21:36.288363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:21:36.291691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:21:36.294422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:21:36.294873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:21:36.299002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:21:36.300644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:21:36.306583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:21:36.308081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:21:36.308237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:21:36.308961: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 19:21:36.308982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 19:21:36.308991: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 19:21:36.310155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4408 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 19:21:36.797556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:21:36.797650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:21:36.797671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:21:36.797690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:21:36.797708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:21:36.797726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:21:36.797744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:21:36.797762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:21:36.798995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:21:36.800203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:21:36.800254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:21:36.800269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:21:36.800284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:21:36.800311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:21:36.800325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:21:36.800339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:21:36.800354: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:21:36.801296: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:21:36.801327: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 19:21:36.801335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 19:21:36.801343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 19:21:36.802368: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4408 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 19:21:50.411482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:21:50.694843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:21:52.611077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.81G (4087218176 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 220029 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 157 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4860 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.004281282424926758 nb_pixel_total : 158922 time to create 1 rle with new method : 0.011256933212280273 length of segment : 454 time for calcul the mask position with numpy : 0.004667758941650391 nb_pixel_total : 205336 time to create 1 rle with new method : 0.015933990478515625 length of segment : 503 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 26304 time to create 1 rle with old method : 0.03672432899475098 length of segment : 185 time for calcul the mask position with numpy : 0.0005025863647460938 nb_pixel_total : 27407 time to create 1 rle with old method : 0.032506465911865234 length of segment : 151 time for calcul the mask position with numpy : 0.0005474090576171875 nb_pixel_total : 18987 time to create 1 rle with old method : 0.022466659545898438 length of segment : 200 time for calcul the mask position with numpy : 0.0017476081848144531 nb_pixel_total : 90365 time to create 1 rle with old method : 0.10643243789672852 length of segment : 392 time for calcul the mask position with numpy : 0.0038394927978515625 nb_pixel_total : 270857 time to create 1 rle with new method : 0.016852855682373047 length of segment : 1152 time for calcul the mask position with numpy : 0.0012137889862060547 nb_pixel_total : 40571 time to create 1 rle with old method : 0.050020456314086914 length of segment : 227 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 10206 time to create 1 rle with old method : 0.01274561882019043 length of segment : 113 time for calcul the mask position with numpy : 0.000530242919921875 nb_pixel_total : 24197 time to create 1 rle with old method : 0.027602195739746094 length of segment : 287 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 4119 time to create 1 rle with old method : 0.00723576545715332 length of segment : 158 time for calcul the mask position with numpy : 0.0009744167327880859 nb_pixel_total : 40408 time to create 1 rle with old method : 0.050750732421875 length of segment : 257 time for calcul the mask position with numpy : 0.0011477470397949219 nb_pixel_total : 67007 time to create 1 rle with old method : 0.07666540145874023 length of segment : 220 time for calcul the mask position with numpy : 0.0007061958312988281 nb_pixel_total : 46017 time to create 1 rle with old method : 0.054704904556274414 length of segment : 349 time for calcul the mask position with numpy : 0.0007560253143310547 nb_pixel_total : 46549 time to create 1 rle with old method : 0.052490949630737305 length of segment : 280 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 33227 time to create 1 rle with old method : 0.03993415832519531 length of segment : 259 time for calcul the mask position with numpy : 0.0007584095001220703 nb_pixel_total : 54915 time to create 1 rle with old method : 0.06578564643859863 length of segment : 218 time for calcul the mask position with numpy : 0.0007443428039550781 nb_pixel_total : 43739 time to create 1 rle with old method : 0.050728797912597656 length of segment : 277 time for calcul the mask position with numpy : 0.0005280971527099609 nb_pixel_total : 31812 time to create 1 rle with old method : 0.04544997215270996 length of segment : 159 time for calcul the mask position with numpy : 0.0015463829040527344 nb_pixel_total : 70049 time to create 1 rle with old method : 0.0857396125793457 length of segment : 444 time for calcul the mask position with numpy : 0.002594470977783203 nb_pixel_total : 137703 time to create 1 rle with old method : 0.16040253639221191 length of segment : 457 time for calcul the mask position with numpy : 0.0005166530609130859 nb_pixel_total : 21610 time to create 1 rle with old method : 0.02693653106689453 length of segment : 140 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 28369 time to create 1 rle with old method : 0.03249049186706543 length of segment : 214 time for calcul the mask position with numpy : 0.013994693756103516 nb_pixel_total : 412611 time to create 1 rle with new method : 0.06168675422668457 length of segment : 925 time for calcul the mask position with numpy : 0.0006048679351806641 nb_pixel_total : 21204 time to create 1 rle with old method : 0.02463674545288086 length of segment : 313 time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 28903 time to create 1 rle with old method : 0.0330960750579834 length of segment : 111 time for calcul the mask position with numpy : 0.0022993087768554688 nb_pixel_total : 152452 time to create 1 rle with new method : 0.0067369937896728516 length of segment : 646 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 28694 time to create 1 rle with old method : 0.032581329345703125 length of segment : 238 time for calcul the mask position with numpy : 0.0005021095275878906 nb_pixel_total : 28741 time to create 1 rle with old method : 0.041800498962402344 length of segment : 230 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 2627 time to create 1 rle with old method : 0.003537416458129883 length of segment : 107 time for calcul the mask position with numpy : 0.002463102340698242 nb_pixel_total : 153658 time to create 1 rle with new method : 0.007206439971923828 length of segment : 749 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 18050 time to create 1 rle with old method : 0.02128005027770996 length of segment : 132 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 22333 time to create 1 rle with old method : 0.025974035263061523 length of segment : 117 time for calcul the mask position with numpy : 0.0009245872497558594 nb_pixel_total : 54428 time to create 1 rle with old method : 0.06084609031677246 length of segment : 552 time for calcul the mask position with numpy : 0.002750873565673828 nb_pixel_total : 93523 time to create 1 rle with old method : 0.10899877548217773 length of segment : 391 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 24413 time to create 1 rle with old method : 0.0277249813079834 length of segment : 242 time for calcul the mask position with numpy : 0.0022559165954589844 nb_pixel_total : 32661 time to create 1 rle with old method : 0.03880143165588379 length of segment : 545 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 18802 time to create 1 rle with old method : 0.021785974502563477 length of segment : 206 time for calcul the mask position with numpy : 0.0006062984466552734 nb_pixel_total : 6725 time to create 1 rle with old method : 0.008277416229248047 length of segment : 90 time for calcul the mask position with numpy : 0.003183603286743164 nb_pixel_total : 100850 time to create 1 rle with old method : 0.12020373344421387 length of segment : 477 time for calcul the mask position with numpy : 0.0009486675262451172 nb_pixel_total : 12233 time to create 1 rle with old method : 0.01502847671508789 length of segment : 280 time for calcul the mask position with numpy : 0.0010998249053955078 nb_pixel_total : 19547 time to create 1 rle with old method : 0.022849559783935547 length of segment : 207 time for calcul the mask position with numpy : 0.0046346187591552734 nb_pixel_total : 157064 time to create 1 rle with new method : 0.008552074432373047 length of segment : 345 time for calcul the mask position with numpy : 0.0015416145324707031 nb_pixel_total : 38954 time to create 1 rle with old method : 0.045458078384399414 length of segment : 246 time for calcul the mask position with numpy : 0.0007169246673583984 nb_pixel_total : 14156 time to create 1 rle with old method : 0.01752781867980957 length of segment : 194 time for calcul the mask position with numpy : 0.0013914108276367188 nb_pixel_total : 36682 time to create 1 rle with old method : 0.0537877082824707 length of segment : 238 time for calcul the mask position with numpy : 0.004256248474121094 nb_pixel_total : 94293 time to create 1 rle with old method : 0.10467052459716797 length of segment : 454 time for calcul the mask position with numpy : 0.004888772964477539 nb_pixel_total : 106333 time to create 1 rle with old method : 0.11988639831542969 length of segment : 572 time for calcul the mask position with numpy : 0.006539583206176758 nb_pixel_total : 222938 time to create 1 rle with new method : 0.01511073112487793 length of segment : 569 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 32104 time to create 1 rle with old method : 0.03701901435852051 length of segment : 289 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 24077 time to create 1 rle with old method : 0.027623414993286133 length of segment : 218 time for calcul the mask position with numpy : 0.002619504928588867 nb_pixel_total : 81699 time to create 1 rle with old method : 0.09045767784118652 length of segment : 428 time for calcul the mask position with numpy : 0.0028085708618164062 nb_pixel_total : 47166 time to create 1 rle with old method : 0.07986688613891602 length of segment : 345 time for calcul the mask position with numpy : 0.0027861595153808594 nb_pixel_total : 109540 time to create 1 rle with old method : 0.17417526245117188 length of segment : 554 time for calcul the mask position with numpy : 0.0011105537414550781 nb_pixel_total : 30682 time to create 1 rle with old method : 0.034914255142211914 length of segment : 229 time for calcul the mask position with numpy : 0.39992618560791016 nb_pixel_total : 543286 time to create 1 rle with new method : 0.3520369529724121 length of segment : 992 time for calcul the mask position with numpy : 0.0029861927032470703 nb_pixel_total : 148589 time to create 1 rle with old method : 0.17267394065856934 length of segment : 503 time for calcul the mask position with numpy : 0.0009415149688720703 nb_pixel_total : 22729 time to create 1 rle with old method : 0.026294946670532227 length of segment : 289 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 3243 time to create 1 rle with old method : 0.0039081573486328125 length of segment : 68 time for calcul the mask position with numpy : 0.0005154609680175781 nb_pixel_total : 22613 time to create 1 rle with old method : 0.026895999908447266 length of segment : 146 time for calcul the mask position with numpy : 0.001001119613647461 nb_pixel_total : 34043 time to create 1 rle with old method : 0.043016672134399414 length of segment : 301 time for calcul the mask position with numpy : 0.0015902519226074219 nb_pixel_total : 16412 time to create 1 rle with old method : 0.027111530303955078 length of segment : 335 time for calcul the mask position with numpy : 0.004290103912353516 nb_pixel_total : 239535 time to create 1 rle with new method : 0.007266998291015625 length of segment : 636 time for calcul the mask position with numpy : 0.0025353431701660156 nb_pixel_total : 97361 time to create 1 rle with old method : 0.15024447441101074 length of segment : 282 time for calcul the mask position with numpy : 0.001720428466796875 nb_pixel_total : 65216 time to create 1 rle with old method : 0.09661245346069336 length of segment : 411 time for calcul the mask position with numpy : 0.0006401538848876953 nb_pixel_total : 20986 time to create 1 rle with old method : 0.024869918823242188 length of segment : 146 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 13805 time to create 1 rle with old method : 0.015575885772705078 length of segment : 199 time for calcul the mask position with numpy : 0.0010480880737304688 nb_pixel_total : 25183 time to create 1 rle with old method : 0.0295867919921875 length of segment : 326 time for calcul the mask position with numpy : 0.0021142959594726562 nb_pixel_total : 73355 time to create 1 rle with old method : 0.08524394035339355 length of segment : 341 time for calcul the mask position with numpy : 0.0018329620361328125 nb_pixel_total : 122265 time to create 1 rle with old method : 0.14575433731079102 length of segment : 485 time for calcul the mask position with numpy : 0.0013623237609863281 nb_pixel_total : 21405 time to create 1 rle with old method : 0.02551102638244629 length of segment : 389 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 23056 time to create 1 rle with old method : 0.026748180389404297 length of segment : 262 time for calcul the mask position with numpy : 0.0038106441497802734 nb_pixel_total : 143616 time to create 1 rle with old method : 0.16069316864013672 length of segment : 992 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 13617 time to create 1 rle with old method : 0.015820026397705078 length of segment : 160 time for calcul the mask position with numpy : 0.0013072490692138672 nb_pixel_total : 45393 time to create 1 rle with old method : 0.05150270462036133 length of segment : 300 time for calcul the mask position with numpy : 0.002231597900390625 nb_pixel_total : 59816 time to create 1 rle with old method : 0.06998825073242188 length of segment : 310 time for calcul the mask position with numpy : 0.0008919239044189453 nb_pixel_total : 43189 time to create 1 rle with old method : 0.050852298736572266 length of segment : 298 time for calcul the mask position with numpy : 0.0007083415985107422 nb_pixel_total : 20564 time to create 1 rle with old method : 0.023537158966064453 length of segment : 184 time for calcul the mask position with numpy : 0.0017192363739013672 nb_pixel_total : 21894 time to create 1 rle with old method : 0.02706122398376465 length of segment : 177 time for calcul the mask position with numpy : 0.0002961158752441406 nb_pixel_total : 6170 time to create 1 rle with old method : 0.0076503753662109375 length of segment : 118 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 33151 time to create 1 rle with old method : 0.03938007354736328 length of segment : 228 time for calcul the mask position with numpy : 0.6078455448150635 nb_pixel_total : 4944756 time to create 1 rle with new method : 0.6849346160888672 length of segment : 3648 time for calcul the mask position with numpy : 0.10927033424377441 nb_pixel_total : 2482450 time to create 1 rle with new method : 0.614506721496582 length of segment : 2024 time for calcul the mask position with numpy : 0.007587909698486328 nb_pixel_total : 377727 time to create 1 rle with new method : 0.016241073608398438 length of segment : 760 time for calcul the mask position with numpy : 0.8312432765960693 nb_pixel_total : 4333553 time to create 1 rle with new method : 0.7709574699401855 length of segment : 1742 time for calcul the mask position with numpy : 0.0022253990173339844 nb_pixel_total : 82757 time to create 1 rle with old method : 0.09463334083557129 length of segment : 352 time spent for convertir_results : 17.674236536026 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 86 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 76.64346432685852 time spend to save output : 0.4573347568511963 total time spend for step 1 : 77.10079908370972 step2:mask_detect Mon Mar 10 19:22:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4860 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 19:22:54.110833: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 19:22:54.143150: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 19:22:54.145706: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6ec4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 19:22:54.145757: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 19:22:54.160056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 19:22:54.308432: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3a6762e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 19:22:54.308497: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 19:22:54.309950: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:22:54.310490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:22:54.313334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:22:54.331570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:22:54.332165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:22:54.357403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:22:54.361886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:22:54.420046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:22:54.421610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:22:54.422158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:22:54.422970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 19:22:54.422995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 19:22:54.423007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 19:22:54.424820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4187 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 19:22:54.746755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:22:54.746941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:22:54.746984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:22:54.747015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:22:54.747043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:22:54.747071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:22:54.747112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:22:54.747140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:22:54.748403: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:22:54.749752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 19:22:54.749827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 19:22:54.749855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:22:54.749879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 19:22:54.749902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 19:22:54.749926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 19:22:54.749948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 19:22:54.749972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:22:54.751226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 19:22:54.751277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 19:22:54.751290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 19:22:54.751301: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 19:22:54.752610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4187 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 19:23:07.427590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 19:23:07.622022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 19:23:10.140846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:10.980377: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-10 19:23:11.064181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.064246: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.065450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.065480: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.072743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.072790: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.073445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.073462: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.095250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.095394: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.095420: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-10 19:23:11.096764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.096884: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.100857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.100919: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.108525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.108588: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.109682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.109706: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.110789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.110811: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 19:23:11.111920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.120737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.121807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.145365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.146071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.146741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.147440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.151868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.152700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.153513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.154329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.155827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.169342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.172169: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.182349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.183368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.184150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.187478: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.188200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 19:23:11.188860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.59G (3855482880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 80 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 63 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 225346 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8735 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10370 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.029074907302856445 nb_pixel_total : 71957 time to create 1 rle with old method : 0.11932992935180664 length of segment : 365 time for calcul the mask position with numpy : 0.007999420166015625 nb_pixel_total : 47185 time to create 1 rle with old method : 0.07100272178649902 length of segment : 314 time for calcul the mask position with numpy : 0.08669137954711914 nb_pixel_total : 64213 time to create 1 rle with old method : 0.10033035278320312 length of segment : 337 time for calcul the mask position with numpy : 0.0779106616973877 nb_pixel_total : 52753 time to create 1 rle with old method : 0.12363386154174805 length of segment : 221 time for calcul the mask position with numpy : 0.0809476375579834 nb_pixel_total : 21812 time to create 1 rle with old method : 0.04068446159362793 length of segment : 193 time for calcul the mask position with numpy : 0.19732046127319336 nb_pixel_total : 112029 time to create 1 rle with old method : 0.1327042579650879 length of segment : 572 time for calcul the mask position with numpy : 0.9512755870819092 nb_pixel_total : 1506944 time to create 1 rle with new method : 0.2326207160949707 length of segment : 1035 time for calcul the mask position with numpy : 0.22300171852111816 nb_pixel_total : 144330 time to create 1 rle with old method : 0.1715226173400879 length of segment : 528 time for calcul the mask position with numpy : 0.10187125205993652 nb_pixel_total : 63849 time to create 1 rle with old method : 0.08122444152832031 length of segment : 310 time for calcul the mask position with numpy : 0.2199397087097168 nb_pixel_total : 180756 time to create 1 rle with new method : 0.010700702667236328 length of segment : 484 time for calcul the mask position with numpy : 0.4860348701477051 nb_pixel_total : 228128 time to create 1 rle with new method : 0.020743131637573242 length of segment : 874 time for calcul the mask position with numpy : 0.4931490421295166 nb_pixel_total : 285685 time to create 1 rle with new method : 0.01923060417175293 length of segment : 751 time for calcul the mask position with numpy : 0.2109510898590088 nb_pixel_total : 266568 time to create 1 rle with new method : 0.014367341995239258 length of segment : 517 time for calcul the mask position with numpy : 0.0009870529174804688 nb_pixel_total : 50521 time to create 1 rle with old method : 0.05810403823852539 length of segment : 374 time for calcul the mask position with numpy : 0.07989931106567383 nb_pixel_total : 12443 time to create 1 rle with old method : 0.01908421516418457 length of segment : 97 time for calcul the mask position with numpy : 0.003794431686401367 nb_pixel_total : 172278 time to create 1 rle with new method : 0.011237144470214844 length of segment : 539 time for calcul the mask position with numpy : 0.06371283531188965 nb_pixel_total : 79910 time to create 1 rle with old method : 0.09424042701721191 length of segment : 328 time for calcul the mask position with numpy : 0.25756263732910156 nb_pixel_total : 768708 time to create 1 rle with new method : 0.1443173885345459 length of segment : 836 time for calcul the mask position with numpy : 0.04989504814147949 nb_pixel_total : 126048 time to create 1 rle with old method : 0.15387725830078125 length of segment : 516 time for calcul the mask position with numpy : 1.745488166809082 nb_pixel_total : 1361933 time to create 1 rle with new method : 0.12560606002807617 length of segment : 2108 time for calcul the mask position with numpy : 0.0013456344604492188 nb_pixel_total : 27726 time to create 1 rle with old method : 0.03381848335266113 length of segment : 207 time for calcul the mask position with numpy : 0.0020079612731933594 nb_pixel_total : 46692 time to create 1 rle with old method : 0.051947832107543945 length of segment : 238 time for calcul the mask position with numpy : 0.03172469139099121 nb_pixel_total : 58779 time to create 1 rle with old method : 0.06553339958190918 length of segment : 293 time for calcul the mask position with numpy : 0.23160004615783691 nb_pixel_total : 642365 time to create 1 rle with new method : 0.9347736835479736 length of segment : 1201 time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 12716 time to create 1 rle with old method : 0.01504373550415039 length of segment : 141 time for calcul the mask position with numpy : 0.01711869239807129 nb_pixel_total : 93107 time to create 1 rle with old method : 0.1093130111694336 length of segment : 306 time for calcul the mask position with numpy : 0.2858419418334961 nb_pixel_total : 1022778 time to create 1 rle with new method : 0.1942286491394043 length of segment : 1704 time for calcul the mask position with numpy : 0.06404566764831543 nb_pixel_total : 111227 time to create 1 rle with old method : 0.1267697811126709 length of segment : 662 time for calcul the mask position with numpy : 0.085693359375 nb_pixel_total : 545464 time to create 1 rle with new method : 0.06693696975708008 length of segment : 1026 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 10085 time to create 1 rle with old method : 0.011992931365966797 length of segment : 167 time for calcul the mask position with numpy : 0.002501964569091797 nb_pixel_total : 125753 time to create 1 rle with old method : 0.14715313911437988 length of segment : 742 time for calcul the mask position with numpy : 0.0009353160858154297 nb_pixel_total : 36322 time to create 1 rle with old method : 0.04243922233581543 length of segment : 285 time for calcul the mask position with numpy : 0.022641897201538086 nb_pixel_total : 98656 time to create 1 rle with old method : 0.11670804023742676 length of segment : 330 time for calcul the mask position with numpy : 0.0010805130004882812 nb_pixel_total : 42596 time to create 1 rle with old method : 0.04979825019836426 length of segment : 274 time for calcul the mask position with numpy : 0.0014798641204833984 nb_pixel_total : 41927 time to create 1 rle with old method : 0.04808330535888672 length of segment : 435 time for calcul the mask position with numpy : 0.012379646301269531 nb_pixel_total : 356983 time to create 1 rle with new method : 0.02814960479736328 length of segment : 1300 time for calcul the mask position with numpy : 0.09119057655334473 nb_pixel_total : 100379 time to create 1 rle with old method : 0.12118816375732422 length of segment : 408 time for calcul the mask position with numpy : 0.003415822982788086 nb_pixel_total : 90975 time to create 1 rle with old method : 0.10525369644165039 length of segment : 396 time for calcul the mask position with numpy : 0.04794192314147949 nb_pixel_total : 118546 time to create 1 rle with old method : 0.13356447219848633 length of segment : 294 time for calcul the mask position with numpy : 0.004845619201660156 nb_pixel_total : 244943 time to create 1 rle with new method : 0.013106107711791992 length of segment : 756 time for calcul the mask position with numpy : 0.004612445831298828 nb_pixel_total : 17088 time to create 1 rle with old method : 0.026920795440673828 length of segment : 98 time for calcul the mask position with numpy : 0.0039293766021728516 nb_pixel_total : 222773 time to create 1 rle with new method : 0.010921716690063477 length of segment : 719 time for calcul the mask position with numpy : 0.011629343032836914 nb_pixel_total : 49707 time to create 1 rle with old method : 0.06619834899902344 length of segment : 144 time for calcul the mask position with numpy : 0.0012400150299072266 nb_pixel_total : 34291 time to create 1 rle with old method : 0.04837822914123535 length of segment : 231 time for calcul the mask position with numpy : 0.00457310676574707 nb_pixel_total : 158834 time to create 1 rle with new method : 0.01537775993347168 length of segment : 520 time for calcul the mask position with numpy : 0.001149892807006836 nb_pixel_total : 58317 time to create 1 rle with old method : 0.06843709945678711 length of segment : 327 time for calcul the mask position with numpy : 0.003116607666015625 nb_pixel_total : 125623 time to create 1 rle with old method : 0.14152884483337402 length of segment : 586 time for calcul the mask position with numpy : 0.002305746078491211 nb_pixel_total : 95843 time to create 1 rle with old method : 0.10916280746459961 length of segment : 385 time for calcul the mask position with numpy : 0.02402782440185547 nb_pixel_total : 1315039 time to create 1 rle with new method : 0.22670269012451172 length of segment : 2058 time for calcul the mask position with numpy : 0.002043485641479492 nb_pixel_total : 93215 time to create 1 rle with old method : 0.10402131080627441 length of segment : 468 time for calcul the mask position with numpy : 0.6679239273071289 nb_pixel_total : 1399430 time to create 1 rle with new method : 0.12077069282531738 length of segment : 1341 time for calcul the mask position with numpy : 0.002875089645385742 nb_pixel_total : 51681 time to create 1 rle with old method : 0.05749058723449707 length of segment : 328 time for calcul the mask position with numpy : 0.02075791358947754 nb_pixel_total : 249380 time to create 1 rle with new method : 0.01748824119567871 length of segment : 457 time for calcul the mask position with numpy : 0.07637786865234375 nb_pixel_total : 549338 time to create 1 rle with new method : 0.22096776962280273 length of segment : 1161 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 43706 time to create 1 rle with old method : 0.04921746253967285 length of segment : 275 time for calcul the mask position with numpy : 0.006173610687255859 nb_pixel_total : 140442 time to create 1 rle with old method : 0.16069531440734863 length of segment : 474 time for calcul the mask position with numpy : 0.013041019439697266 nb_pixel_total : 147377 time to create 1 rle with old method : 0.18894052505493164 length of segment : 524 time for calcul the mask position with numpy : 0.04732060432434082 nb_pixel_total : 536011 time to create 1 rle with new method : 0.057466983795166016 length of segment : 863 time for calcul the mask position with numpy : 0.04595685005187988 nb_pixel_total : 40988 time to create 1 rle with old method : 0.05102205276489258 length of segment : 476 time for calcul the mask position with numpy : 0.0027620792388916016 nb_pixel_total : 68414 time to create 1 rle with old method : 0.10487532615661621 length of segment : 303 time for calcul the mask position with numpy : 0.02199101448059082 nb_pixel_total : 291722 time to create 1 rle with new method : 0.026853322982788086 length of segment : 843 time for calcul the mask position with numpy : 0.0038390159606933594 nb_pixel_total : 32452 time to create 1 rle with old method : 0.039348602294921875 length of segment : 332 time for calcul the mask position with numpy : 0.009947776794433594 nb_pixel_total : 91622 time to create 1 rle with old method : 0.11955571174621582 length of segment : 528 time for calcul the mask position with numpy : 0.02186131477355957 nb_pixel_total : 333175 time to create 1 rle with new method : 0.024412155151367188 length of segment : 902 time for calcul the mask position with numpy : 0.01039576530456543 nb_pixel_total : 245618 time to create 1 rle with new method : 0.021051883697509766 length of segment : 864 time for calcul the mask position with numpy : 0.003864765167236328 nb_pixel_total : 61270 time to create 1 rle with old method : 0.10623908042907715 length of segment : 275 time for calcul the mask position with numpy : 0.12973618507385254 nb_pixel_total : 392649 time to create 1 rle with new method : 0.033727169036865234 length of segment : 1093 time for calcul the mask position with numpy : 0.0064013004302978516 nb_pixel_total : 278109 time to create 1 rle with new method : 0.02473306655883789 length of segment : 832 time for calcul the mask position with numpy : 0.00165557861328125 nb_pixel_total : 45378 time to create 1 rle with old method : 0.0740194320678711 length of segment : 280 time for calcul the mask position with numpy : 0.02162957191467285 nb_pixel_total : 389330 time to create 1 rle with new method : 0.0613710880279541 length of segment : 1060 time for calcul the mask position with numpy : 0.010742902755737305 nb_pixel_total : 158241 time to create 1 rle with new method : 0.012008190155029297 length of segment : 607 time for calcul the mask position with numpy : 0.01766514778137207 nb_pixel_total : 32049 time to create 1 rle with old method : 0.04912710189819336 length of segment : 247 time for calcul the mask position with numpy : 0.004536151885986328 nb_pixel_total : 191811 time to create 1 rle with new method : 0.01200246810913086 length of segment : 851 time for calcul the mask position with numpy : 0.0034012794494628906 nb_pixel_total : 78045 time to create 1 rle with old method : 0.08985757827758789 length of segment : 467 time for calcul the mask position with numpy : 0.001760721206665039 nb_pixel_total : 63230 time to create 1 rle with old method : 0.06969666481018066 length of segment : 352 time for calcul the mask position with numpy : 0.07182717323303223 nb_pixel_total : 556482 time to create 1 rle with new method : 0.040086984634399414 length of segment : 1012 time for calcul the mask position with numpy : 0.004441976547241211 nb_pixel_total : 37215 time to create 1 rle with old method : 0.052445173263549805 length of segment : 180 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 23803 time to create 1 rle with old method : 0.028307437896728516 length of segment : 164 time for calcul the mask position with numpy : 0.0030241012573242188 nb_pixel_total : 74474 time to create 1 rle with old method : 0.08452749252319336 length of segment : 338 time for calcul the mask position with numpy : 0.0055692195892333984 nb_pixel_total : 118412 time to create 1 rle with old method : 0.13366270065307617 length of segment : 358 time for calcul the mask position with numpy : 0.02469921112060547 nb_pixel_total : 568070 time to create 1 rle with new method : 0.12403106689453125 length of segment : 1027 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 9630 time to create 1 rle with old method : 0.011551856994628906 length of segment : 93 time for calcul the mask position with numpy : 0.0010576248168945312 nb_pixel_total : 47292 time to create 1 rle with old method : 0.057031869888305664 length of segment : 201 time for calcul the mask position with numpy : 0.0031642913818359375 nb_pixel_total : 151015 time to create 1 rle with new method : 0.010235309600830078 length of segment : 637 time for calcul the mask position with numpy : 0.009043455123901367 nb_pixel_total : 309407 time to create 1 rle with new method : 0.06343770027160645 length of segment : 1324 time for calcul the mask position with numpy : 0.0018377304077148438 nb_pixel_total : 86462 time to create 1 rle with old method : 0.09792900085449219 length of segment : 452 time for calcul the mask position with numpy : 0.001972198486328125 nb_pixel_total : 49245 time to create 1 rle with old method : 0.06071591377258301 length of segment : 252 time for calcul the mask position with numpy : 0.003384828567504883 nb_pixel_total : 151908 time to create 1 rle with new method : 0.010377645492553711 length of segment : 530 time for calcul the mask position with numpy : 0.0009467601776123047 nb_pixel_total : 29819 time to create 1 rle with old method : 0.04211688041687012 length of segment : 292 time for calcul the mask position with numpy : 0.003919839859008789 nb_pixel_total : 194563 time to create 1 rle with new method : 0.013057231903076172 length of segment : 706 time for calcul the mask position with numpy : 0.01036691665649414 nb_pixel_total : 242865 time to create 1 rle with new method : 0.06411862373352051 length of segment : 679 time for calcul the mask position with numpy : 0.004214048385620117 nb_pixel_total : 163986 time to create 1 rle with new method : 0.013069629669189453 length of segment : 715 time for calcul the mask position with numpy : 0.007119894027709961 nb_pixel_total : 304479 time to create 1 rle with new method : 0.02207779884338379 length of segment : 952 time for calcul the mask position with numpy : 0.0036668777465820312 nb_pixel_total : 102032 time to create 1 rle with old method : 0.11573362350463867 length of segment : 628 time for calcul the mask position with numpy : 0.013333797454833984 nb_pixel_total : 602584 time to create 1 rle with new method : 0.07875895500183105 length of segment : 1044 time for calcul the mask position with numpy : 0.008415699005126953 nb_pixel_total : 315216 time to create 1 rle with new method : 0.023619890213012695 length of segment : 1354 time for calcul the mask position with numpy : 0.001990079879760742 nb_pixel_total : 72251 time to create 1 rle with old method : 0.08158278465270996 length of segment : 428 time for calcul the mask position with numpy : 0.19031763076782227 nb_pixel_total : 627628 time to create 1 rle with new method : 0.029593944549560547 length of segment : 891 time for calcul the mask position with numpy : 0.01629185676574707 nb_pixel_total : 133101 time to create 1 rle with old method : 0.1798102855682373 length of segment : 482 time for calcul the mask position with numpy : 0.15362834930419922 nb_pixel_total : 256871 time to create 1 rle with new method : 0.011861085891723633 length of segment : 625 time for calcul the mask position with numpy : 0.16253161430358887 nb_pixel_total : 1924293 time to create 1 rle with new method : 0.6409039497375488 length of segment : 1527 time for calcul the mask position with numpy : 0.005106210708618164 nb_pixel_total : 153852 time to create 1 rle with new method : 0.009937286376953125 length of segment : 597 time for calcul the mask position with numpy : 0.0030961036682128906 nb_pixel_total : 109011 time to create 1 rle with old method : 0.12340617179870605 length of segment : 357 time for calcul the mask position with numpy : 0.0019297599792480469 nb_pixel_total : 101956 time to create 1 rle with old method : 0.11721062660217285 length of segment : 321 time for calcul the mask position with numpy : 0.021454572677612305 nb_pixel_total : 337801 time to create 1 rle with new method : 0.020711183547973633 length of segment : 1044 time for calcul the mask position with numpy : 0.5994453430175781 nb_pixel_total : 1121741 time to create 1 rle with new method : 0.12312459945678711 length of segment : 783 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 33824 time to create 1 rle with old method : 0.05388474464416504 length of segment : 223 time for calcul the mask position with numpy : 0.005867958068847656 nb_pixel_total : 26319 time to create 1 rle with old method : 0.030597686767578125 length of segment : 139 time for calcul the mask position with numpy : 0.0012726783752441406 nb_pixel_total : 68341 time to create 1 rle with old method : 0.08394670486450195 length of segment : 340 time for calcul the mask position with numpy : 0.004305362701416016 nb_pixel_total : 107997 time to create 1 rle with old method : 0.12170910835266113 length of segment : 317 time for calcul the mask position with numpy : 0.10940051078796387 nb_pixel_total : 280106 time to create 1 rle with new method : 0.022049427032470703 length of segment : 599 time for calcul the mask position with numpy : 0.021478652954101562 nb_pixel_total : 134559 time to create 1 rle with old method : 0.25033116340637207 length of segment : 387 time for calcul the mask position with numpy : 0.00850224494934082 nb_pixel_total : 74102 time to create 1 rle with old method : 0.08434367179870605 length of segment : 279 time for calcul the mask position with numpy : 0.003282308578491211 nb_pixel_total : 145195 time to create 1 rle with old method : 0.1625537872314453 length of segment : 477 time for calcul the mask position with numpy : 0.08238887786865234 nb_pixel_total : 509043 time to create 1 rle with new method : 0.15944480895996094 length of segment : 1877 time for calcul the mask position with numpy : 0.0074634552001953125 nb_pixel_total : 96833 time to create 1 rle with old method : 0.10988306999206543 length of segment : 432 time for calcul the mask position with numpy : 0.002533435821533203 nb_pixel_total : 65921 time to create 1 rle with old method : 0.07955145835876465 length of segment : 343 time for calcul the mask position with numpy : 0.024459362030029297 nb_pixel_total : 63108 time to create 1 rle with old method : 0.07844924926757812 length of segment : 276 time for calcul the mask position with numpy : 0.015318155288696289 nb_pixel_total : 223032 time to create 1 rle with new method : 0.028263330459594727 length of segment : 1109 time for calcul the mask position with numpy : 0.0018794536590576172 nb_pixel_total : 75970 time to create 1 rle with old method : 0.08401918411254883 length of segment : 368 time for calcul the mask position with numpy : 0.005298614501953125 nb_pixel_total : 109803 time to create 1 rle with old method : 0.1714630126953125 length of segment : 283 time for calcul the mask position with numpy : 0.0035893917083740234 nb_pixel_total : 179236 time to create 1 rle with new method : 0.01003408432006836 length of segment : 420 time for calcul the mask position with numpy : 0.002478361129760742 nb_pixel_total : 103982 time to create 1 rle with old method : 0.12281584739685059 length of segment : 290 time for calcul the mask position with numpy : 0.0024063587188720703 nb_pixel_total : 78658 time to create 1 rle with old method : 0.09256291389465332 length of segment : 437 time for calcul the mask position with numpy : 0.17717599868774414 nb_pixel_total : 991637 time to create 1 rle with new method : 0.16823410987854004 length of segment : 1560 time for calcul the mask position with numpy : 0.009538412094116211 nb_pixel_total : 331469 time to create 1 rle with new method : 0.0304105281829834 length of segment : 596 time for calcul the mask position with numpy : 0.0016870498657226562 nb_pixel_total : 57512 time to create 1 rle with old method : 0.06582975387573242 length of segment : 290 time for calcul the mask position with numpy : 0.0024535655975341797 nb_pixel_total : 83657 time to create 1 rle with old method : 0.10053157806396484 length of segment : 438 time for calcul the mask position with numpy : 0.0021266937255859375 nb_pixel_total : 62895 time to create 1 rle with old method : 0.07295632362365723 length of segment : 260 time for calcul the mask position with numpy : 0.006873369216918945 nb_pixel_total : 27052 time to create 1 rle with old method : 0.032593727111816406 length of segment : 161 time for calcul the mask position with numpy : 0.027323484420776367 nb_pixel_total : 759227 time to create 1 rle with new method : 0.2564523220062256 length of segment : 658 time for calcul the mask position with numpy : 0.003090381622314453 nb_pixel_total : 153704 time to create 1 rle with new method : 0.008409976959228516 length of segment : 446 time for calcul the mask position with numpy : 0.0012218952178955078 nb_pixel_total : 51506 time to create 1 rle with old method : 0.05987739562988281 length of segment : 381 time for calcul the mask position with numpy : 0.006369590759277344 nb_pixel_total : 284889 time to create 1 rle with new method : 0.02042245864868164 length of segment : 1154 time for calcul the mask position with numpy : 0.0006134510040283203 nb_pixel_total : 18220 time to create 1 rle with old method : 0.02113652229309082 length of segment : 130 time for calcul the mask position with numpy : 0.02255105972290039 nb_pixel_total : 134875 time to create 1 rle with old method : 0.18402504920959473 length of segment : 289 time for calcul the mask position with numpy : 0.006216287612915039 nb_pixel_total : 244532 time to create 1 rle with new method : 0.015343904495239258 length of segment : 486 time for calcul the mask position with numpy : 0.014026641845703125 nb_pixel_total : 41576 time to create 1 rle with old method : 0.0684652328491211 length of segment : 219 time for calcul the mask position with numpy : 0.0009772777557373047 nb_pixel_total : 32229 time to create 1 rle with old method : 0.06633639335632324 length of segment : 140 time for calcul the mask position with numpy : 0.010012149810791016 nb_pixel_total : 66299 time to create 1 rle with old method : 0.09944462776184082 length of segment : 265 time for calcul the mask position with numpy : 0.0015282630920410156 nb_pixel_total : 72619 time to create 1 rle with old method : 0.08585548400878906 length of segment : 339 time for calcul the mask position with numpy : 0.040228843688964844 nb_pixel_total : 565513 time to create 1 rle with new method : 0.30747532844543457 length of segment : 1176 time for calcul the mask position with numpy : 0.0008747577667236328 nb_pixel_total : 35578 time to create 1 rle with old method : 0.041380882263183594 length of segment : 175 time for calcul the mask position with numpy : 0.006947755813598633 nb_pixel_total : 326765 time to create 1 rle with new method : 0.01888275146484375 length of segment : 557 time for calcul the mask position with numpy : 0.0009012222290039062 nb_pixel_total : 12621 time to create 1 rle with old method : 0.015390396118164062 length of segment : 159 time for calcul the mask position with numpy : 0.006074428558349609 nb_pixel_total : 126269 time to create 1 rle with old method : 0.15299510955810547 length of segment : 477 time for calcul the mask position with numpy : 0.0025947093963623047 nb_pixel_total : 75847 time to create 1 rle with old method : 0.12293648719787598 length of segment : 199 time for calcul the mask position with numpy : 0.005783796310424805 nb_pixel_total : 204542 time to create 1 rle with new method : 0.018488407135009766 length of segment : 625 time for calcul the mask position with numpy : 0.002729654312133789 nb_pixel_total : 113536 time to create 1 rle with old method : 0.13430428504943848 length of segment : 253 time for calcul the mask position with numpy : 0.0015518665313720703 nb_pixel_total : 56881 time to create 1 rle with old method : 0.06970047950744629 length of segment : 288 time for calcul the mask position with numpy : 0.0391850471496582 nb_pixel_total : 560601 time to create 1 rle with new method : 0.11831355094909668 length of segment : 1716 time for calcul the mask position with numpy : 0.0029785633087158203 nb_pixel_total : 129855 time to create 1 rle with old method : 0.1466224193572998 length of segment : 461 time for calcul the mask position with numpy : 0.003371715545654297 nb_pixel_total : 119045 time to create 1 rle with old method : 0.15819478034973145 length of segment : 347 time for calcul the mask position with numpy : 0.002396106719970703 nb_pixel_total : 112912 time to create 1 rle with old method : 0.12562108039855957 length of segment : 312 time for calcul the mask position with numpy : 0.0028946399688720703 nb_pixel_total : 143923 time to create 1 rle with old method : 0.15987658500671387 length of segment : 342 time for calcul the mask position with numpy : 0.001577615737915039 nb_pixel_total : 72889 time to create 1 rle with old method : 0.10225987434387207 length of segment : 338 time for calcul the mask position with numpy : 0.00458836555480957 nb_pixel_total : 64063 time to create 1 rle with old method : 0.08068585395812988 length of segment : 237 time for calcul the mask position with numpy : 0.004982471466064453 nb_pixel_total : 72784 time to create 1 rle with old method : 0.08106064796447754 length of segment : 668 time for calcul the mask position with numpy : 0.013355731964111328 nb_pixel_total : 464048 time to create 1 rle with new method : 0.253969669342041 length of segment : 1322 time for calcul the mask position with numpy : 0.002010345458984375 nb_pixel_total : 26550 time to create 1 rle with old method : 0.030468463897705078 length of segment : 174 time for calcul the mask position with numpy : 0.003431081771850586 nb_pixel_total : 57678 time to create 1 rle with old method : 0.07136178016662598 length of segment : 293 time for calcul the mask position with numpy : 0.0073320865631103516 nb_pixel_total : 252917 time to create 1 rle with new method : 0.02242565155029297 length of segment : 775 time for calcul the mask position with numpy : 0.0022573471069335938 nb_pixel_total : 21329 time to create 1 rle with old method : 0.02530527114868164 length of segment : 190 time for calcul the mask position with numpy : 0.003973245620727539 nb_pixel_total : 58773 time to create 1 rle with old method : 0.06741523742675781 length of segment : 373 time for calcul the mask position with numpy : 0.003168821334838867 nb_pixel_total : 41102 time to create 1 rle with old method : 0.06628847122192383 length of segment : 210 time for calcul the mask position with numpy : 0.011573076248168945 nb_pixel_total : 188879 time to create 1 rle with new method : 0.013998031616210938 length of segment : 686 time for calcul the mask position with numpy : 0.002140045166015625 nb_pixel_total : 81876 time to create 1 rle with old method : 0.09371185302734375 length of segment : 401 time for calcul the mask position with numpy : 0.008959531784057617 nb_pixel_total : 261568 time to create 1 rle with new method : 0.03234076499938965 length of segment : 1042 time for calcul the mask position with numpy : 0.004298686981201172 nb_pixel_total : 214554 time to create 1 rle with new method : 0.011794328689575195 length of segment : 649 time for calcul the mask position with numpy : 0.007605075836181641 nb_pixel_total : 156953 time to create 1 rle with new method : 0.023929595947265625 length of segment : 603 time for calcul the mask position with numpy : 0.0013566017150878906 nb_pixel_total : 51183 time to create 1 rle with old method : 0.07023358345031738 length of segment : 277 time for calcul the mask position with numpy : 0.005427122116088867 nb_pixel_total : 86197 time to create 1 rle with old method : 0.09909510612487793 length of segment : 779 time for calcul the mask position with numpy : 0.0012888908386230469 nb_pixel_total : 55576 time to create 1 rle with old method : 0.0625 length of segment : 293 time for calcul the mask position with numpy : 0.010937213897705078 nb_pixel_total : 149301 time to create 1 rle with old method : 0.16731023788452148 length of segment : 579 time for calcul the mask position with numpy : 0.003614187240600586 nb_pixel_total : 67236 time to create 1 rle with old method : 0.09626555442810059 length of segment : 400 time for calcul the mask position with numpy : 0.002952098846435547 nb_pixel_total : 22819 time to create 1 rle with old method : 0.02605581283569336 length of segment : 306 time for calcul the mask position with numpy : 0.0010368824005126953 nb_pixel_total : 34074 time to create 1 rle with old method : 0.03958630561828613 length of segment : 267 time for calcul the mask position with numpy : 0.001581430435180664 nb_pixel_total : 23945 time to create 1 rle with old method : 0.03185319900512695 length of segment : 202 time for calcul the mask position with numpy : 0.00931859016418457 nb_pixel_total : 140044 time to create 1 rle with old method : 0.17018961906433105 length of segment : 457 time for calcul the mask position with numpy : 0.004123687744140625 nb_pixel_total : 158216 time to create 1 rle with new method : 0.012068033218383789 length of segment : 726 time for calcul the mask position with numpy : 0.08560323715209961 nb_pixel_total : 927876 time to create 1 rle with new method : 0.3382904529571533 length of segment : 1679 time for calcul the mask position with numpy : 0.003839731216430664 nb_pixel_total : 89726 time to create 1 rle with old method : 0.11746573448181152 length of segment : 509 time for calcul the mask position with numpy : 0.009256839752197266 nb_pixel_total : 106352 time to create 1 rle with old method : 0.13565778732299805 length of segment : 364 time for calcul the mask position with numpy : 0.007608652114868164 nb_pixel_total : 188339 time to create 1 rle with new method : 0.011066436767578125 length of segment : 592 time for calcul the mask position with numpy : 0.0007688999176025391 nb_pixel_total : 19647 time to create 1 rle with old method : 0.022191762924194336 length of segment : 247 time for calcul the mask position with numpy : 0.0026955604553222656 nb_pixel_total : 105048 time to create 1 rle with old method : 0.11804389953613281 length of segment : 417 time for calcul the mask position with numpy : 0.002296924591064453 nb_pixel_total : 62993 time to create 1 rle with old method : 0.0708763599395752 length of segment : 425 time for calcul the mask position with numpy : 0.04553699493408203 nb_pixel_total : 634122 time to create 1 rle with new method : 0.22088122367858887 length of segment : 1814 time for calcul the mask position with numpy : 0.0034241676330566406 nb_pixel_total : 169127 time to create 1 rle with new method : 0.009041070938110352 length of segment : 247 time for calcul the mask position with numpy : 0.003283977508544922 nb_pixel_total : 127201 time to create 1 rle with old method : 0.15674161911010742 length of segment : 610 time for calcul the mask position with numpy : 0.001600027084350586 nb_pixel_total : 63685 time to create 1 rle with old method : 0.0726470947265625 length of segment : 278 time for calcul the mask position with numpy : 0.019483566284179688 nb_pixel_total : 762380 time to create 1 rle with new method : 0.06165266036987305 length of segment : 1061 time for calcul the mask position with numpy : 0.004660367965698242 nb_pixel_total : 199720 time to create 1 rle with new method : 0.013778448104858398 length of segment : 512 time for calcul the mask position with numpy : 0.008789777755737305 nb_pixel_total : 243643 time to create 1 rle with new method : 0.023107528686523438 length of segment : 713 time for calcul the mask position with numpy : 0.001567840576171875 nb_pixel_total : 18877 time to create 1 rle with old method : 0.022930622100830078 length of segment : 223 time for calcul the mask position with numpy : 0.0016093254089355469 nb_pixel_total : 74870 time to create 1 rle with old method : 0.08710670471191406 length of segment : 279 time for calcul the mask position with numpy : 0.003239154815673828 nb_pixel_total : 140317 time to create 1 rle with old method : 0.16082072257995605 length of segment : 375 time for calcul the mask position with numpy : 0.0029268264770507812 nb_pixel_total : 85198 time to create 1 rle with old method : 0.0986783504486084 length of segment : 501 time for calcul the mask position with numpy : 0.009883880615234375 nb_pixel_total : 366765 time to create 1 rle with new method : 0.026088237762451172 length of segment : 794 time for calcul the mask position with numpy : 0.003906965255737305 nb_pixel_total : 116929 time to create 1 rle with old method : 0.13144612312316895 length of segment : 569 time for calcul the mask position with numpy : 0.004377126693725586 nb_pixel_total : 210062 time to create 1 rle with new method : 0.013854742050170898 length of segment : 533 time for calcul the mask position with numpy : 0.0034699440002441406 nb_pixel_total : 107222 time to create 1 rle with old method : 0.12302732467651367 length of segment : 475 time for calcul the mask position with numpy : 0.020071029663085938 nb_pixel_total : 365198 time to create 1 rle with new method : 0.04954171180725098 length of segment : 1193 time for calcul the mask position with numpy : 0.002926349639892578 nb_pixel_total : 110057 time to create 1 rle with old method : 0.12370443344116211 length of segment : 399 time for calcul the mask position with numpy : 0.002417325973510742 nb_pixel_total : 118355 time to create 1 rle with old method : 0.135329008102417 length of segment : 382 time for calcul the mask position with numpy : 0.002291440963745117 nb_pixel_total : 86545 time to create 1 rle with old method : 0.11023736000061035 length of segment : 710 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 15731 time to create 1 rle with old method : 0.018158674240112305 length of segment : 216 time for calcul the mask position with numpy : 0.0008661746978759766 nb_pixel_total : 17472 time to create 1 rle with old method : 0.020704030990600586 length of segment : 141 time for calcul the mask position with numpy : 0.008016824722290039 nb_pixel_total : 360441 time to create 1 rle with new method : 0.023470401763916016 length of segment : 692 time for calcul the mask position with numpy : 0.006680965423583984 nb_pixel_total : 196303 time to create 1 rle with new method : 0.021009445190429688 length of segment : 602 time for calcul the mask position with numpy : 0.00406646728515625 nb_pixel_total : 142216 time to create 1 rle with old method : 0.1840982437133789 length of segment : 633 time for calcul the mask position with numpy : 0.0019211769104003906 nb_pixel_total : 65877 time to create 1 rle with old method : 0.07783246040344238 length of segment : 443 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 56014 time to create 1 rle with old method : 0.0648491382598877 length of segment : 357 time for calcul the mask position with numpy : 0.0026161670684814453 nb_pixel_total : 51940 time to create 1 rle with old method : 0.0577397346496582 length of segment : 362 time for calcul the mask position with numpy : 0.004883289337158203 nb_pixel_total : 71491 time to create 1 rle with old method : 0.09714388847351074 length of segment : 564 time for calcul the mask position with numpy : 0.003172159194946289 nb_pixel_total : 102628 time to create 1 rle with old method : 0.11491107940673828 length of segment : 448 time for calcul the mask position with numpy : 0.0011854171752929688 nb_pixel_total : 33916 time to create 1 rle with old method : 0.04676318168640137 length of segment : 273 time for calcul the mask position with numpy : 0.005391597747802734 nb_pixel_total : 76643 time to create 1 rle with old method : 0.11399602890014648 length of segment : 586 time for calcul the mask position with numpy : 0.0021753311157226562 nb_pixel_total : 49599 time to create 1 rle with old method : 0.05775141716003418 length of segment : 456 time for calcul the mask position with numpy : 0.0030896663665771484 nb_pixel_total : 92122 time to create 1 rle with old method : 0.1218719482421875 length of segment : 369 time for calcul the mask position with numpy : 0.0012683868408203125 nb_pixel_total : 60984 time to create 1 rle with old method : 0.07848954200744629 length of segment : 356 time for calcul the mask position with numpy : 0.0009331703186035156 nb_pixel_total : 19769 time to create 1 rle with old method : 0.029180288314819336 length of segment : 234 time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 64488 time to create 1 rle with old method : 0.0870211124420166 length of segment : 405 time for calcul the mask position with numpy : 0.0072176456451416016 nb_pixel_total : 334870 time to create 1 rle with new method : 0.022556543350219727 length of segment : 658 time for calcul the mask position with numpy : 0.009642839431762695 nb_pixel_total : 275776 time to create 1 rle with new method : 0.032445669174194336 length of segment : 969 time for calcul the mask position with numpy : 0.0016422271728515625 nb_pixel_total : 48945 time to create 1 rle with old method : 0.056854963302612305 length of segment : 651 time for calcul the mask position with numpy : 0.003312826156616211 nb_pixel_total : 129202 time to create 1 rle with old method : 0.14614486694335938 length of segment : 472 time for calcul the mask position with numpy : 0.0022292137145996094 nb_pixel_total : 63105 time to create 1 rle with old method : 0.07571125030517578 length of segment : 360 time for calcul the mask position with numpy : 0.0015816688537597656 nb_pixel_total : 61707 time to create 1 rle with old method : 0.07112789154052734 length of segment : 278 time for calcul the mask position with numpy : 0.0011415481567382812 nb_pixel_total : 39045 time to create 1 rle with old method : 0.04459428787231445 length of segment : 279 time for calcul the mask position with numpy : 0.0007696151733398438 nb_pixel_total : 28362 time to create 1 rle with old method : 0.036533355712890625 length of segment : 237 time for calcul the mask position with numpy : 0.009212493896484375 nb_pixel_total : 222650 time to create 1 rle with new method : 0.026354551315307617 length of segment : 824 time for calcul the mask position with numpy : 0.002651214599609375 nb_pixel_total : 105700 time to create 1 rle with old method : 0.12179017066955566 length of segment : 414 time for calcul the mask position with numpy : 0.0032083988189697266 nb_pixel_total : 94243 time to create 1 rle with old method : 0.11221909523010254 length of segment : 539 time for calcul the mask position with numpy : 0.003978729248046875 nb_pixel_total : 120551 time to create 1 rle with old method : 0.17075753211975098 length of segment : 467 time for calcul the mask position with numpy : 0.003092527389526367 nb_pixel_total : 27346 time to create 1 rle with old method : 0.032640695571899414 length of segment : 235 time for calcul the mask position with numpy : 0.06509160995483398 nb_pixel_total : 1163285 time to create 1 rle with new method : 0.28148746490478516 length of segment : 2005 time for calcul the mask position with numpy : 0.008649826049804688 nb_pixel_total : 353894 time to create 1 rle with new method : 0.020685195922851562 length of segment : 751 time for calcul the mask position with numpy : 0.021436691284179688 nb_pixel_total : 354932 time to create 1 rle with new method : 0.026072263717651367 length of segment : 854 time for calcul the mask position with numpy : 0.005498647689819336 nb_pixel_total : 177965 time to create 1 rle with new method : 0.014987468719482422 length of segment : 718 time for calcul the mask position with numpy : 0.004961252212524414 nb_pixel_total : 185919 time to create 1 rle with new method : 0.014537811279296875 length of segment : 558 time for calcul the mask position with numpy : 0.008400201797485352 nb_pixel_total : 322277 time to create 1 rle with new method : 0.02091240882873535 length of segment : 740 time for calcul the mask position with numpy : 0.005703449249267578 nb_pixel_total : 110226 time to create 1 rle with old method : 0.14528536796569824 length of segment : 420 time for calcul the mask position with numpy : 0.0017130374908447266 nb_pixel_total : 64652 time to create 1 rle with old method : 0.07468819618225098 length of segment : 534 time for calcul the mask position with numpy : 0.005401134490966797 nb_pixel_total : 194403 time to create 1 rle with new method : 0.015570402145385742 length of segment : 622 time for calcul the mask position with numpy : 0.006122112274169922 nb_pixel_total : 279836 time to create 1 rle with new method : 0.014976024627685547 length of segment : 642 time for calcul the mask position with numpy : 0.0018627643585205078 nb_pixel_total : 67633 time to create 1 rle with old method : 0.09450912475585938 length of segment : 332 time for calcul the mask position with numpy : 0.006615638732910156 nb_pixel_total : 278218 time to create 1 rle with new method : 0.018137693405151367 length of segment : 1232 time for calcul the mask position with numpy : 0.002564668655395508 nb_pixel_total : 79113 time to create 1 rle with old method : 0.08758854866027832 length of segment : 390 time for calcul the mask position with numpy : 0.0032613277435302734 nb_pixel_total : 163914 time to create 1 rle with new method : 0.008085966110229492 length of segment : 559 time for calcul the mask position with numpy : 0.0010113716125488281 nb_pixel_total : 35322 time to create 1 rle with old method : 0.03976869583129883 length of segment : 315 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 14933 time to create 1 rle with old method : 0.01765275001525879 length of segment : 149 time for calcul the mask position with numpy : 0.004414558410644531 nb_pixel_total : 155640 time to create 1 rle with new method : 0.010824441909790039 length of segment : 707 time for calcul the mask position with numpy : 0.0047607421875 nb_pixel_total : 134434 time to create 1 rle with old method : 0.1530919075012207 length of segment : 496 time for calcul the mask position with numpy : 0.0019991397857666016 nb_pixel_total : 100376 time to create 1 rle with old method : 0.11517143249511719 length of segment : 440 time for calcul the mask position with numpy : 0.0038824081420898438 nb_pixel_total : 133574 time to create 1 rle with old method : 0.17724108695983887 length of segment : 431 time for calcul the mask position with numpy : 0.005959272384643555 nb_pixel_total : 170264 time to create 1 rle with new method : 0.018930435180664062 length of segment : 914 time for calcul the mask position with numpy : 0.003548145294189453 nb_pixel_total : 161180 time to create 1 rle with new method : 0.01030588150024414 length of segment : 513 time for calcul the mask position with numpy : 0.003567934036254883 nb_pixel_total : 122620 time to create 1 rle with old method : 0.1379997730255127 length of segment : 531 time for calcul the mask position with numpy : 0.0040166378021240234 nb_pixel_total : 145858 time to create 1 rle with old method : 0.1715404987335205 length of segment : 636 time for calcul the mask position with numpy : 0.001417398452758789 nb_pixel_total : 31905 time to create 1 rle with old method : 0.05057787895202637 length of segment : 266 time for calcul the mask position with numpy : 0.0030357837677001953 nb_pixel_total : 4960 time to create 1 rle with old method : 0.005907535552978516 length of segment : 78 time for calcul the mask position with numpy : 0.0006282329559326172 nb_pixel_total : 22165 time to create 1 rle with old method : 0.02565622329711914 length of segment : 143 time for calcul the mask position with numpy : 0.011585712432861328 nb_pixel_total : 426901 time to create 1 rle with new method : 0.04903984069824219 length of segment : 743 time for calcul the mask position with numpy : 0.017568349838256836 nb_pixel_total : 453396 time to create 1 rle with new method : 0.16095662117004395 length of segment : 1003 time for calcul the mask position with numpy : 0.0006530284881591797 nb_pixel_total : 28877 time to create 1 rle with old method : 0.032350778579711914 length of segment : 211 time for calcul the mask position with numpy : 0.0037488937377929688 nb_pixel_total : 151019 time to create 1 rle with new method : 0.014600753784179688 length of segment : 713 time for calcul the mask position with numpy : 0.0069811344146728516 nb_pixel_total : 336816 time to create 1 rle with new method : 0.0201873779296875 length of segment : 593 time for calcul the mask position with numpy : 0.014360904693603516 nb_pixel_total : 481788 time to create 1 rle with new method : 0.020106792449951172 length of segment : 851 time for calcul the mask position with numpy : 0.002809762954711914 nb_pixel_total : 97409 time to create 1 rle with old method : 0.10826778411865234 length of segment : 781 time for calcul the mask position with numpy : 0.0009431838989257812 nb_pixel_total : 20602 time to create 1 rle with old method : 0.024531841278076172 length of segment : 266 time for calcul the mask position with numpy : 0.004717588424682617 nb_pixel_total : 184625 time to create 1 rle with new method : 0.014652729034423828 length of segment : 321 time for calcul the mask position with numpy : 0.0021059513092041016 nb_pixel_total : 87738 time to create 1 rle with old method : 0.12283492088317871 length of segment : 535 time for calcul the mask position with numpy : 0.0028035640716552734 nb_pixel_total : 117004 time to create 1 rle with old method : 0.15296506881713867 length of segment : 430 time for calcul the mask position with numpy : 0.03101634979248047 nb_pixel_total : 1151735 time to create 1 rle with new method : 0.5053074359893799 length of segment : 1545 time for calcul the mask position with numpy : 0.0010180473327636719 nb_pixel_total : 37192 time to create 1 rle with old method : 0.051091909408569336 length of segment : 247 time for calcul the mask position with numpy : 0.009232282638549805 nb_pixel_total : 278797 time to create 1 rle with new method : 0.034128665924072266 length of segment : 1212 time for calcul the mask position with numpy : 0.0039713382720947266 nb_pixel_total : 147544 time to create 1 rle with old method : 0.175919771194458 length of segment : 621 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 39618 time to create 1 rle with old method : 0.04462790489196777 length of segment : 212 time for calcul the mask position with numpy : 0.0015118122100830078 nb_pixel_total : 10046 time to create 1 rle with old method : 0.011552810668945312 length of segment : 330 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 23928 time to create 1 rle with old method : 0.027359485626220703 length of segment : 229 time for calcul the mask position with numpy : 0.002699613571166992 nb_pixel_total : 112771 time to create 1 rle with old method : 0.12608551979064941 length of segment : 453 time for calcul the mask position with numpy : 0.007225990295410156 nb_pixel_total : 301482 time to create 1 rle with new method : 0.022260427474975586 length of segment : 1242 time for calcul the mask position with numpy : 0.003509521484375 nb_pixel_total : 184662 time to create 1 rle with new method : 0.009005546569824219 length of segment : 312 time for calcul the mask position with numpy : 0.0034313201904296875 nb_pixel_total : 119128 time to create 1 rle with old method : 0.14902853965759277 length of segment : 496 time for calcul the mask position with numpy : 0.004652500152587891 nb_pixel_total : 108419 time to create 1 rle with old method : 0.12009406089782715 length of segment : 747 time for calcul the mask position with numpy : 0.0004513263702392578 nb_pixel_total : 19948 time to create 1 rle with old method : 0.022394418716430664 length of segment : 232 time for calcul the mask position with numpy : 0.00501704216003418 nb_pixel_total : 144677 time to create 1 rle with old method : 0.16284823417663574 length of segment : 455 time for calcul the mask position with numpy : 0.0039031505584716797 nb_pixel_total : 156633 time to create 1 rle with new method : 0.011955499649047852 length of segment : 654 time for calcul the mask position with numpy : 0.008022069931030273 nb_pixel_total : 250161 time to create 1 rle with new method : 0.02536606788635254 length of segment : 597 time for calcul the mask position with numpy : 0.0024890899658203125 nb_pixel_total : 149567 time to create 1 rle with old method : 0.16833853721618652 length of segment : 283 time for calcul the mask position with numpy : 0.0028526782989501953 nb_pixel_total : 109051 time to create 1 rle with old method : 0.12383389472961426 length of segment : 769 time for calcul the mask position with numpy : 0.0019636154174804688 nb_pixel_total : 81439 time to create 1 rle with old method : 0.09168481826782227 length of segment : 463 time for calcul the mask position with numpy : 0.004469871520996094 nb_pixel_total : 147584 time to create 1 rle with old method : 0.1673130989074707 length of segment : 488 time for calcul the mask position with numpy : 0.0041027069091796875 nb_pixel_total : 174406 time to create 1 rle with new method : 0.012488603591918945 length of segment : 700 time for calcul the mask position with numpy : 0.008104324340820312 nb_pixel_total : 245241 time to create 1 rle with new method : 0.026249170303344727 length of segment : 984 time for calcul the mask position with numpy : 0.003932952880859375 nb_pixel_total : 148045 time to create 1 rle with old method : 0.1916346549987793 length of segment : 706 time for calcul the mask position with numpy : 0.0019211769104003906 nb_pixel_total : 79267 time to create 1 rle with old method : 0.11073064804077148 length of segment : 337 time for calcul the mask position with numpy : 0.006801128387451172 nb_pixel_total : 203867 time to create 1 rle with new method : 0.026897907257080078 length of segment : 859 time for calcul the mask position with numpy : 0.0031900405883789062 nb_pixel_total : 139743 time to create 1 rle with old method : 0.17351794242858887 length of segment : 443 time for calcul the mask position with numpy : 0.0035619735717773438 nb_pixel_total : 146928 time to create 1 rle with old method : 0.16304922103881836 length of segment : 625 time for calcul the mask position with numpy : 0.01688861846923828 nb_pixel_total : 483937 time to create 1 rle with new method : 0.033711910247802734 length of segment : 650 time for calcul the mask position with numpy : 0.0026247501373291016 nb_pixel_total : 94013 time to create 1 rle with old method : 0.10431766510009766 length of segment : 363 time for calcul the mask position with numpy : 0.0019147396087646484 nb_pixel_total : 67321 time to create 1 rle with old method : 0.1220247745513916 length of segment : 293 time for calcul the mask position with numpy : 0.0025720596313476562 nb_pixel_total : 95561 time to create 1 rle with old method : 0.10766124725341797 length of segment : 395 time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 79860 time to create 1 rle with old method : 0.09017777442932129 length of segment : 318 time for calcul the mask position with numpy : 0.0012862682342529297 nb_pixel_total : 42081 time to create 1 rle with old method : 0.05678367614746094 length of segment : 208 time for calcul the mask position with numpy : 0.003325223922729492 nb_pixel_total : 100016 time to create 1 rle with old method : 0.11658334732055664 length of segment : 669 time for calcul the mask position with numpy : 0.010884284973144531 nb_pixel_total : 248735 time to create 1 rle with new method : 0.028011322021484375 length of segment : 593 time for calcul the mask position with numpy : 0.002703428268432617 nb_pixel_total : 104880 time to create 1 rle with old method : 0.11869549751281738 length of segment : 555 time for calcul the mask position with numpy : 0.003680706024169922 nb_pixel_total : 131888 time to create 1 rle with old method : 0.17197966575622559 length of segment : 391 time for calcul the mask position with numpy : 0.0073010921478271484 nb_pixel_total : 316360 time to create 1 rle with new method : 0.021303892135620117 length of segment : 643 time for calcul the mask position with numpy : 0.0037412643432617188 nb_pixel_total : 171681 time to create 1 rle with new method : 0.010438680648803711 length of segment : 409 time for calcul the mask position with numpy : 0.0014078617095947266 nb_pixel_total : 39539 time to create 1 rle with old method : 0.046994924545288086 length of segment : 219 time for calcul the mask position with numpy : 0.015646934509277344 nb_pixel_total : 363180 time to create 1 rle with new method : 0.03871011734008789 length of segment : 508 time for calcul the mask position with numpy : 0.008521795272827148 nb_pixel_total : 239982 time to create 1 rle with new method : 0.021760225296020508 length of segment : 645 time for calcul the mask position with numpy : 0.0020139217376708984 nb_pixel_total : 55519 time to create 1 rle with old method : 0.06426477432250977 length of segment : 320 time for calcul the mask position with numpy : 0.006997346878051758 nb_pixel_total : 207441 time to create 1 rle with new method : 0.019702434539794922 length of segment : 630 time for calcul the mask position with numpy : 0.003122568130493164 nb_pixel_total : 97515 time to create 1 rle with old method : 0.11322832107543945 length of segment : 415 time for calcul the mask position with numpy : 0.0019865036010742188 nb_pixel_total : 57493 time to create 1 rle with old method : 0.06649041175842285 length of segment : 272 time for calcul the mask position with numpy : 0.0021729469299316406 nb_pixel_total : 78404 time to create 1 rle with old method : 0.08925008773803711 length of segment : 288 time for calcul the mask position with numpy : 0.003698587417602539 nb_pixel_total : 86894 time to create 1 rle with old method : 0.09812450408935547 length of segment : 675 time for calcul the mask position with numpy : 0.008980035781860352 nb_pixel_total : 235004 time to create 1 rle with new method : 0.034940242767333984 length of segment : 1009 time for calcul the mask position with numpy : 0.0016095638275146484 nb_pixel_total : 67170 time to create 1 rle with old method : 0.08509373664855957 length of segment : 296 time for calcul the mask position with numpy : 0.005110263824462891 nb_pixel_total : 215286 time to create 1 rle with new method : 0.0165712833404541 length of segment : 730 time for calcul the mask position with numpy : 0.053627967834472656 nb_pixel_total : 738243 time to create 1 rle with new method : 0.46158361434936523 length of segment : 976 time for calcul the mask position with numpy : 0.0014820098876953125 nb_pixel_total : 75665 time to create 1 rle with old method : 0.08722686767578125 length of segment : 405 time for calcul the mask position with numpy : 0.0005402565002441406 nb_pixel_total : 24267 time to create 1 rle with old method : 0.02776813507080078 length of segment : 186 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 34745 time to create 1 rle with old method : 0.04018354415893555 length of segment : 271 time for calcul the mask position with numpy : 0.002437591552734375 nb_pixel_total : 55808 time to create 1 rle with old method : 0.08928966522216797 length of segment : 221 time for calcul the mask position with numpy : 0.0010912418365478516 nb_pixel_total : 5447 time to create 1 rle with old method : 0.007159233093261719 length of segment : 130 time for calcul the mask position with numpy : 0.0012524127960205078 nb_pixel_total : 57448 time to create 1 rle with old method : 0.07514119148254395 length of segment : 311 time for calcul the mask position with numpy : 0.004364967346191406 nb_pixel_total : 165542 time to create 1 rle with new method : 0.012900590896606445 length of segment : 447 time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 14085 time to create 1 rle with old method : 0.01631474494934082 length of segment : 236 time for calcul the mask position with numpy : 0.0014128684997558594 nb_pixel_total : 56532 time to create 1 rle with old method : 0.0643460750579834 length of segment : 286 time for calcul the mask position with numpy : 0.0034093856811523438 nb_pixel_total : 145685 time to create 1 rle with old method : 0.17551302909851074 length of segment : 515 time for calcul the mask position with numpy : 0.004585981369018555 nb_pixel_total : 241973 time to create 1 rle with new method : 0.013206243515014648 length of segment : 683 time for calcul the mask position with numpy : 0.0013277530670166016 nb_pixel_total : 36371 time to create 1 rle with old method : 0.042436838150024414 length of segment : 284 time for calcul the mask position with numpy : 0.0036039352416992188 nb_pixel_total : 174971 time to create 1 rle with new method : 0.010286092758178711 length of segment : 433 time for calcul the mask position with numpy : 0.0014319419860839844 nb_pixel_total : 68137 time to create 1 rle with old method : 0.0776665210723877 length of segment : 442 time for calcul the mask position with numpy : 0.00222015380859375 nb_pixel_total : 57714 time to create 1 rle with old method : 0.0670783519744873 length of segment : 313 time for calcul the mask position with numpy : 0.00966644287109375 nb_pixel_total : 419094 time to create 1 rle with new method : 0.028557300567626953 length of segment : 849 time for calcul the mask position with numpy : 0.0004703998565673828 nb_pixel_total : 23137 time to create 1 rle with old method : 0.028536081314086914 length of segment : 227 time for calcul the mask position with numpy : 0.007823944091796875 nb_pixel_total : 350321 time to create 1 rle with new method : 0.022678852081298828 length of segment : 840 time for calcul the mask position with numpy : 0.040303707122802734 nb_pixel_total : 1318508 time to create 1 rle with new method : 0.3225243091583252 length of segment : 1861 time for calcul the mask position with numpy : 0.0021522045135498047 nb_pixel_total : 82641 time to create 1 rle with old method : 0.10047411918640137 length of segment : 332 time for calcul the mask position with numpy : 0.0008568763732910156 nb_pixel_total : 12942 time to create 1 rle with old method : 0.014630317687988281 length of segment : 479 time for calcul the mask position with numpy : 0.003020763397216797 nb_pixel_total : 146395 time to create 1 rle with old method : 0.1689918041229248 length of segment : 375 time for calcul the mask position with numpy : 0.006213665008544922 nb_pixel_total : 311400 time to create 1 rle with new method : 0.018293142318725586 length of segment : 730 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 168780 time to create 1 rle with new method : 0.02179241180419922 length of segment : 545 time for calcul the mask position with numpy : 0.0019273757934570312 nb_pixel_total : 40681 time to create 1 rle with old method : 0.04874730110168457 length of segment : 262 time for calcul the mask position with numpy : 0.00927877426147461 nb_pixel_total : 345781 time to create 1 rle with new method : 0.0243685245513916 length of segment : 854 time for calcul the mask position with numpy : 0.006590366363525391 nb_pixel_total : 239618 time to create 1 rle with new method : 0.022057056427001953 length of segment : 556 time for calcul the mask position with numpy : 0.0017664432525634766 nb_pixel_total : 90767 time to create 1 rle with old method : 0.1014409065246582 length of segment : 243 time for calcul the mask position with numpy : 0.0029649734497070312 nb_pixel_total : 151998 time to create 1 rle with new method : 0.008319854736328125 length of segment : 402 time for calcul the mask position with numpy : 0.0009496212005615234 nb_pixel_total : 43024 time to create 1 rle with old method : 0.04872703552246094 length of segment : 382 time for calcul the mask position with numpy : 0.0012440681457519531 nb_pixel_total : 54962 time to create 1 rle with old method : 0.06260085105895996 length of segment : 305 time for calcul the mask position with numpy : 0.0027065277099609375 nb_pixel_total : 140743 time to create 1 rle with old method : 0.16292595863342285 length of segment : 487 time for calcul the mask position with numpy : 0.0009326934814453125 nb_pixel_total : 43024 time to create 1 rle with old method : 0.04877281188964844 length of segment : 378 time for calcul the mask position with numpy : 0.018971681594848633 nb_pixel_total : 484888 time to create 1 rle with new method : 0.13507890701293945 length of segment : 1103 time for calcul the mask position with numpy : 0.0038590431213378906 nb_pixel_total : 147097 time to create 1 rle with old method : 0.21143317222595215 length of segment : 501 time for calcul the mask position with numpy : 0.0026459693908691406 nb_pixel_total : 113285 time to create 1 rle with old method : 0.12482714653015137 length of segment : 491 time for calcul the mask position with numpy : 0.0018231868743896484 nb_pixel_total : 72378 time to create 1 rle with old method : 0.09001398086547852 length of segment : 469 time for calcul the mask position with numpy : 0.0015327930450439453 nb_pixel_total : 38284 time to create 1 rle with old method : 0.05000615119934082 length of segment : 358 time for calcul the mask position with numpy : 0.00385284423828125 nb_pixel_total : 140786 time to create 1 rle with old method : 0.17670083045959473 length of segment : 455 time for calcul the mask position with numpy : 0.0034723281860351562 nb_pixel_total : 140380 time to create 1 rle with old method : 0.15870237350463867 length of segment : 648 time for calcul the mask position with numpy : 0.0017375946044921875 nb_pixel_total : 76720 time to create 1 rle with old method : 0.08970475196838379 length of segment : 468 time for calcul the mask position with numpy : 0.001232147216796875 nb_pixel_total : 47550 time to create 1 rle with old method : 0.05455350875854492 length of segment : 339 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 67659 time to create 1 rle with old method : 0.07588624954223633 length of segment : 541 time for calcul the mask position with numpy : 0.0015184879302978516 nb_pixel_total : 62899 time to create 1 rle with old method : 0.07228946685791016 length of segment : 291 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 20315 time to create 1 rle with old method : 0.023613452911376953 length of segment : 185 time for calcul the mask position with numpy : 0.0025475025177001953 nb_pixel_total : 87717 time to create 1 rle with old method : 0.10158419609069824 length of segment : 537 time for calcul the mask position with numpy : 0.0008230209350585938 nb_pixel_total : 27585 time to create 1 rle with old method : 0.03173232078552246 length of segment : 227 time for calcul the mask position with numpy : 0.0006930828094482422 nb_pixel_total : 27505 time to create 1 rle with old method : 0.03135180473327637 length of segment : 231 time for calcul the mask position with numpy : 0.0016827583312988281 nb_pixel_total : 95468 time to create 1 rle with old method : 0.10620808601379395 length of segment : 356 time for calcul the mask position with numpy : 0.006424665451049805 nb_pixel_total : 295972 time to create 1 rle with new method : 0.016463279724121094 length of segment : 646 time for calcul the mask position with numpy : 0.005076169967651367 nb_pixel_total : 187652 time to create 1 rle with new method : 0.03350019454956055 length of segment : 736 time for calcul the mask position with numpy : 0.001165151596069336 nb_pixel_total : 51501 time to create 1 rle with old method : 0.056630849838256836 length of segment : 236 time for calcul the mask position with numpy : 0.002924203872680664 nb_pixel_total : 134212 time to create 1 rle with old method : 0.15004324913024902 length of segment : 483 time for calcul the mask position with numpy : 0.0004639625549316406 nb_pixel_total : 12854 time to create 1 rle with old method : 0.015083551406860352 length of segment : 130 time for calcul the mask position with numpy : 0.002157926559448242 nb_pixel_total : 62595 time to create 1 rle with old method : 0.07240915298461914 length of segment : 234 time for calcul the mask position with numpy : 0.016750574111938477 nb_pixel_total : 427126 time to create 1 rle with new method : 0.04323148727416992 length of segment : 1203 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 47694 time to create 1 rle with old method : 0.05414319038391113 length of segment : 337 time for calcul the mask position with numpy : 0.0044384002685546875 nb_pixel_total : 201973 time to create 1 rle with new method : 0.016318798065185547 length of segment : 935 time for calcul the mask position with numpy : 0.0028765201568603516 nb_pixel_total : 108508 time to create 1 rle with old method : 0.12209820747375488 length of segment : 504 time for calcul the mask position with numpy : 0.0020475387573242188 nb_pixel_total : 67977 time to create 1 rle with old method : 0.0765388011932373 length of segment : 278 time for calcul the mask position with numpy : 0.0006742477416992188 nb_pixel_total : 21818 time to create 1 rle with old method : 0.0252227783203125 length of segment : 237 time for calcul the mask position with numpy : 0.008923768997192383 nb_pixel_total : 335696 time to create 1 rle with new method : 0.024416446685791016 length of segment : 771 time for calcul the mask position with numpy : 0.0033693313598632812 nb_pixel_total : 181764 time to create 1 rle with new method : 0.008979558944702148 length of segment : 386 time for calcul the mask position with numpy : 0.0006930828094482422 nb_pixel_total : 25492 time to create 1 rle with old method : 0.028566598892211914 length of segment : 190 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 37568 time to create 1 rle with old method : 0.04166865348815918 length of segment : 222 time for calcul the mask position with numpy : 0.0005581378936767578 nb_pixel_total : 24492 time to create 1 rle with old method : 0.02777385711669922 length of segment : 170 time for calcul the mask position with numpy : 0.0013279914855957031 nb_pixel_total : 49509 time to create 1 rle with old method : 0.0547335147857666 length of segment : 338 time for calcul the mask position with numpy : 0.002285003662109375 nb_pixel_total : 100243 time to create 1 rle with old method : 0.11290621757507324 length of segment : 436 time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 52939 time to create 1 rle with old method : 0.05791926383972168 length of segment : 208 time for calcul the mask position with numpy : 0.00532221794128418 nb_pixel_total : 197611 time to create 1 rle with new method : 0.01576089859008789 length of segment : 600 time for calcul the mask position with numpy : 0.004347801208496094 nb_pixel_total : 154960 time to create 1 rle with new method : 0.012827873229980469 length of segment : 623 time for calcul the mask position with numpy : 0.0013623237609863281 nb_pixel_total : 56032 time to create 1 rle with old method : 0.06432294845581055 length of segment : 243 time for calcul the mask position with numpy : 0.017818450927734375 nb_pixel_total : 571230 time to create 1 rle with new method : 0.053850650787353516 length of segment : 928 time for calcul the mask position with numpy : 0.03157830238342285 nb_pixel_total : 1074419 time to create 1 rle with new method : 0.20639944076538086 length of segment : 1016 time for calcul the mask position with numpy : 0.0025022029876708984 nb_pixel_total : 94788 time to create 1 rle with old method : 0.13343524932861328 length of segment : 308 time for calcul the mask position with numpy : 0.020752906799316406 nb_pixel_total : 317860 time to create 1 rle with new method : 0.03309774398803711 length of segment : 759 time for calcul the mask position with numpy : 0.0017881393432617188 nb_pixel_total : 28784 time to create 1 rle with old method : 0.03864741325378418 length of segment : 133 time for calcul the mask position with numpy : 0.0016789436340332031 nb_pixel_total : 29547 time to create 1 rle with old method : 0.05638432502746582 length of segment : 246 time for calcul the mask position with numpy : 0.05044221878051758 nb_pixel_total : 1250454 time to create 1 rle with new method : 0.5151548385620117 length of segment : 1769 time for calcul the mask position with numpy : 0.013469219207763672 nb_pixel_total : 544301 time to create 1 rle with new method : 0.03292512893676758 length of segment : 948 time for calcul the mask position with numpy : 0.008199930191040039 nb_pixel_total : 333000 time to create 1 rle with new method : 0.03359508514404297 length of segment : 753 time for calcul the mask position with numpy : 0.002239704132080078 nb_pixel_total : 84946 time to create 1 rle with old method : 0.0989389419555664 length of segment : 401 time for calcul the mask position with numpy : 0.024820804595947266 nb_pixel_total : 910362 time to create 1 rle with new method : 0.0950157642364502 length of segment : 906 time for calcul the mask position with numpy : 0.020862102508544922 nb_pixel_total : 912196 time to create 1 rle with new method : 0.1223292350769043 length of segment : 889 time for calcul the mask position with numpy : 0.002377033233642578 nb_pixel_total : 94208 time to create 1 rle with old method : 0.10723662376403809 length of segment : 462 time for calcul the mask position with numpy : 0.002848386764526367 nb_pixel_total : 149486 time to create 1 rle with old method : 0.16206908226013184 length of segment : 424 time for calcul the mask position with numpy : 0.0009965896606445312 nb_pixel_total : 12605 time to create 1 rle with old method : 0.014261722564697266 length of segment : 109 time for calcul the mask position with numpy : 0.016516923904418945 nb_pixel_total : 338340 time to create 1 rle with new method : 0.024170398712158203 length of segment : 929 time for calcul the mask position with numpy : 0.0045015811920166016 nb_pixel_total : 220350 time to create 1 rle with new method : 0.013906478881835938 length of segment : 449 time for calcul the mask position with numpy : 0.002044677734375 nb_pixel_total : 90644 time to create 1 rle with old method : 0.1375575065612793 length of segment : 232 time for calcul the mask position with numpy : 0.03145718574523926 nb_pixel_total : 1002712 time to create 1 rle with new method : 0.27072954177856445 length of segment : 1347 time for calcul the mask position with numpy : 0.022579193115234375 nb_pixel_total : 1067546 time to create 1 rle with new method : 0.17476725578308105 length of segment : 1477 time for calcul the mask position with numpy : 0.0015010833740234375 nb_pixel_total : 77493 time to create 1 rle with old method : 0.08653807640075684 length of segment : 372 time for calcul the mask position with numpy : 0.004136562347412109 nb_pixel_total : 174892 time to create 1 rle with new method : 0.01140904426574707 length of segment : 406 time for calcul the mask position with numpy : 0.0017559528350830078 nb_pixel_total : 82116 time to create 1 rle with old method : 0.09137821197509766 length of segment : 338 time for calcul the mask position with numpy : 0.005643606185913086 nb_pixel_total : 151858 time to create 1 rle with new method : 0.01892375946044922 length of segment : 681 time for calcul the mask position with numpy : 0.005776882171630859 nb_pixel_total : 226022 time to create 1 rle with new method : 0.02028965950012207 length of segment : 739 time for calcul the mask position with numpy : 0.00208282470703125 nb_pixel_total : 115552 time to create 1 rle with old method : 0.14999818801879883 length of segment : 319 time for calcul the mask position with numpy : 0.002178192138671875 nb_pixel_total : 46915 time to create 1 rle with old method : 0.07622051239013672 length of segment : 348 time for calcul the mask position with numpy : 0.002713441848754883 nb_pixel_total : 105464 time to create 1 rle with old method : 0.1304762363433838 length of segment : 517 time for calcul the mask position with numpy : 0.007344245910644531 nb_pixel_total : 286848 time to create 1 rle with new method : 0.021573781967163086 length of segment : 1090 time for calcul the mask position with numpy : 0.0026769638061523438 nb_pixel_total : 103827 time to create 1 rle with old method : 0.1399364471435547 length of segment : 502 time for calcul the mask position with numpy : 0.8433868885040283 nb_pixel_total : 8061263 time to create 1 rle with new method : 1.5119976997375488 length of segment : 6010 time for calcul the mask position with numpy : 0.0008983612060546875 nb_pixel_total : 43863 time to create 1 rle with old method : 0.050665855407714844 length of segment : 231 time for calcul the mask position with numpy : 0.0020225048065185547 nb_pixel_total : 154848 time to create 1 rle with new method : 0.004772186279296875 length of segment : 501 time for calcul the mask position with numpy : 0.007510662078857422 nb_pixel_total : 467049 time to create 1 rle with new method : 0.10191917419433594 length of segment : 857 time for calcul the mask position with numpy : 0.1323564052581787 nb_pixel_total : 2610086 time to create 1 rle with new method : 0.25066089630126953 length of segment : 1971 time for calcul the mask position with numpy : 0.0006563663482666016 nb_pixel_total : 39749 time to create 1 rle with old method : 0.04648113250732422 length of segment : 155 time for calcul the mask position with numpy : 0.025427579879760742 nb_pixel_total : 1391140 time to create 1 rle with new method : 0.14476633071899414 length of segment : 1417 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 14417 time to create 1 rle with old method : 0.04532599449157715 length of segment : 210 time for calcul the mask position with numpy : 0.0021212100982666016 nb_pixel_total : 123668 time to create 1 rle with old method : 0.14966917037963867 length of segment : 531 time spent for convertir_results : 107.06956815719604 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 523 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 324.70597863197327 time spend to save output : 0.61203932762146 total time spend for step 2 : 325.3180179595947 step3:blur_detection Mon Mar 10 19:28:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 2094.408929979666 (4160, 3120) 2556.1096941528713 (4160, 3120) 1085.1223692140013 (4160, 3120) 2501.250497416516 (4160, 3120) 1121.3250842258549 (4160, 3120) 1205.4797748878323 (4160, 3120) 2668.1916038357317 (4160, 3120) 304.71827384779033 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.046152591705322266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.04803824424743652 save missing photos in datou_result : time spend for datou_step_exec : 3.6905996799468994 time spend to save output : 0.11506509780883789 total time spend for step 3 : 3.8056647777557373 step4:brightness Mon Mar 10 19:28:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741630890_219453_1342523681_cd7205c74f87c08f94addf2babc4a7e5.jpg treat image : temp/1741630890_219453_1342523678_b94b408b18f383b703d54b1ab5438951.jpg treat image : temp/1741630890_219453_1342523673_25f7a23617c7c72be44a5e7762425356.jpg treat image : temp/1741630890_219453_1342523646_869faf3ef6379d8d7433371a03438ced.jpg treat image : temp/1741630890_219453_1342523642_1dcb69903ec18cbbae7302307daac838.jpg treat image : temp/1741630890_219453_1342523636_6fc85abaaa6749319f1f09154e9ab6a0.jpg treat image : temp/1741630890_219453_1342523632_980503cb6266eed39f120d7d647d2fd0.jpg treat image : temp/1741630890_219453_1342523629_0f098b30d1d5dc9f56ff009406a7441a.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.03964400291442871 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.039955854415893555 save missing photos in datou_result : time spend for datou_step_exec : 14.744937896728516 time spend to save output : 0.09734725952148438 total time spend for step 4 : 14.84228515625 step5:rle_unique_nms_with_priority Mon Mar 10 19:28:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 523 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 62 nb_hashtags : 9 time to prepare the origin masks : 66.52007412910461 time for calcul the mask position with numpy : 0.24884700775146484 nb_pixel_total : 3758152 time to create 1 rle with new method : 1.7322287559509277 time for calcul the mask position with numpy : 0.05195784568786621 nb_pixel_total : 27314 time to create 1 rle with old method : 0.029439210891723633 time for calcul the mask position with numpy : 0.05290675163269043 nb_pixel_total : 31843 time to create 1 rle with old method : 0.03586316108703613 time for calcul the mask position with numpy : 0.053531646728515625 nb_pixel_total : 2797 time to create 1 rle with old method : 0.0036754608154296875 time for calcul the mask position with numpy : 0.053411245346069336 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005449771881103516 time for calcul the mask position with numpy : 0.053521156311035156 nb_pixel_total : 158500 time to create 1 rle with new method : 1.287074327468872 time for calcul the mask position with numpy : 0.05255126953125 nb_pixel_total : 33880 time to create 1 rle with old method : 0.03840065002441406 time for calcul the mask position with numpy : 0.05172371864318848 nb_pixel_total : 11882 time to create 1 rle with old method : 0.012819290161132812 time for calcul the mask position with numpy : 0.05356287956237793 nb_pixel_total : 145100 time to create 1 rle with old method : 0.18442654609680176 time for calcul the mask position with numpy : 0.07289528846740723 nb_pixel_total : 750873 time to create 1 rle with new method : 1.1081457138061523 time for calcul the mask position with numpy : 0.05124092102050781 nb_pixel_total : 6675 time to create 1 rle with old method : 0.007072925567626953 time for calcul the mask position with numpy : 0.05291628837585449 nb_pixel_total : 3957 time to create 1 rle with old method : 0.0046558380126953125 time for calcul the mask position with numpy : 0.053792715072631836 nb_pixel_total : 52476 time to create 1 rle with old method : 0.0600433349609375 time for calcul the mask position with numpy : 0.05811810493469238 nb_pixel_total : 621922 time to create 1 rle with new method : 1.4664373397827148 time for calcul the mask position with numpy : 0.05745077133178711 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005483627319335938 time for calcul the mask position with numpy : 0.052229881286621094 nb_pixel_total : 63599 time to create 1 rle with old method : 0.06937074661254883 time for calcul the mask position with numpy : 0.051732778549194336 nb_pixel_total : 4137 time to create 1 rle with old method : 0.004775524139404297 time for calcul the mask position with numpy : 0.051879167556762695 nb_pixel_total : 18907 time to create 1 rle with old method : 0.02095961570739746 time for calcul the mask position with numpy : 0.07432246208190918 nb_pixel_total : 1335545 time to create 1 rle with new method : 1.0160257816314697 time for calcul the mask position with numpy : 0.05144643783569336 nb_pixel_total : 21736 time to create 1 rle with old method : 0.03384089469909668 time for calcul the mask position with numpy : 0.06413817405700684 nb_pixel_total : 270275 time to create 1 rle with new method : 1.097428560256958 time for calcul the mask position with numpy : 0.05812811851501465 nb_pixel_total : 285241 time to create 1 rle with new method : 0.889718770980835 time for calcul the mask position with numpy : 0.05370306968688965 nb_pixel_total : 87140 time to create 1 rle with old method : 0.09430837631225586 time for calcul the mask position with numpy : 0.05359148979187012 nb_pixel_total : 50829 time to create 1 rle with old method : 0.0579228401184082 time for calcul the mask position with numpy : 0.05196094512939453 nb_pixel_total : 4088 time to create 1 rle with old method : 0.004694223403930664 time for calcul the mask position with numpy : 0.05032515525817871 nb_pixel_total : 1923 time to create 1 rle with old method : 0.00215911865234375 time for calcul the mask position with numpy : 0.05271172523498535 nb_pixel_total : 46635 time to create 1 rle with old method : 0.05001330375671387 time for calcul the mask position with numpy : 0.05402088165283203 nb_pixel_total : 230174 time to create 1 rle with new method : 1.4870643615722656 time for calcul the mask position with numpy : 0.05139517784118652 nb_pixel_total : 26246 time to create 1 rle with old method : 0.0288999080657959 time for calcul the mask position with numpy : 0.05344724655151367 nb_pixel_total : 100183 time to create 1 rle with old method : 0.10946154594421387 time for calcul the mask position with numpy : 0.05606579780578613 nb_pixel_total : 2322 time to create 1 rle with old method : 0.0029489994049072266 time for calcul the mask position with numpy : 0.05380511283874512 nb_pixel_total : 57793 time to create 1 rle with old method : 0.0632176399230957 time for calcul the mask position with numpy : 0.054934024810791016 nb_pixel_total : 97896 time to create 1 rle with old method : 0.12688112258911133 time for calcul the mask position with numpy : 0.059792518615722656 nb_pixel_total : 2382 time to create 1 rle with old method : 0.002766132354736328 time for calcul the mask position with numpy : 0.05468440055847168 nb_pixel_total : 118130 time to create 1 rle with old method : 0.13077783584594727 time for calcul the mask position with numpy : 0.058423757553100586 nb_pixel_total : 17221 time to create 1 rle with old method : 0.02004075050354004 time for calcul the mask position with numpy : 0.06211543083190918 nb_pixel_total : 266000 time to create 1 rle with new method : 1.09373140335083 time for calcul the mask position with numpy : 0.05441761016845703 nb_pixel_total : 111763 time to create 1 rle with old method : 0.12975597381591797 time for calcul the mask position with numpy : 0.05397963523864746 nb_pixel_total : 110989 time to create 1 rle with old method : 0.12198448181152344 time for calcul the mask position with numpy : 0.05560421943664551 nb_pixel_total : 58727 time to create 1 rle with old method : 0.06428766250610352 time for calcul the mask position with numpy : 0.05318784713745117 nb_pixel_total : 20580 time to create 1 rle with old method : 0.023401498794555664 time for calcul the mask position with numpy : 0.053388357162475586 nb_pixel_total : 8642 time to create 1 rle with old method : 0.010239601135253906 time for calcul the mask position with numpy : 0.05711555480957031 nb_pixel_total : 64058 time to create 1 rle with old method : 0.07302618026733398 time for calcul the mask position with numpy : 0.05595088005065918 nb_pixel_total : 314179 time to create 1 rle with new method : 0.8061685562133789 time for calcul the mask position with numpy : 0.06316900253295898 nb_pixel_total : 756660 time to create 1 rle with new method : 0.6902143955230713 time for calcul the mask position with numpy : 0.05340933799743652 nb_pixel_total : 125213 time to create 1 rle with old method : 0.14460086822509766 time for calcul the mask position with numpy : 0.05471920967102051 nb_pixel_total : 204998 time to create 1 rle with new method : 1.0277841091156006 time for calcul the mask position with numpy : 0.054000139236450195 nb_pixel_total : 90026 time to create 1 rle with old method : 0.10139203071594238 time for calcul the mask position with numpy : 0.05261707305908203 nb_pixel_total : 12378 time to create 1 rle with old method : 0.013832807540893555 time for calcul the mask position with numpy : 0.059201955795288086 nb_pixel_total : 79660 time to create 1 rle with old method : 0.09184527397155762 time for calcul the mask position with numpy : 0.05298328399658203 nb_pixel_total : 18 time to create 1 rle with old method : 7.939338684082031e-05 time for calcul the mask position with numpy : 0.06483054161071777 nb_pixel_total : 1504869 time to create 1 rle with new method : 0.9776132106781006 time for calcul the mask position with numpy : 0.07415246963500977 nb_pixel_total : 47093 time to create 1 rle with old method : 0.08872222900390625 time for calcul the mask position with numpy : 0.07397651672363281 nb_pixel_total : 37652 time to create 1 rle with old method : 0.06776642799377441 time for calcul the mask position with numpy : 0.06355023384094238 nb_pixel_total : 71786 time to create 1 rle with old method : 0.08512687683105469 time for calcul the mask position with numpy : 0.05466651916503906 nb_pixel_total : 164689 time to create 1 rle with new method : 0.8117544651031494 time for calcul the mask position with numpy : 0.05239987373352051 nb_pixel_total : 170984 time to create 1 rle with new method : 0.9885985851287842 time for calcul the mask position with numpy : 0.053527116775512695 nb_pixel_total : 39999 time to create 1 rle with old method : 0.04780411720275879 time for calcul the mask position with numpy : 0.058294057846069336 nb_pixel_total : 125801 time to create 1 rle with old method : 0.16600537300109863 time for calcul the mask position with numpy : 0.05550670623779297 nb_pixel_total : 690 time to create 1 rle with old method : 0.0011916160583496094 time for calcul the mask position with numpy : 0.05491209030151367 nb_pixel_total : 14496 time to create 1 rle with old method : 0.017142534255981445 time for calcul the mask position with numpy : 0.056265830993652344 nb_pixel_total : 92974 time to create 1 rle with old method : 0.11423659324645996 time for calcul the mask position with numpy : 0.05383181571960449 nb_pixel_total : 31279 time to create 1 rle with old method : 0.03590583801269531 create new chi : 23.616992235183716 time to delete rle : 0.04305291175842285 batch 1 Loaded 63 chid ids of type : 4855 Number RLEs to save : 54094 TO DO : save crop sub photo not yet done ! save time : 5.763595104217529 nb_obj : 53 nb_hashtags : 8 time to prepare the origin masks : 49.97597098350525 time for calcul the mask position with numpy : 0.41248297691345215 nb_pixel_total : 4478500 time to create 1 rle with new method : 0.8101942539215088 time for calcul the mask position with numpy : 0.054813385009765625 nb_pixel_total : 31723 time to create 1 rle with old method : 0.03501296043395996 time for calcul the mask position with numpy : 0.05505871772766113 nb_pixel_total : 66547 time to create 1 rle with old method : 0.07382512092590332 time for calcul the mask position with numpy : 0.054981231689453125 nb_pixel_total : 68252 time to create 1 rle with old method : 0.07605457305908203 time for calcul the mask position with numpy : 0.055321455001831055 nb_pixel_total : 6994 time to create 1 rle with old method : 0.012042760848999023 time for calcul the mask position with numpy : 0.060465335845947266 nb_pixel_total : 47122 time to create 1 rle with old method : 0.05211472511291504 time for calcul the mask position with numpy : 0.05644536018371582 nb_pixel_total : 288807 time to create 1 rle with new method : 0.8484060764312744 time for calcul the mask position with numpy : 0.052700042724609375 nb_pixel_total : 191232 time to create 1 rle with new method : 0.9402921199798584 time for calcul the mask position with numpy : 0.05426311492919922 nb_pixel_total : 71819 time to create 1 rle with old method : 0.07934141159057617 time for calcul the mask position with numpy : 0.05471181869506836 nb_pixel_total : 248719 time to create 1 rle with new method : 0.6590523719787598 time for calcul the mask position with numpy : 0.05796957015991211 nb_pixel_total : 162247 time to create 1 rle with new method : 0.7683484554290771 time for calcul the mask position with numpy : 0.06388354301452637 nb_pixel_total : 231783 time to create 1 rle with new method : 0.7681024074554443 time for calcul the mask position with numpy : 0.05371689796447754 nb_pixel_total : 77790 time to create 1 rle with old method : 0.08451294898986816 time for calcul the mask position with numpy : 0.05378532409667969 nb_pixel_total : 108932 time to create 1 rle with old method : 0.12066984176635742 time for calcul the mask position with numpy : 0.05330777168273926 nb_pixel_total : 139737 time to create 1 rle with old method : 0.15445518493652344 time for calcul the mask position with numpy : 0.05328059196472168 nb_pixel_total : 74279 time to create 1 rle with old method : 0.08142709732055664 time for calcul the mask position with numpy : 0.052895307540893555 nb_pixel_total : 45266 time to create 1 rle with old method : 0.04925870895385742 time for calcul the mask position with numpy : 0.05270195007324219 nb_pixel_total : 140029 time to create 1 rle with old method : 0.15538573265075684 time for calcul the mask position with numpy : 0.05812859535217285 nb_pixel_total : 277752 time to create 1 rle with new method : 0.9938035011291504 time for calcul the mask position with numpy : 0.05339932441711426 nb_pixel_total : 51606 time to create 1 rle with old method : 0.05829191207885742 time for calcul the mask position with numpy : 0.05288290977478027 nb_pixel_total : 66182 time to create 1 rle with old method : 0.07128643989562988 time for calcul the mask position with numpy : 0.05204176902770996 nb_pixel_total : 9508 time to create 1 rle with old method : 0.012342691421508789 time for calcul the mask position with numpy : 0.06252527236938477 nb_pixel_total : 72903 time to create 1 rle with old method : 0.08483004570007324 time for calcul the mask position with numpy : 0.06211042404174805 nb_pixel_total : 534685 time to create 1 rle with new method : 0.8422327041625977 time for calcul the mask position with numpy : 0.056792259216308594 nb_pixel_total : 63055 time to create 1 rle with old method : 0.06887102127075195 time for calcul the mask position with numpy : 0.05746102333068848 nb_pixel_total : 554172 time to create 1 rle with new method : 0.8522017002105713 time for calcul the mask position with numpy : 0.05475449562072754 nb_pixel_total : 66273 time to create 1 rle with old method : 0.07489681243896484 time for calcul the mask position with numpy : 0.05431175231933594 nb_pixel_total : 147168 time to create 1 rle with old method : 0.1695401668548584 time for calcul the mask position with numpy : 0.055342674255371094 nb_pixel_total : 332381 time to create 1 rle with new method : 1.2916123867034912 time for calcul the mask position with numpy : 0.05619955062866211 nb_pixel_total : 158195 time to create 1 rle with new method : 0.6773028373718262 time for calcul the mask position with numpy : 0.05365490913391113 nb_pixel_total : 118135 time to create 1 rle with old method : 0.13768839836120605 time for calcul the mask position with numpy : 0.058626651763916016 nb_pixel_total : 548237 time to create 1 rle with new method : 0.9600496292114258 time for calcul the mask position with numpy : 0.06080436706542969 nb_pixel_total : 5652 time to create 1 rle with old method : 0.0068817138671875 time for calcul the mask position with numpy : 0.05587935447692871 nb_pixel_total : 43559 time to create 1 rle with old method : 0.05186772346496582 time for calcul the mask position with numpy : 0.05425429344177246 nb_pixel_total : 169 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.05731654167175293 nb_pixel_total : 245678 time to create 1 rle with new method : 0.7982175350189209 time for calcul the mask position with numpy : 0.05442380905151367 nb_pixel_total : 92227 time to create 1 rle with old method : 0.10354924201965332 time for calcul the mask position with numpy : 0.05405449867248535 nb_pixel_total : 23747 time to create 1 rle with old method : 0.02674579620361328 time for calcul the mask position with numpy : 0.0549929141998291 nb_pixel_total : 32412 time to create 1 rle with old method : 0.04169750213623047 time for calcul the mask position with numpy : 0.05561494827270508 nb_pixel_total : 49000 time to create 1 rle with old method : 0.05680441856384277 time for calcul the mask position with numpy : 0.05535602569580078 nb_pixel_total : 65607 time to create 1 rle with old method : 0.07528495788574219 time for calcul the mask position with numpy : 0.06836104393005371 nb_pixel_total : 1399162 time to create 1 rle with new method : 0.8432114124298096 time for calcul the mask position with numpy : 0.06177854537963867 nb_pixel_total : 309231 time to create 1 rle with new method : 1.0985710620880127 time for calcul the mask position with numpy : 0.05687665939331055 nb_pixel_total : 7699 time to create 1 rle with old method : 0.010246753692626953 time for calcul the mask position with numpy : 0.05594611167907715 nb_pixel_total : 18184 time to create 1 rle with old method : 0.023075103759765625 time for calcul the mask position with numpy : 0.06763863563537598 nb_pixel_total : 555752 time to create 1 rle with new method : 1.2121760845184326 time for calcul the mask position with numpy : 0.07581639289855957 nb_pixel_total : 391832 time to create 1 rle with new method : 1.8615608215332031 time for calcul the mask position with numpy : 0.06087136268615723 nb_pixel_total : 84215 time to create 1 rle with old method : 0.10085821151733398 time for calcul the mask position with numpy : 0.05543017387390137 nb_pixel_total : 29768 time to create 1 rle with old method : 0.03553128242492676 time for calcul the mask position with numpy : 0.05543017387390137 nb_pixel_total : 10751 time to create 1 rle with old method : 0.01856374740600586 time for calcul the mask position with numpy : 0.0633995532989502 nb_pixel_total : 42290 time to create 1 rle with old method : 0.04991769790649414 time for calcul the mask position with numpy : 0.05603528022766113 nb_pixel_total : 32083 time to create 1 rle with old method : 0.037981510162353516 time for calcul the mask position with numpy : 0.054477691650390625 nb_pixel_total : 23049 time to create 1 rle with old method : 0.026816844940185547 time for calcul the mask position with numpy : 0.05719566345214844 nb_pixel_total : 37103 time to create 1 rle with old method : 0.041072845458984375 create new chi : 22.81762981414795 time to delete rle : 0.007206916809082031 batch 1 Loaded 54 chid ids of type : 4855 Number RLEs to save : 56456 TO DO : save crop sub photo not yet done ! save time : 8.191580772399902 nb_obj : 69 nb_hashtags : 10 time to prepare the origin masks : 55.97465252876282 time for calcul the mask position with numpy : 0.4841432571411133 nb_pixel_total : 3286744 time to create 1 rle with new method : 1.1039721965789795 time for calcul the mask position with numpy : 0.05907440185546875 nb_pixel_total : 18025 time to create 1 rle with old method : 0.02953338623046875 time for calcul the mask position with numpy : 0.061376333236694336 nb_pixel_total : 21588 time to create 1 rle with old method : 0.026149272918701172 time for calcul the mask position with numpy : 0.05386948585510254 nb_pixel_total : 20137 time to create 1 rle with old method : 0.02384781837463379 time for calcul the mask position with numpy : 0.05512118339538574 nb_pixel_total : 65963 time to create 1 rle with old method : 0.0759134292602539 time for calcul the mask position with numpy : 0.05473518371582031 nb_pixel_total : 62791 time to create 1 rle with old method : 0.07002544403076172 time for calcul the mask position with numpy : 0.054152488708496094 nb_pixel_total : 41362 time to create 1 rle with old method : 0.04948854446411133 time for calcul the mask position with numpy : 0.053395986557006836 nb_pixel_total : 2583 time to create 1 rle with old method : 0.0029430389404296875 time for calcul the mask position with numpy : 0.053786516189575195 nb_pixel_total : 121267 time to create 1 rle with old method : 0.13791894912719727 time for calcul the mask position with numpy : 0.05630826950073242 nb_pixel_total : 134318 time to create 1 rle with old method : 0.15759038925170898 time for calcul the mask position with numpy : 0.05220627784729004 nb_pixel_total : 26939 time to create 1 rle with old method : 0.030058860778808594 time for calcul the mask position with numpy : 0.05453777313232422 nb_pixel_total : 73836 time to create 1 rle with old method : 0.08769941329956055 time for calcul the mask position with numpy : 0.06402254104614258 nb_pixel_total : 331035 time to create 1 rle with new method : 0.8635482788085938 time for calcul the mask position with numpy : 0.06017184257507324 nb_pixel_total : 241572 time to create 1 rle with new method : 1.0428078174591064 time for calcul the mask position with numpy : 0.05312800407409668 nb_pixel_total : 13825 time to create 1 rle with old method : 0.018810749053955078 time for calcul the mask position with numpy : 0.0532221794128418 nb_pixel_total : 129643 time to create 1 rle with old method : 0.15097737312316895 time for calcul the mask position with numpy : 0.05361151695251465 nb_pixel_total : 107558 time to create 1 rle with old method : 0.1172177791595459 time for calcul the mask position with numpy : 0.05273270606994629 nb_pixel_total : 75578 time to create 1 rle with old method : 0.08163118362426758 time for calcul the mask position with numpy : 0.0543515682220459 nb_pixel_total : 18166 time to create 1 rle with old method : 0.021117448806762695 time for calcul the mask position with numpy : 0.0541384220123291 nb_pixel_total : 104753 time to create 1 rle with old method : 0.14115095138549805 time for calcul the mask position with numpy : 0.053588151931762695 nb_pixel_total : 28240 time to create 1 rle with old method : 0.03172612190246582 time for calcul the mask position with numpy : 0.2645223140716553 nb_pixel_total : 1921990 time to create 1 rle with new method : 0.6582787036895752 time for calcul the mask position with numpy : 0.053018808364868164 nb_pixel_total : 12552 time to create 1 rle with old method : 0.01437997817993164 time for calcul the mask position with numpy : 0.05403757095336914 nb_pixel_total : 92661 time to create 1 rle with old method : 0.10457396507263184 time for calcul the mask position with numpy : 0.06396889686584473 nb_pixel_total : 9259 time to create 1 rle with old method : 0.011010885238647461 time for calcul the mask position with numpy : 0.05312919616699219 nb_pixel_total : 33907 time to create 1 rle with old method : 0.03655838966369629 time for calcul the mask position with numpy : 0.057224273681640625 nb_pixel_total : 338995 time to create 1 rle with new method : 0.9616494178771973 time for calcul the mask position with numpy : 0.05901288986206055 nb_pixel_total : 154055 time to create 1 rle with new method : 1.0831701755523682 time for calcul the mask position with numpy : 0.058402061462402344 nb_pixel_total : 7369 time to create 1 rle with old method : 0.009837150573730469 time for calcul the mask position with numpy : 0.05572199821472168 nb_pixel_total : 26825 time to create 1 rle with old method : 0.030806541442871094 time for calcul the mask position with numpy : 0.05359244346618652 nb_pixel_total : 1648 time to create 1 rle with old method : 0.0020046234130859375 time for calcul the mask position with numpy : 0.05492854118347168 nb_pixel_total : 10457 time to create 1 rle with old method : 0.01258397102355957 time for calcul the mask position with numpy : 0.054315805435180664 nb_pixel_total : 1713 time to create 1 rle with old method : 0.0021741390228271484 time for calcul the mask position with numpy : 0.053803205490112305 nb_pixel_total : 28647 time to create 1 rle with old method : 0.03339076042175293 time for calcul the mask position with numpy : 0.060076236724853516 nb_pixel_total : 51149 time to create 1 rle with old method : 0.08229517936706543 time for calcul the mask position with numpy : 0.0689995288848877 nb_pixel_total : 65902 time to create 1 rle with old method : 0.09486532211303711 time for calcul the mask position with numpy : 0.05477166175842285 nb_pixel_total : 170247 time to create 1 rle with new method : 1.0248229503631592 time for calcul the mask position with numpy : 0.05756187438964844 nb_pixel_total : 86703 time to create 1 rle with old method : 0.09778070449829102 time for calcul the mask position with numpy : 0.0540008544921875 nb_pixel_total : 69807 time to create 1 rle with old method : 0.07744193077087402 time for calcul the mask position with numpy : 0.053487300872802734 nb_pixel_total : 250505 time to create 1 rle with new method : 0.9136562347412109 time for calcul the mask position with numpy : 0.05289793014526367 nb_pixel_total : 1198 time to create 1 rle with old method : 0.001699686050415039 time for calcul the mask position with numpy : 0.053349971771240234 nb_pixel_total : 72520 time to create 1 rle with old method : 0.10064220428466797 time for calcul the mask position with numpy : 0.05636239051818848 nb_pixel_total : 8437 time to create 1 rle with old method : 0.009442329406738281 time for calcul the mask position with numpy : 0.0571441650390625 nb_pixel_total : 412316 time to create 1 rle with new method : 0.8995463848114014 time for calcul the mask position with numpy : 0.054586172103881836 nb_pixel_total : 134313 time to create 1 rle with old method : 0.15508270263671875 time for calcul the mask position with numpy : 0.0592648983001709 nb_pixel_total : 626945 time to create 1 rle with new method : 0.733461856842041 time for calcul the mask position with numpy : 0.053424835205078125 nb_pixel_total : 3968 time to create 1 rle with old method : 0.005174398422241211 time for calcul the mask position with numpy : 0.053381919860839844 nb_pixel_total : 5280 time to create 1 rle with old method : 0.0062563419342041016 time for calcul the mask position with numpy : 0.05390739440917969 nb_pixel_total : 10534 time to create 1 rle with old method : 0.012233972549438477 time for calcul the mask position with numpy : 0.05367898941040039 nb_pixel_total : 738 time to create 1 rle with old method : 0.001215219497680664 time for calcul the mask position with numpy : 0.05847334861755371 nb_pixel_total : 137033 time to create 1 rle with old method : 0.16141080856323242 time for calcul the mask position with numpy : 0.05494213104248047 nb_pixel_total : 135141 time to create 1 rle with old method : 0.16910457611083984 time for calcul the mask position with numpy : 0.0592961311340332 nb_pixel_total : 7286 time to create 1 rle with old method : 0.008776426315307617 time for calcul the mask position with numpy : 0.053554534912109375 nb_pixel_total : 1724 time to create 1 rle with old method : 0.002177000045776367 time for calcul the mask position with numpy : 0.053409576416015625 nb_pixel_total : 72676 time to create 1 rle with old method : 0.0837106704711914 time for calcul the mask position with numpy : 0.05643415451049805 nb_pixel_total : 15167 time to create 1 rle with old method : 0.020361900329589844 time for calcul the mask position with numpy : 0.0632028579711914 nb_pixel_total : 132901 time to create 1 rle with old method : 0.17177653312683105 time for calcul the mask position with numpy : 0.0683283805847168 nb_pixel_total : 990798 time to create 1 rle with new method : 1.1890804767608643 time for calcul the mask position with numpy : 0.05584216117858887 nb_pixel_total : 256711 time to create 1 rle with new method : 1.1561236381530762 time for calcul the mask position with numpy : 0.052748918533325195 nb_pixel_total : 80965 time to create 1 rle with old method : 0.0967264175415039 time for calcul the mask position with numpy : 0.06851935386657715 nb_pixel_total : 270368 time to create 1 rle with new method : 1.1929845809936523 time for calcul the mask position with numpy : 0.05472564697265625 nb_pixel_total : 12811 time to create 1 rle with old method : 0.013936758041381836 time for calcul the mask position with numpy : 0.053295135498046875 nb_pixel_total : 1213 time to create 1 rle with old method : 0.0015587806701660156 time for calcul the mask position with numpy : 0.052918195724487305 nb_pixel_total : 144889 time to create 1 rle with old method : 0.16232991218566895 time for calcul the mask position with numpy : 0.05327033996582031 nb_pixel_total : 12021 time to create 1 rle with old method : 0.014346599578857422 time for calcul the mask position with numpy : 0.053453683853149414 nb_pixel_total : 19424 time to create 1 rle with old method : 0.022812604904174805 time for calcul the mask position with numpy : 0.06134605407714844 nb_pixel_total : 1120333 time to create 1 rle with new method : 0.9725701808929443 time for calcul the mask position with numpy : 0.05203127861022949 nb_pixel_total : 10729 time to create 1 rle with old method : 0.01317286491394043 time for calcul the mask position with numpy : 0.05141735076904297 nb_pixel_total : 8439 time to create 1 rle with old method : 0.009999275207519531 time for calcul the mask position with numpy : 0.05190086364746094 nb_pixel_total : 12008 time to create 1 rle with old method : 0.01234889030456543 create new chi : 22.331894397735596 time to delete rle : 0.004171848297119141 batch 1 Loaded 70 chid ids of type : 4855 Number RLEs to save : 52604 TO DO : save crop sub photo not yet done ! save time : 7.699349641799927 nb_obj : 92 nb_hashtags : 10 time to prepare the origin masks : 80.91039896011353 time for calcul the mask position with numpy : 0.28562450408935547 nb_pixel_total : 4655968 time to create 1 rle with new method : 2.1673710346221924 time for calcul the mask position with numpy : 0.05357551574707031 nb_pixel_total : 15727 time to create 1 rle with old method : 0.018571138381958008 time for calcul the mask position with numpy : 0.05508685111999512 nb_pixel_total : 157399 time to create 1 rle with new method : 0.8493940830230713 time for calcul the mask position with numpy : 0.05379056930541992 nb_pixel_total : 938 time to create 1 rle with old method : 0.0012247562408447266 time for calcul the mask position with numpy : 0.0541989803314209 nb_pixel_total : 22209 time to create 1 rle with old method : 0.02590799331665039 time for calcul the mask position with numpy : 0.05412912368774414 nb_pixel_total : 82134 time to create 1 rle with old method : 0.09441590309143066 time for calcul the mask position with numpy : 0.053934335708618164 nb_pixel_total : 36999 time to create 1 rle with old method : 0.15651655197143555 time for calcul the mask position with numpy : 0.05360865592956543 nb_pixel_total : 38794 time to create 1 rle with old method : 0.045070648193359375 time for calcul the mask position with numpy : 0.05228018760681152 nb_pixel_total : 88265 time to create 1 rle with old method : 0.09627532958984375 time for calcul the mask position with numpy : 0.05370354652404785 nb_pixel_total : 156471 time to create 1 rle with new method : 1.0587949752807617 time for calcul the mask position with numpy : 0.06370067596435547 nb_pixel_total : 261103 time to create 1 rle with new method : 0.8373739719390869 time for calcul the mask position with numpy : 0.06890344619750977 nb_pixel_total : 1092 time to create 1 rle with old method : 0.002344369888305664 time for calcul the mask position with numpy : 0.07197093963623047 nb_pixel_total : 126883 time to create 1 rle with old method : 0.1456286907196045 time for calcul the mask position with numpy : 0.0572965145111084 nb_pixel_total : 89546 time to create 1 rle with old method : 0.1033480167388916 time for calcul the mask position with numpy : 0.054071664810180664 nb_pixel_total : 19552 time to create 1 rle with old method : 0.024146318435668945 time for calcul the mask position with numpy : 0.05441546440124512 nb_pixel_total : 76450 time to create 1 rle with old method : 0.08921575546264648 time for calcul the mask position with numpy : 0.05457353591918945 nb_pixel_total : 309 time to create 1 rle with old method : 0.0006616115570068359 time for calcul the mask position with numpy : 0.05358695983886719 nb_pixel_total : 19489 time to create 1 rle with old method : 0.023148536682128906 time for calcul the mask position with numpy : 0.054982900619506836 nb_pixel_total : 140036 time to create 1 rle with old method : 0.19346165657043457 time for calcul the mask position with numpy : 0.07367062568664551 nb_pixel_total : 2748 time to create 1 rle with old method : 0.0032944679260253906 time for calcul the mask position with numpy : 0.0545194149017334 nb_pixel_total : 59914 time to create 1 rle with old method : 0.0670466423034668 time for calcul the mask position with numpy : 0.05364251136779785 nb_pixel_total : 5967 time to create 1 rle with old method : 0.006707668304443359 time for calcul the mask position with numpy : 0.07047176361083984 nb_pixel_total : 463089 time to create 1 rle with new method : 0.893294095993042 time for calcul the mask position with numpy : 0.05358481407165527 nb_pixel_total : 55224 time to create 1 rle with old method : 0.06029367446899414 time for calcul the mask position with numpy : 0.05348014831542969 nb_pixel_total : 64225 time to create 1 rle with old method : 0.06870675086975098 time for calcul the mask position with numpy : 0.05329155921936035 nb_pixel_total : 166299 time to create 1 rle with new method : 0.9546029567718506 time for calcul the mask position with numpy : 0.05503964424133301 nb_pixel_total : 252191 time to create 1 rle with new method : 1.991694688796997 time for calcul the mask position with numpy : 0.06641197204589844 nb_pixel_total : 214553 time to create 1 rle with new method : 1.3552098274230957 time for calcul the mask position with numpy : 0.06414318084716797 nb_pixel_total : 18836 time to create 1 rle with old method : 0.022207975387573242 time for calcul the mask position with numpy : 0.05487704277038574 nb_pixel_total : 14355 time to create 1 rle with old method : 0.017274856567382812 time for calcul the mask position with numpy : 0.061371564865112305 nb_pixel_total : 199230 time to create 1 rle with new method : 1.0987098217010498 time for calcul the mask position with numpy : 0.05507946014404297 nb_pixel_total : 34036 time to create 1 rle with old method : 0.03988337516784668 time for calcul the mask position with numpy : 0.054290056228637695 nb_pixel_total : 51115 time to create 1 rle with old method : 0.06971621513366699 time for calcul the mask position with numpy : 0.06074333190917969 nb_pixel_total : 98188 time to create 1 rle with old method : 0.11016845703125 time for calcul the mask position with numpy : 0.05513334274291992 nb_pixel_total : 364582 time to create 1 rle with new method : 2.1689939498901367 time for calcul the mask position with numpy : 0.05654263496398926 nb_pixel_total : 7679 time to create 1 rle with old method : 0.009783506393432617 time for calcul the mask position with numpy : 0.06109499931335449 nb_pixel_total : 60804 time to create 1 rle with old method : 0.07338595390319824 time for calcul the mask position with numpy : 0.05381488800048828 nb_pixel_total : 74475 time to create 1 rle with old method : 0.0878603458404541 time for calcul the mask position with numpy : 0.05749964714050293 nb_pixel_total : 109914 time to create 1 rle with old method : 0.13318490982055664 time for calcul the mask position with numpy : 0.055315256118774414 nb_pixel_total : 9746 time to create 1 rle with old method : 0.011187553405761719 time for calcul the mask position with numpy : 0.054143428802490234 nb_pixel_total : 27641 time to create 1 rle with old method : 0.03948616981506348 time for calcul the mask position with numpy : 0.061974287033081055 nb_pixel_total : 787 time to create 1 rle with old method : 0.0009534358978271484 time for calcul the mask position with numpy : 0.06479549407958984 nb_pixel_total : 55927 time to create 1 rle with old method : 0.08321833610534668 time for calcul the mask position with numpy : 0.05369377136230469 nb_pixel_total : 36 time to create 1 rle with old method : 0.0002467632293701172 time for calcul the mask position with numpy : 0.05791020393371582 nb_pixel_total : 26542 time to create 1 rle with old method : 0.030070066452026367 time for calcul the mask position with numpy : 0.060272216796875 nb_pixel_total : 51910 time to create 1 rle with old method : 0.05681920051574707 time for calcul the mask position with numpy : 0.05419516563415527 nb_pixel_total : 48774 time to create 1 rle with old method : 0.05526900291442871 time for calcul the mask position with numpy : 0.07545757293701172 nb_pixel_total : 879411 time to create 1 rle with new method : 1.5366487503051758 time for calcul the mask position with numpy : 0.054741621017456055 nb_pixel_total : 93397 time to create 1 rle with old method : 0.10913348197937012 time for calcul the mask position with numpy : 0.05350661277770996 nb_pixel_total : 23913 time to create 1 rle with old method : 0.02534937858581543 time for calcul the mask position with numpy : 0.053848981857299805 nb_pixel_total : 9345 time to create 1 rle with old method : 0.010544061660766602 time for calcul the mask position with numpy : 0.05393075942993164 nb_pixel_total : 63915 time to create 1 rle with old method : 0.0697019100189209 time for calcul the mask position with numpy : 0.0575101375579834 nb_pixel_total : 100720 time to create 1 rle with old method : 0.11084222793579102 time for calcul the mask position with numpy : 0.05539584159851074 nb_pixel_total : 671 time to create 1 rle with old method : 0.0016663074493408203 time for calcul the mask position with numpy : 0.06142759323120117 nb_pixel_total : 24340 time to create 1 rle with old method : 0.02723383903503418 time for calcul the mask position with numpy : 0.05139899253845215 nb_pixel_total : 38065 time to create 1 rle with old method : 0.04150080680847168 time for calcul the mask position with numpy : 0.060565948486328125 nb_pixel_total : 176390 time to create 1 rle with new method : 0.9028806686401367 time for calcul the mask position with numpy : 0.05383467674255371 nb_pixel_total : 4705 time to create 1 rle with old method : 0.005646467208862305 time for calcul the mask position with numpy : 0.05360889434814453 nb_pixel_total : 21250 time to create 1 rle with old method : 0.02389836311340332 time for calcul the mask position with numpy : 0.05373692512512207 nb_pixel_total : 17385 time to create 1 rle with old method : 0.020708799362182617 time for calcul the mask position with numpy : 0.0528264045715332 nb_pixel_total : 29578 time to create 1 rle with old method : 0.03309893608093262 time for calcul the mask position with numpy : 0.0540313720703125 nb_pixel_total : 61538 time to create 1 rle with old method : 0.06834197044372559 time for calcul the mask position with numpy : 0.05678868293762207 nb_pixel_total : 188693 time to create 1 rle with new method : 0.914259672164917 time for calcul the mask position with numpy : 0.057157278060913086 nb_pixel_total : 372263 time to create 1 rle with new method : 1.2464573383331299 time for calcul the mask position with numpy : 0.06036710739135742 nb_pixel_total : 119 time to create 1 rle with old method : 0.0003795623779296875 time for calcul the mask position with numpy : 0.05599689483642578 nb_pixel_total : 6409 time to create 1 rle with old method : 0.0070760250091552734 time for calcul the mask position with numpy : 0.05915236473083496 nb_pixel_total : 2998 time to create 1 rle with old method : 0.003962039947509766 time for calcul the mask position with numpy : 0.0553438663482666 nb_pixel_total : 187943 time to create 1 rle with new method : 1.1759624481201172 time for calcul the mask position with numpy : 0.052752017974853516 nb_pixel_total : 10257 time to create 1 rle with old method : 0.011923074722290039 time for calcul the mask position with numpy : 0.05372142791748047 nb_pixel_total : 62939 time to create 1 rle with old method : 0.06684613227844238 time for calcul the mask position with numpy : 0.05306673049926758 nb_pixel_total : 28206 time to create 1 rle with old method : 0.03149747848510742 time for calcul the mask position with numpy : 0.062311410903930664 nb_pixel_total : 736627 time to create 1 rle with new method : 1.3755114078521729 time for calcul the mask position with numpy : 0.06921100616455078 nb_pixel_total : 22664 time to create 1 rle with old method : 0.03035283088684082 time for calcul the mask position with numpy : 0.054959774017333984 nb_pixel_total : 67429 time to create 1 rle with old method : 0.07817602157592773 time for calcul the mask position with numpy : 0.05621910095214844 nb_pixel_total : 72671 time to create 1 rle with old method : 0.08363056182861328 time for calcul the mask position with numpy : 0.052840232849121094 nb_pixel_total : 33505 time to create 1 rle with old method : 0.03661322593688965 time for calcul the mask position with numpy : 0.052755117416381836 nb_pixel_total : 38998 time to create 1 rle with old method : 0.04515981674194336 time for calcul the mask position with numpy : 0.06398415565490723 nb_pixel_total : 149064 time to create 1 rle with old method : 0.15979504585266113 time for calcul the mask position with numpy : 0.0522613525390625 nb_pixel_total : 7901 time to create 1 rle with old method : 0.008767127990722656 time for calcul the mask position with numpy : 0.05392861366271973 nb_pixel_total : 214518 time to create 1 rle with new method : 1.0962717533111572 time for calcul the mask position with numpy : 0.05315232276916504 nb_pixel_total : 103529 time to create 1 rle with old method : 0.11440706253051758 time for calcul the mask position with numpy : 0.05393528938293457 nb_pixel_total : 57530 time to create 1 rle with old method : 0.0683591365814209 time for calcul the mask position with numpy : 0.05333280563354492 nb_pixel_total : 1804 time to create 1 rle with old method : 0.002926349639892578 time for calcul the mask position with numpy : 0.0564885139465332 nb_pixel_total : 41040 time to create 1 rle with old method : 0.058197021484375 time for calcul the mask position with numpy : 0.0517125129699707 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005774497985839844 time for calcul the mask position with numpy : 0.052240610122680664 nb_pixel_total : 54436 time to create 1 rle with old method : 0.06262803077697754 time for calcul the mask position with numpy : 0.053337812423706055 nb_pixel_total : 70659 time to create 1 rle with old method : 0.08252859115600586 time for calcul the mask position with numpy : 0.05562162399291992 nb_pixel_total : 52246 time to create 1 rle with old method : 0.056389570236206055 time for calcul the mask position with numpy : 0.05361032485961914 nb_pixel_total : 1 time to create 1 rle with old method : 3.0279159545898438e-05 time for calcul the mask position with numpy : 0.05346059799194336 nb_pixel_total : 155212 time to create 1 rle with new method : 0.7990970611572266 time for calcul the mask position with numpy : 0.05503129959106445 nb_pixel_total : 106107 time to create 1 rle with old method : 0.11812257766723633 time for calcul the mask position with numpy : 0.05347037315368652 nb_pixel_total : 1907 time to create 1 rle with old method : 0.0023331642150878906 time for calcul the mask position with numpy : 0.05404210090637207 nb_pixel_total : 58359 time to create 1 rle with old method : 0.06501102447509766 create new chi : 32.57473826408386 time to delete rle : 0.008564233779907227 batch 1 Loaded 93 chid ids of type : 4855 Number RLEs to save : 68164 TO DO : save crop sub photo not yet done ! save time : 16.08617854118347 nb_obj : 81 nb_hashtags : 11 time to prepare the origin masks : 62.58762216567993 time for calcul the mask position with numpy : 1.0905866622924805 nb_pixel_total : 4234737 time to create 1 rle with new method : 0.9610331058502197 time for calcul the mask position with numpy : 0.05336141586303711 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008153915405273438 time for calcul the mask position with numpy : 0.053240299224853516 nb_pixel_total : 24042 time to create 1 rle with old method : 0.026426315307617188 time for calcul the mask position with numpy : 0.05649685859680176 nb_pixel_total : 426867 time to create 1 rle with new method : 0.8415486812591553 time for calcul the mask position with numpy : 0.06099224090576172 nb_pixel_total : 153314 time to create 1 rle with new method : 0.9036450386047363 time for calcul the mask position with numpy : 0.05443859100341797 nb_pixel_total : 4808 time to create 1 rle with old method : 0.006079196929931641 time for calcul the mask position with numpy : 0.055298566818237305 nb_pixel_total : 362315 time to create 1 rle with new method : 0.7590212821960449 time for calcul the mask position with numpy : 0.054442644119262695 nb_pixel_total : 81504 time to create 1 rle with old method : 0.09376764297485352 time for calcul the mask position with numpy : 0.05557394027709961 nb_pixel_total : 25348 time to create 1 rle with old method : 0.0285189151763916 time for calcul the mask position with numpy : 0.09548139572143555 nb_pixel_total : 1162104 time to create 1 rle with new method : 1.1373629570007324 time for calcul the mask position with numpy : 0.0550382137298584 nb_pixel_total : 2254 time to create 1 rle with old method : 0.0027608871459960938 time for calcul the mask position with numpy : 0.06338763236999512 nb_pixel_total : 128792 time to create 1 rle with old method : 0.1492140293121338 time for calcul the mask position with numpy : 0.05812191963195801 nb_pixel_total : 25295 time to create 1 rle with old method : 0.028296709060668945 time for calcul the mask position with numpy : 0.05553627014160156 nb_pixel_total : 78768 time to create 1 rle with old method : 0.09976863861083984 time for calcul the mask position with numpy : 0.05845189094543457 nb_pixel_total : 88037 time to create 1 rle with old method : 0.10475349426269531 time for calcul the mask position with numpy : 0.0537874698638916 nb_pixel_total : 4610 time to create 1 rle with old method : 0.005537509918212891 time for calcul the mask position with numpy : 0.05606484413146973 nb_pixel_total : 59903 time to create 1 rle with old method : 0.07304811477661133 time for calcul the mask position with numpy : 0.06371712684631348 nb_pixel_total : 19908 time to create 1 rle with old method : 0.02439141273498535 time for calcul the mask position with numpy : 0.055440425872802734 nb_pixel_total : 222701 time to create 1 rle with new method : 0.8688843250274658 time for calcul the mask position with numpy : 0.05419659614562988 nb_pixel_total : 7791 time to create 1 rle with old method : 0.009154796600341797 time for calcul the mask position with numpy : 0.056385040283203125 nb_pixel_total : 300982 time to create 1 rle with new method : 0.8066136837005615 time for calcul the mask position with numpy : 0.05518078804016113 nb_pixel_total : 147785 time to create 1 rle with old method : 0.17335295677185059 time for calcul the mask position with numpy : 0.05907034873962402 nb_pixel_total : 81193 time to create 1 rle with old method : 0.09288358688354492 time for calcul the mask position with numpy : 0.05452895164489746 nb_pixel_total : 8301 time to create 1 rle with old method : 0.009781837463378906 time for calcul the mask position with numpy : 0.053456783294677734 nb_pixel_total : 7150 time to create 1 rle with old method : 0.008202075958251953 time for calcul the mask position with numpy : 0.0544893741607666 nb_pixel_total : 84493 time to create 1 rle with old method : 0.09501051902770996 time for calcul the mask position with numpy : 0.055719614028930664 nb_pixel_total : 155566 time to create 1 rle with new method : 0.6671977043151855 time for calcul the mask position with numpy : 0.05436515808105469 nb_pixel_total : 185713 time to create 1 rle with new method : 0.6590003967285156 time for calcul the mask position with numpy : 0.05213475227355957 nb_pixel_total : 35334 time to create 1 rle with old method : 0.03652167320251465 time for calcul the mask position with numpy : 0.06008434295654297 nb_pixel_total : 453040 time to create 1 rle with new method : 0.6036431789398193 time for calcul the mask position with numpy : 0.05644083023071289 nb_pixel_total : 5053 time to create 1 rle with old method : 0.006471872329711914 time for calcul the mask position with numpy : 0.05445075035095215 nb_pixel_total : 39917 time to create 1 rle with old method : 0.04542660713195801 time for calcul the mask position with numpy : 0.054079532623291016 nb_pixel_total : 94188 time to create 1 rle with old method : 0.10233545303344727 time for calcul the mask position with numpy : 0.05356335639953613 nb_pixel_total : 31992 time to create 1 rle with old method : 0.03628396987915039 time for calcul the mask position with numpy : 0.05190777778625488 nb_pixel_total : 39569 time to create 1 rle with old method : 0.04221963882446289 time for calcul the mask position with numpy : 0.05248880386352539 nb_pixel_total : 67422 time to create 1 rle with old method : 0.07516741752624512 time for calcul the mask position with numpy : 0.052459716796875 nb_pixel_total : 22089 time to create 1 rle with old method : 0.02424764633178711 time for calcul the mask position with numpy : 0.052350521087646484 nb_pixel_total : 20539 time to create 1 rle with old method : 0.02345561981201172 time for calcul the mask position with numpy : 0.052993059158325195 nb_pixel_total : 21986 time to create 1 rle with old method : 0.023360490798950195 time for calcul the mask position with numpy : 0.054250478744506836 nb_pixel_total : 911 time to create 1 rle with old method : 0.0013458728790283203 time for calcul the mask position with numpy : 0.052835941314697266 nb_pixel_total : 2919 time to create 1 rle with old method : 0.003329038619995117 time for calcul the mask position with numpy : 0.0599513053894043 nb_pixel_total : 54491 time to create 1 rle with old method : 0.07488036155700684 time for calcul the mask position with numpy : 0.056165218353271484 nb_pixel_total : 321940 time to create 1 rle with new method : 1.1232657432556152 time for calcul the mask position with numpy : 0.055310726165771484 nb_pixel_total : 163894 time to create 1 rle with new method : 1.121535301208496 time for calcul the mask position with numpy : 0.05899691581726074 nb_pixel_total : 26423 time to create 1 rle with old method : 0.03364086151123047 time for calcul the mask position with numpy : 0.06422638893127441 nb_pixel_total : 277576 time to create 1 rle with new method : 0.8932387828826904 time for calcul the mask position with numpy : 0.05642414093017578 nb_pixel_total : 116820 time to create 1 rle with old method : 0.12094593048095703 time for calcul the mask position with numpy : 0.05375790596008301 nb_pixel_total : 35906 time to create 1 rle with old method : 0.03806257247924805 time for calcul the mask position with numpy : 0.05614733695983887 nb_pixel_total : 177736 time to create 1 rle with new method : 1.4165942668914795 time for calcul the mask position with numpy : 0.05767178535461426 nb_pixel_total : 64540 time to create 1 rle with old method : 0.07350444793701172 time for calcul the mask position with numpy : 0.05344247817993164 nb_pixel_total : 28860 time to create 1 rle with old method : 0.03303360939025879 time for calcul the mask position with numpy : 0.056061744689941406 nb_pixel_total : 44135 time to create 1 rle with old method : 0.06647324562072754 time for calcul the mask position with numpy : 0.06069326400756836 nb_pixel_total : 145494 time to create 1 rle with old method : 0.1859450340270996 time for calcul the mask position with numpy : 0.056861162185668945 nb_pixel_total : 169655 time to create 1 rle with new method : 0.8401806354522705 time for calcul the mask position with numpy : 0.05231142044067383 nb_pixel_total : 35915 time to create 1 rle with old method : 0.0379948616027832 time for calcul the mask position with numpy : 0.058916330337524414 nb_pixel_total : 282131 time to create 1 rle with new method : 0.998833417892456 time for calcul the mask position with numpy : 0.05642056465148926 nb_pixel_total : 3252 time to create 1 rle with old method : 0.006085395812988281 time for calcul the mask position with numpy : 0.07082414627075195 nb_pixel_total : 44985 time to create 1 rle with old method : 0.055289268493652344 time for calcul the mask position with numpy : 0.06035780906677246 nb_pixel_total : 100203 time to create 1 rle with old method : 0.11784029006958008 time for calcul the mask position with numpy : 0.055529117584228516 nb_pixel_total : 35916 time to create 1 rle with old method : 0.04171156883239746 time for calcul the mask position with numpy : 0.055582284927368164 nb_pixel_total : 110125 time to create 1 rle with old method : 0.12006092071533203 time for calcul the mask position with numpy : 0.05504345893859863 nb_pixel_total : 119479 time to create 1 rle with old method : 0.13215017318725586 time for calcul the mask position with numpy : 0.055644989013671875 nb_pixel_total : 106378 time to create 1 rle with old method : 0.13675713539123535 time for calcul the mask position with numpy : 0.05394268035888672 nb_pixel_total : 4606 time to create 1 rle with old method : 0.005827188491821289 time for calcul the mask position with numpy : 0.05355501174926758 nb_pixel_total : 103557 time to create 1 rle with old method : 0.11275553703308105 time for calcul the mask position with numpy : 0.05252790451049805 nb_pixel_total : 10034 time to create 1 rle with old method : 0.011562824249267578 time for calcul the mask position with numpy : 0.05280447006225586 nb_pixel_total : 77277 time to create 1 rle with old method : 0.080352783203125 time for calcul the mask position with numpy : 0.05416464805603027 nb_pixel_total : 48435 time to create 1 rle with old method : 0.07141852378845215 time for calcul the mask position with numpy : 0.05334210395812988 nb_pixel_total : 4577 time to create 1 rle with old method : 0.0055196285247802734 time for calcul the mask position with numpy : 0.05334782600402832 nb_pixel_total : 617 time to create 1 rle with old method : 0.000850677490234375 time for calcul the mask position with numpy : 0.05367732048034668 nb_pixel_total : 31859 time to create 1 rle with old method : 0.034436941146850586 time for calcul the mask position with numpy : 0.05780649185180664 nb_pixel_total : 162664 time to create 1 rle with new method : 1.0055272579193115 time for calcul the mask position with numpy : 0.05545401573181152 nb_pixel_total : 39520 time to create 1 rle with old method : 0.04597139358520508 time for calcul the mask position with numpy : 0.05825400352478027 nb_pixel_total : 88402 time to create 1 rle with old method : 0.11505246162414551 time for calcul the mask position with numpy : 0.062032222747802734 nb_pixel_total : 351599 time to create 1 rle with new method : 1.089578628540039 time for calcul the mask position with numpy : 0.058309078216552734 nb_pixel_total : 194352 time to create 1 rle with new method : 0.7757995128631592 time for calcul the mask position with numpy : 0.056322336196899414 nb_pixel_total : 115959 time to create 1 rle with old method : 0.1394968032836914 time for calcul the mask position with numpy : 0.05544447898864746 nb_pixel_total : 28664 time to create 1 rle with old method : 0.03438973426818848 time for calcul the mask position with numpy : 0.05731034278869629 nb_pixel_total : 14884 time to create 1 rle with old method : 0.023606300354003906 time for calcul the mask position with numpy : 0.06357073783874512 nb_pixel_total : 160857 time to create 1 rle with new method : 0.912522554397583 time for calcul the mask position with numpy : 0.05309295654296875 nb_pixel_total : 4928 time to create 1 rle with old method : 0.005718708038330078 time for calcul the mask position with numpy : 0.05544328689575195 nb_pixel_total : 150697 time to create 1 rle with new method : 1.2689523696899414 create new chi : 29.841488122940063 time to delete rle : 0.01081991195678711 batch 1 Loaded 82 chid ids of type : 4855 Number RLEs to save : 72361 TO DO : save crop sub photo not yet done ! save time : 13.208137035369873 nb_obj : 72 nb_hashtags : 11 time to prepare the origin masks : 62.687199115753174 time for calcul the mask position with numpy : 0.27573394775390625 nb_pixel_total : 4503053 time to create 1 rle with new method : 0.5567624568939209 time for calcul the mask position with numpy : 0.05342912673950195 nb_pixel_total : 55322 time to create 1 rle with old method : 0.06547164916992188 time for calcul the mask position with numpy : 0.05386090278625488 nb_pixel_total : 97114 time to create 1 rle with old method : 0.11665582656860352 time for calcul the mask position with numpy : 0.060667991638183594 nb_pixel_total : 40535 time to create 1 rle with old method : 0.06180143356323242 time for calcul the mask position with numpy : 0.06364107131958008 nb_pixel_total : 311389 time to create 1 rle with new method : 1.0039846897125244 time for calcul the mask position with numpy : 0.054018259048461914 nb_pixel_total : 206680 time to create 1 rle with new method : 1.0053811073303223 time for calcul the mask position with numpy : 0.08196496963500977 nb_pixel_total : 891885 time to create 1 rle with new method : 1.412917137145996 time for calcul the mask position with numpy : 0.05884385108947754 nb_pixel_total : 73216 time to create 1 rle with old method : 0.0898885726928711 time for calcul the mask position with numpy : 0.05610918998718262 nb_pixel_total : 362388 time to create 1 rle with new method : 0.827599287033081 time for calcul the mask position with numpy : 0.05413532257080078 nb_pixel_total : 257 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.0539400577545166 nb_pixel_total : 67231 time to create 1 rle with old method : 0.0743875503540039 time for calcul the mask position with numpy : 0.05515313148498535 nb_pixel_total : 189242 time to create 1 rle with new method : 1.1105408668518066 time for calcul the mask position with numpy : 0.05414628982543945 nb_pixel_total : 65018 time to create 1 rle with old method : 0.0902557373046875 time for calcul the mask position with numpy : 0.053311824798583984 nb_pixel_total : 14015 time to create 1 rle with old method : 0.015587329864501953 time for calcul the mask position with numpy : 0.05469155311584473 nb_pixel_total : 23138 time to create 1 rle with old method : 0.02543950080871582 time for calcul the mask position with numpy : 0.05356001853942871 nb_pixel_total : 100695 time to create 1 rle with old method : 0.11325454711914062 time for calcul the mask position with numpy : 0.053833723068237305 nb_pixel_total : 71095 time to create 1 rle with old method : 0.08085250854492188 time for calcul the mask position with numpy : 0.05406022071838379 nb_pixel_total : 55601 time to create 1 rle with old method : 0.06833720207214355 time for calcul the mask position with numpy : 0.05376100540161133 nb_pixel_total : 241422 time to create 1 rle with new method : 1.5908915996551514 time for calcul the mask position with numpy : 0.05257534980773926 nb_pixel_total : 95458 time to create 1 rle with old method : 0.11125898361206055 time for calcul the mask position with numpy : 0.05354809761047363 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001659393310546875 time for calcul the mask position with numpy : 0.05601835250854492 nb_pixel_total : 15071 time to create 1 rle with old method : 0.01810741424560547 time for calcul the mask position with numpy : 0.05446004867553711 nb_pixel_total : 312098 time to create 1 rle with new method : 1.1111743450164795 time for calcul the mask position with numpy : 0.0567781925201416 nb_pixel_total : 533947 time to create 1 rle with new method : 1.0244145393371582 time for calcul the mask position with numpy : 0.054409027099609375 nb_pixel_total : 131555 time to create 1 rle with old method : 0.1441969871520996 time for calcul the mask position with numpy : 0.05229020118713379 nb_pixel_total : 34677 time to create 1 rle with old method : 0.037390947341918945 time for calcul the mask position with numpy : 0.05267596244812012 nb_pixel_total : 93859 time to create 1 rle with old method : 0.10173201560974121 time for calcul the mask position with numpy : 0.05415606498718262 nb_pixel_total : 214441 time to create 1 rle with new method : 1.0641989707946777 time for calcul the mask position with numpy : 0.056548118591308594 nb_pixel_total : 78132 time to create 1 rle with old method : 0.08636283874511719 time for calcul the mask position with numpy : 0.0515744686126709 nb_pixel_total : 5066 time to create 1 rle with old method : 0.006313323974609375 time for calcul the mask position with numpy : 0.05403566360473633 nb_pixel_total : 349600 time to create 1 rle with new method : 0.9931375980377197 time for calcul the mask position with numpy : 0.05040454864501953 nb_pixel_total : 13551 time to create 1 rle with old method : 0.015479087829589844 time for calcul the mask position with numpy : 0.05255627632141113 nb_pixel_total : 7857 time to create 1 rle with old method : 0.009243249893188477 time for calcul the mask position with numpy : 0.05418682098388672 nb_pixel_total : 239203 time to create 1 rle with new method : 1.022019863128662 time for calcul the mask position with numpy : 0.05312609672546387 nb_pixel_total : 69405 time to create 1 rle with old method : 0.07890081405639648 time for calcul the mask position with numpy : 0.0532224178314209 nb_pixel_total : 7326 time to create 1 rle with old method : 0.008704185485839844 time for calcul the mask position with numpy : 0.052947282791137695 nb_pixel_total : 141671 time to create 1 rle with old method : 0.15426301956176758 time for calcul the mask position with numpy : 0.0524899959564209 nb_pixel_total : 24134 time to create 1 rle with old method : 0.026009082794189453 time for calcul the mask position with numpy : 0.05384206771850586 nb_pixel_total : 149300 time to create 1 rle with old method : 0.16118478775024414 time for calcul the mask position with numpy : 0.05306267738342285 nb_pixel_total : 11566 time to create 1 rle with old method : 0.012741565704345703 time for calcul the mask position with numpy : 0.05293989181518555 nb_pixel_total : 57513 time to create 1 rle with old method : 0.08667588233947754 time for calcul the mask position with numpy : 0.0546875 nb_pixel_total : 42969 time to create 1 rle with old method : 0.04603886604309082 time for calcul the mask position with numpy : 0.05237889289855957 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006489753723144531 time for calcul the mask position with numpy : 0.05208277702331543 nb_pixel_total : 34861 time to create 1 rle with old method : 0.03702998161315918 time for calcul the mask position with numpy : 0.054585933685302734 nb_pixel_total : 234867 time to create 1 rle with new method : 0.8700942993164062 time for calcul the mask position with numpy : 0.05401754379272461 nb_pixel_total : 109684 time to create 1 rle with old method : 0.12247347831726074 time for calcul the mask position with numpy : 0.05924654006958008 nb_pixel_total : 79752 time to create 1 rle with old method : 0.08725786209106445 time for calcul the mask position with numpy : 0.05295062065124512 nb_pixel_total : 6879 time to create 1 rle with old method : 0.008252859115600586 time for calcul the mask position with numpy : 0.05404925346374512 nb_pixel_total : 140541 time to create 1 rle with old method : 0.16841554641723633 time for calcul the mask position with numpy : 0.059636592864990234 nb_pixel_total : 853 time to create 1 rle with old method : 0.0012879371643066406 time for calcul the mask position with numpy : 0.05561518669128418 nb_pixel_total : 57182 time to create 1 rle with old method : 0.06634187698364258 time for calcul the mask position with numpy : 0.05365300178527832 nb_pixel_total : 104636 time to create 1 rle with old method : 0.11595916748046875 time for calcul the mask position with numpy : 0.05351519584655762 nb_pixel_total : 6515 time to create 1 rle with old method : 0.007581233978271484 time for calcul the mask position with numpy : 0.053542137145996094 nb_pixel_total : 168356 time to create 1 rle with new method : 1.1016623973846436 time for calcul the mask position with numpy : 0.05483055114746094 nb_pixel_total : 316434 time to create 1 rle with new method : 0.9913511276245117 time for calcul the mask position with numpy : 0.05267620086669922 nb_pixel_total : 56342 time to create 1 rle with old method : 0.06316494941711426 time for calcul the mask position with numpy : 0.053015947341918945 nb_pixel_total : 41969 time to create 1 rle with old method : 0.046095848083496094 time for calcul the mask position with numpy : 0.05332446098327637 nb_pixel_total : 55999 time to create 1 rle with old method : 0.06148099899291992 time for calcul the mask position with numpy : 0.05368232727050781 nb_pixel_total : 395 time to create 1 rle with old method : 0.0006921291351318359 time for calcul the mask position with numpy : 0.05307650566101074 nb_pixel_total : 75644 time to create 1 rle with old method : 0.0816347599029541 time for calcul the mask position with numpy : 0.05307769775390625 nb_pixel_total : 67076 time to create 1 rle with old method : 0.07193613052368164 time for calcul the mask position with numpy : 0.05430340766906738 nb_pixel_total : 248210 time to create 1 rle with new method : 0.9669468402862549 time for calcul the mask position with numpy : 0.05491042137145996 nb_pixel_total : 171328 time to create 1 rle with new method : 1.0453906059265137 time for calcul the mask position with numpy : 0.05238628387451172 nb_pixel_total : 39360 time to create 1 rle with old method : 0.045593976974487305 time for calcul the mask position with numpy : 0.0545344352722168 nb_pixel_total : 105664 time to create 1 rle with old method : 0.11595797538757324 time for calcul the mask position with numpy : 0.0586848258972168 nb_pixel_total : 482339 time to create 1 rle with new method : 0.9217128753662109 time for calcul the mask position with numpy : 0.05302929878234863 nb_pixel_total : 12910 time to create 1 rle with old method : 0.014755010604858398 time for calcul the mask position with numpy : 0.05849933624267578 nb_pixel_total : 159054 time to create 1 rle with new method : 0.9933667182922363 time for calcul the mask position with numpy : 0.052994489669799805 nb_pixel_total : 97414 time to create 1 rle with old method : 0.10639262199401855 time for calcul the mask position with numpy : 0.053585052490234375 nb_pixel_total : 354 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.05352950096130371 nb_pixel_total : 5382 time to create 1 rle with old method : 0.006381034851074219 time for calcul the mask position with numpy : 0.05363726615905762 nb_pixel_total : 22912 time to create 1 rle with old method : 0.02678966522216797 time for calcul the mask position with numpy : 0.05475115776062012 nb_pixel_total : 78062 time to create 1 rle with old method : 0.09194159507751465 create new chi : 27.93685793876648 time to delete rle : 0.007286548614501953 batch 1 Loaded 73 chid ids of type : 4855 Number RLEs to save : 58798 TO DO : save crop sub photo not yet done ! save time : 4.806629657745361 nb_obj : 73 nb_hashtags : 10 time to prepare the origin masks : 65.92809867858887 time for calcul the mask position with numpy : 0.7982330322265625 nb_pixel_total : 3290962 time to create 1 rle with new method : 1.0750532150268555 time for calcul the mask position with numpy : 0.05407857894897461 nb_pixel_total : 47698 time to create 1 rle with old method : 0.05522346496582031 time for calcul the mask position with numpy : 0.05653262138366699 nb_pixel_total : 59485 time to create 1 rle with old method : 0.06926321983337402 time for calcul the mask position with numpy : 0.054276466369628906 nb_pixel_total : 89959 time to create 1 rle with old method : 0.09816765785217285 time for calcul the mask position with numpy : 0.0608065128326416 nb_pixel_total : 14482 time to create 1 rle with old method : 0.016317367553710938 time for calcul the mask position with numpy : 0.05436277389526367 nb_pixel_total : 24410 time to create 1 rle with old method : 0.027162551879882812 time for calcul the mask position with numpy : 0.05409049987792969 nb_pixel_total : 12774 time to create 1 rle with old method : 0.01422572135925293 time for calcul the mask position with numpy : 0.056758880615234375 nb_pixel_total : 20156 time to create 1 rle with old method : 0.02805352210998535 time for calcul the mask position with numpy : 0.0587160587310791 nb_pixel_total : 1730 time to create 1 rle with old method : 0.002871990203857422 time for calcul the mask position with numpy : 0.06279730796813965 nb_pixel_total : 95734 time to create 1 rle with old method : 0.11604738235473633 time for calcul the mask position with numpy : 0.09755945205688477 nb_pixel_total : 1058450 time to create 1 rle with new method : 1.2865924835205078 time for calcul the mask position with numpy : 0.05469369888305664 nb_pixel_total : 62398 time to create 1 rle with old method : 0.07506847381591797 time for calcul the mask position with numpy : 0.05560708045959473 nb_pixel_total : 1969 time to create 1 rle with old method : 0.004107952117919922 time for calcul the mask position with numpy : 0.0623319149017334 nb_pixel_total : 181188 time to create 1 rle with new method : 0.914639949798584 time for calcul the mask position with numpy : 0.06513333320617676 nb_pixel_total : 565111 time to create 1 rle with new method : 1.338819980621338 time for calcul the mask position with numpy : 0.05312705039978027 nb_pixel_total : 13278 time to create 1 rle with old method : 0.018289566040039062 time for calcul the mask position with numpy : 0.05472612380981445 nb_pixel_total : 67682 time to create 1 rle with old method : 0.07468008995056152 time for calcul the mask position with numpy : 0.05513286590576172 nb_pixel_total : 110962 time to create 1 rle with old method : 0.1227576732635498 time for calcul the mask position with numpy : 0.05399131774902344 nb_pixel_total : 55855 time to create 1 rle with old method : 0.06515121459960938 time for calcul the mask position with numpy : 0.055484771728515625 nb_pixel_total : 76552 time to create 1 rle with old method : 0.08332133293151855 time for calcul the mask position with numpy : 0.0524754524230957 nb_pixel_total : 12504 time to create 1 rle with old method : 0.013965845108032227 time for calcul the mask position with numpy : 0.05356574058532715 nb_pixel_total : 3607 time to create 1 rle with old method : 0.005995035171508789 time for calcul the mask position with numpy : 0.0644826889038086 nb_pixel_total : 67829 time to create 1 rle with old method : 0.07909584045410156 time for calcul the mask position with numpy : 0.05519294738769531 nb_pixel_total : 187074 time to create 1 rle with new method : 1.1154165267944336 time for calcul the mask position with numpy : 0.053420305252075195 nb_pixel_total : 106227 time to create 1 rle with old method : 0.13884520530700684 time for calcul the mask position with numpy : 0.05339527130126953 nb_pixel_total : 21293 time to create 1 rle with old method : 0.06673550605773926 time for calcul the mask position with numpy : 0.05671191215515137 nb_pixel_total : 62805 time to create 1 rle with old method : 0.06904411315917969 time for calcul the mask position with numpy : 0.05330801010131836 nb_pixel_total : 29472 time to create 1 rle with old method : 0.03282880783081055 time for calcul the mask position with numpy : 0.05327272415161133 nb_pixel_total : 28219 time to create 1 rle with old method : 0.031279802322387695 time for calcul the mask position with numpy : 0.052269935607910156 nb_pixel_total : 45254 time to create 1 rle with old method : 0.050194501876831055 time for calcul the mask position with numpy : 0.053563594818115234 nb_pixel_total : 439 time to create 1 rle with old method : 0.001119375228881836 time for calcul the mask position with numpy : 0.05556154251098633 nb_pixel_total : 94461 time to create 1 rle with old method : 0.13011813163757324 time for calcul the mask position with numpy : 0.05661749839782715 nb_pixel_total : 47465 time to create 1 rle with old method : 0.054041385650634766 time for calcul the mask position with numpy : 0.05355525016784668 nb_pixel_total : 6101 time to create 1 rle with old method : 0.006793975830078125 time for calcul the mask position with numpy : 0.05315446853637695 nb_pixel_total : 13587 time to create 1 rle with old method : 0.015058040618896484 time for calcul the mask position with numpy : 0.05274367332458496 nb_pixel_total : 53615 time to create 1 rle with old method : 0.060572147369384766 time for calcul the mask position with numpy : 0.05299782752990723 nb_pixel_total : 49399 time to create 1 rle with old method : 0.05358695983886719 time for calcul the mask position with numpy : 0.054163217544555664 nb_pixel_total : 317449 time to create 1 rle with new method : 1.3654115200042725 time for calcul the mask position with numpy : 0.05749773979187012 nb_pixel_total : 207818 time to create 1 rle with new method : 1.5132734775543213 time for calcul the mask position with numpy : 0.059676408767700195 nb_pixel_total : 426743 time to create 1 rle with new method : 1.1389853954315186 time for calcul the mask position with numpy : 0.05497121810913086 nb_pixel_total : 148677 time to create 1 rle with old method : 0.16435527801513672 time for calcul the mask position with numpy : 0.056487321853637695 nb_pixel_total : 335965 time to create 1 rle with new method : 1.2360756397247314 time for calcul the mask position with numpy : 0.05359673500061035 nb_pixel_total : 197025 time to create 1 rle with new method : 1.5088355541229248 time for calcul the mask position with numpy : 0.05394148826599121 nb_pixel_total : 1742 time to create 1 rle with old method : 0.0022585391998291016 time for calcul the mask position with numpy : 0.05598616600036621 nb_pixel_total : 104165 time to create 1 rle with old method : 0.11857223510742188 time for calcul the mask position with numpy : 0.05524015426635742 nb_pixel_total : 33935 time to create 1 rle with old method : 0.038227081298828125 time for calcul the mask position with numpy : 0.06157994270324707 nb_pixel_total : 53406 time to create 1 rle with old method : 0.09194540977478027 time for calcul the mask position with numpy : 0.05748176574707031 nb_pixel_total : 100267 time to create 1 rle with old method : 0.11624932289123535 time for calcul the mask position with numpy : 0.054836273193359375 nb_pixel_total : 135998 time to create 1 rle with old method : 0.1531689167022705 time for calcul the mask position with numpy : 0.057781219482421875 nb_pixel_total : 46420 time to create 1 rle with old method : 0.06449222564697266 time for calcul the mask position with numpy : 0.053357601165771484 nb_pixel_total : 1286 time to create 1 rle with old method : 0.0014951229095458984 time for calcul the mask position with numpy : 0.06809186935424805 nb_pixel_total : 1063177 time to create 1 rle with new method : 1.7836360931396484 time for calcul the mask position with numpy : 0.05302691459655762 nb_pixel_total : 27483 time to create 1 rle with old method : 0.0314335823059082 time for calcul the mask position with numpy : 0.05518507957458496 nb_pixel_total : 51295 time to create 1 rle with old method : 0.054698944091796875 time for calcul the mask position with numpy : 0.07542800903320312 nb_pixel_total : 52733 time to create 1 rle with old method : 0.06080269813537598 time for calcul the mask position with numpy : 0.05395913124084473 nb_pixel_total : 95153 time to create 1 rle with old method : 0.10523247718811035 time for calcul the mask position with numpy : 0.05123472213745117 nb_pixel_total : 25440 time to create 1 rle with old method : 0.026955127716064453 time for calcul the mask position with numpy : 0.062001705169677734 nb_pixel_total : 902080 time to create 1 rle with new method : 1.0099115371704102 time for calcul the mask position with numpy : 0.05391263961791992 nb_pixel_total : 17982 time to create 1 rle with old method : 0.021439790725708008 time for calcul the mask position with numpy : 0.054425716400146484 nb_pixel_total : 87615 time to create 1 rle with old method : 0.09633708000183105 time for calcul the mask position with numpy : 0.0622251033782959 nb_pixel_total : 737615 time to create 1 rle with new method : 1.3270838260650635 time for calcul the mask position with numpy : 0.0748605728149414 nb_pixel_total : 28370 time to create 1 rle with old method : 0.053101301193237305 time for calcul the mask position with numpy : 0.07203888893127441 nb_pixel_total : 1417 time to create 1 rle with old method : 0.0028810501098632812 time for calcul the mask position with numpy : 0.07430529594421387 nb_pixel_total : 20241 time to create 1 rle with old method : 0.03552699089050293 time for calcul the mask position with numpy : 0.05549216270446777 nb_pixel_total : 76684 time to create 1 rle with old method : 0.08686709403991699 time for calcul the mask position with numpy : 0.0541691780090332 nb_pixel_total : 27513 time to create 1 rle with old method : 0.03369140625 time for calcul the mask position with numpy : 0.06112527847290039 nb_pixel_total : 334069 time to create 1 rle with new method : 1.9882783889770508 time for calcul the mask position with numpy : 0.05609393119812012 nb_pixel_total : 9435 time to create 1 rle with old method : 0.01198720932006836 time for calcul the mask position with numpy : 0.05787062644958496 nb_pixel_total : 36492 time to create 1 rle with old method : 0.0410914421081543 time for calcul the mask position with numpy : 0.05811929702758789 nb_pixel_total : 295310 time to create 1 rle with new method : 1.5305242538452148 time for calcul the mask position with numpy : 0.055113792419433594 nb_pixel_total : 133976 time to create 1 rle with old method : 0.17601943016052246 time for calcul the mask position with numpy : 0.05434131622314453 nb_pixel_total : 23030 time to create 1 rle with old method : 0.02572154998779297 time for calcul the mask position with numpy : 0.05454897880554199 nb_pixel_total : 1783 time to create 1 rle with old method : 0.0023140907287597656 time for calcul the mask position with numpy : 0.057622671127319336 nb_pixel_total : 139225 time to create 1 rle with old method : 0.1605074405670166 create new chi : 29.335290670394897 time to delete rle : 0.007816076278686523 batch 1 Loaded 74 chid ids of type : 4855 Number RLEs to save : 60454 TO DO : save crop sub photo not yet done ! save time : 8.198896408081055 nb_obj : 14 nb_hashtags : 6 time to prepare the origin masks : 40.473751068115234 time for calcul the mask position with numpy : 0.18538451194763184 nb_pixel_total : 1083274 time to create 1 rle with new method : 1.213813304901123 time for calcul the mask position with numpy : 0.07295560836791992 nb_pixel_total : 45604 time to create 1 rle with old method : 0.05414724349975586 time for calcul the mask position with numpy : 0.06945180892944336 nb_pixel_total : 72428 time to create 1 rle with old method : 0.07979679107666016 time for calcul the mask position with numpy : 0.06886148452758789 nb_pixel_total : 428995 time to create 1 rle with new method : 1.0192234516143799 time for calcul the mask position with numpy : 0.06748652458190918 nb_pixel_total : 12478 time to create 1 rle with old method : 0.31872057914733887 time for calcul the mask position with numpy : 0.07216787338256836 nb_pixel_total : 108655 time to create 1 rle with old method : 0.12456154823303223 time for calcul the mask position with numpy : 0.07228565216064453 nb_pixel_total : 24681 time to create 1 rle with old method : 0.027713537216186523 time for calcul the mask position with numpy : 0.09581875801086426 nb_pixel_total : 1008937 time to create 1 rle with new method : 2.963477373123169 time for calcul the mask position with numpy : 0.09694075584411621 nb_pixel_total : 36063 time to create 1 rle with old method : 0.04616093635559082 time for calcul the mask position with numpy : 0.12080049514770508 nb_pixel_total : 1413763 time to create 1 rle with new method : 1.4982175827026367 time for calcul the mask position with numpy : 0.08258342742919922 nb_pixel_total : 400793 time to create 1 rle with new method : 1.6041958332061768 time for calcul the mask position with numpy : 0.09359526634216309 nb_pixel_total : 153946 time to create 1 rle with new method : 1.758943796157837 time for calcul the mask position with numpy : 0.0870962142944336 nb_pixel_total : 21011 time to create 1 rle with old method : 0.027083635330200195 time for calcul the mask position with numpy : 0.08597588539123535 nb_pixel_total : 161806 time to create 1 rle with new method : 2.2909505367279053 time for calcul the mask position with numpy : 0.8693554401397705 nb_pixel_total : 8006766 time to create 1 rle with new method : 2.2781786918640137 create new chi : 17.91249918937683 time to delete rle : 0.005313396453857422 batch 1 Loaded 15 chid ids of type : 4855 Number RLEs to save : 27374 TO DO : save crop sub photo not yet done ! save time : 10.148473262786865 map_output_result : {1342523681: (0.3257225216793319, 'Should be the crop_list due to order', 0.3762723818398255), 1342523678: (0.3257225216793319, 'Should be the crop_list due to order', 0.15833881534131827), 1342523673: (0.3257225216793319, 'Should be the crop_list due to order', 0.3025199476513259), 1342523646: (0.3257225216793319, 'Should be the crop_list due to order', 0.21528827716806415), 1342523642: (0.3257225216793319, 'Should be the crop_list due to order', 0.3993311155670148), 1342523636: (0.3257225216793319, 'Should be the crop_list due to order', 0.27688144265286113), 1342523632: (0.3257225216793319, 'Should be the crop_list due to order', 0.0993328654720252), 1342523629: (0.3257225216793319, 'Should be the crop_list due to order', 0.7778153277422202)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 8 /1342523681.Didn't retrieve data . /1342523678.Didn't retrieve data . /1342523673.Didn't retrieve data . /1342523646.Didn't retrieve data . /1342523642.Didn't retrieve data . /1342523636.Didn't retrieve data . /1342523632.Didn't retrieve data . /1342523629.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.02864861488342285 save_final save missing photos in datou_result : time spend for datou_step_exec : 769.4006690979004 time spend to save output : 0.0451045036315918 total time spend for step 5 : 769.445773601532 step6:crop_condition Mon Mar 10 19:41:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 524 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 79 About to insert : list_path_to_insert length 79 new photo from crops ! About to upload 79 photos upload in portfolio : 3015255 init cache_photo without model_param we have 79 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632196_219453 we have uploaded 79 photos in the portfolio 3015255 time of upload the photos Elapsed time : 37.27472114562988 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 83 About to insert : list_path_to_insert length 83 new photo from crops ! About to upload 83 photos upload in portfolio : 3015255 init cache_photo without model_param we have 83 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632307_219453 we have uploaded 83 photos in the portfolio 3015255 time of upload the photos Elapsed time : 35.84629440307617 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632358_219453 we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.87265419960022 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632390_219453 we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 17.069801568984985 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3015255 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632414_219453 we have uploaded 6 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.906047821044922 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632421_219453 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.772078275680542 we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3015255 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632436_219453 we have uploaded 27 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.912764549255371 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632452_219453 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.5614912509918213 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632458_219453 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8019864559173584 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3015255 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632509_219453 we have uploaded 41 photos in the portfolio 3015255 time of upload the photos Elapsed time : 19.43844485282898 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3015255 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632540_219453 we have uploaded 13 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.560488224029541 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 58 About to insert : list_path_to_insert length 58 new photo from crops ! About to upload 58 photos upload in portfolio : 3015255 init cache_photo without model_param we have 58 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741632696_219453 we have uploaded 58 photos in the portfolio 3015255 time of upload the photos Elapsed time : 22.279438734054565 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 375 /1342635842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342635983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342636990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342637661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342638869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1133 time used for this insertion : 2.135422468185425 save_final save missing photos in datou_result : time spend for datou_step_exec : 641.3217601776123 time spend to save output : 2.4757375717163086 total time spend for step 6 : 643.7974977493286 step7:ventilate_hashtags_in_portfolio Mon Mar 10 19:52:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21222677 get user id for portfolio 21222677 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222677 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222677 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222677 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222677 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21237673,21237674,21237675,21237676,21237677,21237692,21237696,21237697,21237698,21237699,21237707,21237713,21237715,21237716,21237717,21237718,21237719,21237720,21237721,21237722?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222677 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 1 /21222677. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.14909601211547852 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.559839248657227 time spend to save output : 0.1494286060333252 total time spend for step 7 : 11.709267854690552 step8:final Mon Mar 10 19:52:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342523681: ('0.27154147259571604',), 1342523678: ('0.27154147259571604',), 1342523673: ('0.27154147259571604',), 1342523646: ('0.27154147259571604',), 1342523642: ('0.27154147259571604',), 1342523636: ('0.27154147259571604',), 1342523632: ('0.27154147259571604',), 1342523629: ('0.27154147259571604',)} new output for save of step final : {1342523681: ('0.27154147259571604',), 1342523678: ('0.27154147259571604',), 1342523673: ('0.27154147259571604',), 1342523646: ('0.27154147259571604',), 1342523642: ('0.27154147259571604',), 1342523636: ('0.27154147259571604',), 1342523632: ('0.27154147259571604',), 1342523629: ('0.27154147259571604',)} [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 8 /1342523681.Didn't retrieve data . /1342523678.Didn't retrieve data . /1342523673.Didn't retrieve data . /1342523646.Didn't retrieve data . /1342523642.Didn't retrieve data . /1342523636.Didn't retrieve data . /1342523632.Didn't retrieve data . /1342523629.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.026963472366333008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.23798465728759766 time spend to save output : 0.027875185012817383 total time spend for step 8 : 0.26585984230041504 step9:velours_tree Mon Mar 10 19:52:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.7111237049102783 time spend to save output : 0.000461578369140625 total time spend for step 9 : 0.711585283279419 step10:send_mail_cod Mon Mar 10 19:52:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21222677_10-03-2025_19_52_19.pdf 21237647 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376471741632739 21237648 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376481741632741 21237649 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376491741632743 21237650 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376501741632745 21237651 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376511741632747 21237652 change filename to text .imagette212376521741632747 21237653 imagette212376531741632747 21237654 imagette212376541741632747 21237655 imagette212376551741632747 21237656 imagette212376561741632747 21237657 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376571741632747 21237658 change filename to text .change filename to text .imagette212376581741632749 21237659 change filename to text .imagette212376591741632749 21237660 imagette212376601741632749 21237661 imagette212376611741632749 21237662 imagette212376621741632749 21237663 imagette212376631741632749 21237664 imagette212376641741632749 21237665 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376651741632749 21237667 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212376671741632750 21237668 imagette212376681741632752 21237669 imagette212376691741632752 21237670 imagette212376701741632752 21237671 imagette212376711741632752 21237672 imagette212376721741632752 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21222677 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21237673,21237674,21237675,21237676,21237677,21237692,21237696,21237697,21237698,21237699,21237707,21237713,21237715,21237716,21237717,21237718,21237719,21237720,21237721,21237722?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222677 your option no_mail is active, we will not send the real mail to your client args[1342523681] : ((1342523681, 2094.408929979666, 492609224), (1342523681, -0.31784158474904295, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523678] : ((1342523678, 2556.1096941528713, 492609224), (1342523678, -0.2006824345134896, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523673] : ((1342523673, 1085.1223692140013, 2107751945), (1342523673, -0.24007196162038014, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523646] : ((1342523646, 2501.250497416516, 492609224), (1342523646, -0.1990350182647128, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523642] : ((1342523642, 1121.3250842258549, 2107751945), (1342523642, -0.18322488504807932, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523636] : ((1342523636, 1205.4797748878323, 2107751945), (1342523636, -0.34679438150646963, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523632] : ((1342523632, 2668.1916038357317, 492609224), (1342523632, -0.17889383797518907, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523629] : ((1342523629, 304.71827384779033, 492688767), (1342523629, -0.4001214608745113, 496442774), '0.27154147259571604') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.27154147259571604 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222677_10-03-2025_19_52_19.pdf results_Auto_P21222677_10-03-2025_19_52_19.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222677_10-03-2025_19_52_19.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21222677','results_Auto_P21222677_10-03-2025_19_52_19.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222677_10-03-2025_19_52_19.pdf','pdf','','2.93','0.27154147259571604') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.02572178840637207 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.08371901512146 time spend to save output : 0.0964043140411377 total time spend for step 10 : 20.180123329162598 step11:split_time_score Mon Mar 10 19:52:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('21', 1), ('22', 2), ('23', 5)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04022025 21222677 Nombre de photos uploadées : 8 / 23040 (0%) 04022025 21222677 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 04022025 21222677 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.1205673217773438e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004975795745849609 elapsed_time : insert_dashboard_record_day_entry 0.05308985710144043 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.41441132458681595 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222675_10-03-2025_15_19_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222675 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222675 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222676 order by id desc limit 1 Qualite : 0.27154147259571604 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222677_10-03-2025_19_52_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222677 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222677 AND mptpi.`type`=4855 To do Qualite : 0.39564799928084676 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222678_10-03-2025_16_10_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222678 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04022025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342523681, 1342523678, 1342523673, 1342523646, 1342523642, 1342523636, 1342523632, 1342523629] Looping around the photos to save general results len do output : 1 /21222677Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523681', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523678', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523673', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523646', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523642', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523636', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523632', None, None, None, None, None, '2654459') ('4741', None, None, None, None, None, None, None, '2654459') ('4741', '21222677', '1342523629', None, None, None, None, None, '2654459') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.02985095977783203 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8980891704559326 time spend to save output : 0.030110836029052734 total time spend for step 11 : 1.9282000064849854 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 1017.56user 854.47system 31:18.10elapsed 99%CPU (0avgtext+0avgdata 6600444maxresident)k 14739008inputs+953808outputs (394844major+89198932minor)pagefaults 0swaps