python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3228249 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2654460'] with mtr_portfolio_ids : ['21222678'] and first list_photo_ids : [] new path : /proc/3228249/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.502969980239868 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 10 15:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1311 wait 20 seconds l 3637 free memory gpu now : 1311 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 15:41:55.297678: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 15:41:55.331325: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 15:41:55.333112: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdfd0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 15:41:55.333136: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 15:41:55.336711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 15:41:55.491365: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xa4fabf0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 15:41:55.491419: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 15:41:55.491984: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:41:55.492964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:41:55.498496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:41:55.503295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:41:55.504642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:41:55.509901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:41:55.511799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:41:55.524981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:41:55.526039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:41:55.526126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:41:55.526683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 15:41:55.526700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 15:41:55.526709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 15:41:55.527913: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2050 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 15:41:55.998241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:41:55.998410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:41:55.998442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:41:55.998471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:41:55.998500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:41:55.998524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:41:55.998546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:41:55.998569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:41:55.999610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:41:56.000935: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:41:56.000981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:41:56.001009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:41:56.001051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:41:56.001079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:41:56.001106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:41:56.001131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:41:56.001157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:41:56.002135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:41:56.002184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 15:41:56.002199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 15:41:56.002210: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 15:41:56.003304: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2050 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 15:42:08.783332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:42:08.991481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:42:10.493628: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.493705: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.500175: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.500199: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.550653: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.550751: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.592973: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.593028: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.643787: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.643828: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:42:10.645254: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-10 15:42:10.660051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.50G (1614675968 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:42:10.660922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.35G (1453208320 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 3229631 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 61 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2721 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 27073 time to create 1 rle with old method : 0.029912471771240234 length of segment : 137 time for calcul the mask position with numpy : 0.01878976821899414 nb_pixel_total : 475776 time to create 1 rle with new method : 0.030527591705322266 length of segment : 1136 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 28378 time to create 1 rle with old method : 0.031096458435058594 length of segment : 359 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 10784 time to create 1 rle with old method : 0.011607170104980469 length of segment : 177 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 16722 time to create 1 rle with old method : 0.01903247833251953 length of segment : 202 time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 21496 time to create 1 rle with old method : 0.024446487426757812 length of segment : 186 time for calcul the mask position with numpy : 0.0017843246459960938 nb_pixel_total : 130980 time to create 1 rle with old method : 0.18152117729187012 length of segment : 362 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 14055 time to create 1 rle with old method : 0.01637554168701172 length of segment : 92 time for calcul the mask position with numpy : 1.0133790969848633 nb_pixel_total : 537329 time to create 1 rle with new method : 0.03728151321411133 length of segment : 1182 time for calcul the mask position with numpy : 0.0013148784637451172 nb_pixel_total : 59865 time to create 1 rle with old method : 0.09195184707641602 length of segment : 610 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 25319 time to create 1 rle with old method : 0.027825593948364258 length of segment : 197 time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 29475 time to create 1 rle with old method : 0.03619575500488281 length of segment : 379 time for calcul the mask position with numpy : 1.4741790294647217 nb_pixel_total : 1088889 time to create 1 rle with new method : 0.05966639518737793 length of segment : 1285 time for calcul the mask position with numpy : 0.0025849342346191406 nb_pixel_total : 157042 time to create 1 rle with new method : 0.00551605224609375 length of segment : 545 time for calcul the mask position with numpy : 0.0009772777557373047 nb_pixel_total : 74968 time to create 1 rle with old method : 0.08257746696472168 length of segment : 344 time for calcul the mask position with numpy : 0.07891535758972168 nb_pixel_total : 1498851 time to create 1 rle with new method : 0.10965752601623535 length of segment : 1766 time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 10710 time to create 1 rle with old method : 0.012149572372436523 length of segment : 164 time for calcul the mask position with numpy : 0.0011839866638183594 nb_pixel_total : 27966 time to create 1 rle with old method : 0.03014683723449707 length of segment : 340 time for calcul the mask position with numpy : 0.029845476150512695 nb_pixel_total : 1420680 time to create 1 rle with new method : 0.13569998741149902 length of segment : 1767 time for calcul the mask position with numpy : 0.0013933181762695312 nb_pixel_total : 41284 time to create 1 rle with old method : 0.05096697807312012 length of segment : 419 time for calcul the mask position with numpy : 0.0017273426055908203 nb_pixel_total : 31586 time to create 1 rle with old method : 0.039430856704711914 length of segment : 369 time for calcul the mask position with numpy : 0.0065958499908447266 nb_pixel_total : 246220 time to create 1 rle with new method : 0.012140512466430664 length of segment : 576 time for calcul the mask position with numpy : 0.0013511180877685547 nb_pixel_total : 46903 time to create 1 rle with old method : 0.05372881889343262 length of segment : 262 time for calcul the mask position with numpy : 0.012070655822753906 nb_pixel_total : 417387 time to create 1 rle with new method : 0.020216941833496094 length of segment : 642 time for calcul the mask position with numpy : 0.0004298686981201172 nb_pixel_total : 9867 time to create 1 rle with old method : 0.011739492416381836 length of segment : 112 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 10739 time to create 1 rle with old method : 0.01260066032409668 length of segment : 158 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 23777 time to create 1 rle with old method : 0.028470993041992188 length of segment : 223 time for calcul the mask position with numpy : 0.002333402633666992 nb_pixel_total : 81281 time to create 1 rle with old method : 0.11632990837097168 length of segment : 473 time for calcul the mask position with numpy : 0.0017778873443603516 nb_pixel_total : 82629 time to create 1 rle with old method : 0.09560894966125488 length of segment : 199 time for calcul the mask position with numpy : 0.004797935485839844 nb_pixel_total : 154991 time to create 1 rle with new method : 0.008283853530883789 length of segment : 720 time for calcul the mask position with numpy : 0.0026793479919433594 nb_pixel_total : 126803 time to create 1 rle with old method : 0.14715027809143066 length of segment : 566 time for calcul the mask position with numpy : 0.0010211467742919922 nb_pixel_total : 24946 time to create 1 rle with old method : 0.02788567543029785 length of segment : 198 time for calcul the mask position with numpy : 0.0014281272888183594 nb_pixel_total : 79122 time to create 1 rle with old method : 0.08927226066589355 length of segment : 566 time for calcul the mask position with numpy : 0.0011932849884033203 nb_pixel_total : 54852 time to create 1 rle with old method : 0.059943437576293945 length of segment : 302 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 21939 time to create 1 rle with old method : 0.025239229202270508 length of segment : 188 time for calcul the mask position with numpy : 0.0011680126190185547 nb_pixel_total : 48552 time to create 1 rle with old method : 0.0547184944152832 length of segment : 201 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 33060 time to create 1 rle with old method : 0.038927316665649414 length of segment : 145 time for calcul the mask position with numpy : 0.0006756782531738281 nb_pixel_total : 21435 time to create 1 rle with old method : 0.025845050811767578 length of segment : 164 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 17879 time to create 1 rle with old method : 0.02105426788330078 length of segment : 115 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 14577 time to create 1 rle with old method : 0.019205570220947266 length of segment : 157 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 52138 time to create 1 rle with old method : 0.060861825942993164 length of segment : 220 time for calcul the mask position with numpy : 0.0007567405700683594 nb_pixel_total : 28627 time to create 1 rle with old method : 0.03384876251220703 length of segment : 194 time for calcul the mask position with numpy : 0.0014529228210449219 nb_pixel_total : 25979 time to create 1 rle with old method : 0.0293886661529541 length of segment : 295 time for calcul the mask position with numpy : 0.0010597705841064453 nb_pixel_total : 28136 time to create 1 rle with old method : 0.03364300727844238 length of segment : 300 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 15065 time to create 1 rle with old method : 0.01905226707458496 length of segment : 278 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 16722 time to create 1 rle with old method : 0.019685029983520508 length of segment : 113 time for calcul the mask position with numpy : 0.004480600357055664 nb_pixel_total : 138863 time to create 1 rle with old method : 0.1613481044769287 length of segment : 607 time for calcul the mask position with numpy : 0.005022287368774414 nb_pixel_total : 261273 time to create 1 rle with new method : 0.00950312614440918 length of segment : 1177 time for calcul the mask position with numpy : 0.0013077259063720703 nb_pixel_total : 45585 time to create 1 rle with old method : 0.051563262939453125 length of segment : 279 time for calcul the mask position with numpy : 0.0076029300689697266 nb_pixel_total : 359000 time to create 1 rle with new method : 0.015138387680053711 length of segment : 625 time for calcul the mask position with numpy : 0.0011408329010009766 nb_pixel_total : 44658 time to create 1 rle with old method : 0.051603078842163086 length of segment : 180 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 22927 time to create 1 rle with old method : 0.02716684341430664 length of segment : 128 time for calcul the mask position with numpy : 0.0012814998626708984 nb_pixel_total : 36723 time to create 1 rle with old method : 0.04299616813659668 length of segment : 201 time for calcul the mask position with numpy : 0.0006635189056396484 nb_pixel_total : 27043 time to create 1 rle with old method : 0.03104877471923828 length of segment : 212 time for calcul the mask position with numpy : 0.0005671977996826172 nb_pixel_total : 12160 time to create 1 rle with old method : 0.021909713745117188 length of segment : 146 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 36372 time to create 1 rle with old method : 0.05127525329589844 length of segment : 179 time for calcul the mask position with numpy : 0.0029718875885009766 nb_pixel_total : 112205 time to create 1 rle with old method : 0.12642598152160645 length of segment : 663 time for calcul the mask position with numpy : 0.0008397102355957031 nb_pixel_total : 26147 time to create 1 rle with old method : 0.03026890754699707 length of segment : 247 time for calcul the mask position with numpy : 0.013445615768432617 nb_pixel_total : 681993 time to create 1 rle with new method : 0.0369260311126709 length of segment : 1107 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 13627 time to create 1 rle with old method : 0.01588892936706543 length of segment : 217 time for calcul the mask position with numpy : 0.0006098747253417969 nb_pixel_total : 40145 time to create 1 rle with old method : 0.04738140106201172 length of segment : 130 time for calcul the mask position with numpy : 0.0011565685272216797 nb_pixel_total : 37084 time to create 1 rle with old method : 0.043209075927734375 length of segment : 239 time for calcul the mask position with numpy : 0.001177072525024414 nb_pixel_total : 2236 time to create 1 rle with old method : 0.0033082962036132812 length of segment : 55 time for calcul the mask position with numpy : 0.0007419586181640625 nb_pixel_total : 14369 time to create 1 rle with old method : 0.01774907112121582 length of segment : 144 time for calcul the mask position with numpy : 0.0010731220245361328 nb_pixel_total : 55850 time to create 1 rle with old method : 0.06650161743164062 length of segment : 310 time for calcul the mask position with numpy : 0.015289306640625 nb_pixel_total : 691400 time to create 1 rle with new method : 0.03571820259094238 length of segment : 1102 time for calcul the mask position with numpy : 0.0007758140563964844 nb_pixel_total : 38149 time to create 1 rle with old method : 0.044162750244140625 length of segment : 245 time for calcul the mask position with numpy : 0.0053844451904296875 nb_pixel_total : 214003 time to create 1 rle with new method : 0.009283065795898438 length of segment : 940 time for calcul the mask position with numpy : 0.0018374919891357422 nb_pixel_total : 79214 time to create 1 rle with old method : 0.09112334251403809 length of segment : 474 time for calcul the mask position with numpy : 0.0026590824127197266 nb_pixel_total : 86181 time to create 1 rle with old method : 0.09741830825805664 length of segment : 702 time for calcul the mask position with numpy : 0.003027677536010742 nb_pixel_total : 155714 time to create 1 rle with new method : 0.004042148590087891 length of segment : 414 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 20046 time to create 1 rle with old method : 0.023640155792236328 length of segment : 296 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 32503 time to create 1 rle with old method : 0.038140296936035156 length of segment : 226 time for calcul the mask position with numpy : 0.001378774642944336 nb_pixel_total : 29441 time to create 1 rle with old method : 0.03476071357727051 length of segment : 343 time for calcul the mask position with numpy : 0.0012481212615966797 nb_pixel_total : 46163 time to create 1 rle with old method : 0.05260610580444336 length of segment : 355 time for calcul the mask position with numpy : 0.003582000732421875 nb_pixel_total : 172503 time to create 1 rle with new method : 0.0068585872650146484 length of segment : 847 time for calcul the mask position with numpy : 0.0029649734497070312 nb_pixel_total : 120323 time to create 1 rle with old method : 0.13702058792114258 length of segment : 523 time for calcul the mask position with numpy : 0.0022497177124023438 nb_pixel_total : 152411 time to create 1 rle with new method : 0.004926919937133789 length of segment : 391 time for calcul the mask position with numpy : 0.0009775161743164062 nb_pixel_total : 37492 time to create 1 rle with old method : 0.04311966896057129 length of segment : 383 time for calcul the mask position with numpy : 0.17644357681274414 nb_pixel_total : 3615253 time to create 1 rle with new method : 0.6408824920654297 length of segment : 5213 time for calcul the mask position with numpy : 1.0062928199768066 nb_pixel_total : 4830734 time to create 1 rle with new method : 1.487671136856079 length of segment : 2048 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 12839 time to create 1 rle with old method : 0.014858007431030273 length of segment : 116 time for calcul the mask position with numpy : 0.34379029273986816 nb_pixel_total : 3474130 time to create 1 rle with new method : 0.45322251319885254 length of segment : 1462 time spent for convertir_results : 22.6145076751709 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 90.77409219741821 time spend to save output : 0.2980492115020752 total time spend for step 1 : 91.07214140892029 step2:mask_detect Mon Mar 10 15:43:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2723 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-10 15:43:05.715166: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-10 15:43:05.739281: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-10 15:43:05.740737: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdfc8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-10 15:43:05.740758: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-10 15:43:05.743589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-10 15:43:05.876426: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb1556a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-10 15:43:05.876472: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-10 15:43:05.877299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:43:05.877653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:43:05.879810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:43:05.881940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:43:05.882272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:43:05.884574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:43:05.885672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:43:05.890239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:43:05.891306: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:43:05.891413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:43:05.891966: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 15:43:05.891983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 15:43:05.891992: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 15:43:05.892887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-10 15:43:06.154225: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:43:06.154328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:43:06.154359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:43:06.154388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:43:06.154415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:43:06.154443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:43:06.154469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:43:06.154497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:43:06.155839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:43:06.156787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-10 15:43:06.156833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-10 15:43:06.156853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:43:06.156872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-10 15:43:06.156890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-10 15:43:06.156908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-10 15:43:06.156926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-10 15:43:06.156945: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:43:06.157802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-10 15:43:06.157829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-10 15:43:06.157838: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-10 15:43:06.157846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-10 15:43:06.158700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-10 15:43:19.370957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-10 15:43:19.582215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-10 15:43:21.324633: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.324723: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.331502: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.331537: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.385508: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.385623: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.428961: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.428998: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.481623: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.481664: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-10 15:43:21.484062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.22G (1309540352 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.484602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.10G (1178586368 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.484614: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-10 15:43:21.508631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.509769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.537602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.538158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.539788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.540360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.545717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.546290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.547910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.548437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.553883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.554410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.555904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.556427: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.582455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.583006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.583574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.584113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.587604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.588175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.603433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.603970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.604490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.605009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.617316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.617899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.618470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.619034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.623246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.623777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.628460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.629021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.641377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.641994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.646248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.646812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.647596: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.648213: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.658988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.659558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.660134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.660691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.661245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.661808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.697172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.697256: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-10 15:43:21.698239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.699212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.706527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.707127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.715167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.715702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.733695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.734418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.735181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.735881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.739899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.740430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.740954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.741477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.742365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.752697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.753254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.762333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.762908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.763481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.764035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.764598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-10 15:43:21.765158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1846411264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 63 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 3233245 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1751 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2944 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.031874895095825195 nb_pixel_total : 191055 time to create 1 rle with new method : 0.019799232482910156 length of segment : 689 time for calcul the mask position with numpy : 0.015553712844848633 nb_pixel_total : 99750 time to create 1 rle with old method : 0.11158156394958496 length of segment : 290 time for calcul the mask position with numpy : 0.03226733207702637 nb_pixel_total : 219752 time to create 1 rle with new method : 0.016994714736938477 length of segment : 806 time for calcul the mask position with numpy : 0.19317626953125 nb_pixel_total : 1678173 time to create 1 rle with new method : 0.2920684814453125 length of segment : 1832 time for calcul the mask position with numpy : 0.012697696685791016 nb_pixel_total : 299388 time to create 1 rle with new method : 0.01621699333190918 length of segment : 902 time for calcul the mask position with numpy : 0.005292177200317383 nb_pixel_total : 82206 time to create 1 rle with old method : 0.08979225158691406 length of segment : 596 time for calcul the mask position with numpy : 0.02837395668029785 nb_pixel_total : 276809 time to create 1 rle with new method : 0.017585277557373047 length of segment : 909 time for calcul the mask position with numpy : 0.023424625396728516 nb_pixel_total : 496402 time to create 1 rle with new method : 0.03349661827087402 length of segment : 977 time for calcul the mask position with numpy : 0.0008530616760253906 nb_pixel_total : 25627 time to create 1 rle with old method : 0.027591943740844727 length of segment : 129 time for calcul the mask position with numpy : 0.018938541412353516 nb_pixel_total : 561857 time to create 1 rle with new method : 0.020607709884643555 length of segment : 1266 time for calcul the mask position with numpy : 0.00900578498840332 nb_pixel_total : 295071 time to create 1 rle with new method : 0.013949155807495117 length of segment : 648 time for calcul the mask position with numpy : 0.0015828609466552734 nb_pixel_total : 40879 time to create 1 rle with old method : 0.04731297492980957 length of segment : 262 time for calcul the mask position with numpy : 0.07878518104553223 nb_pixel_total : 209646 time to create 1 rle with new method : 0.010776996612548828 length of segment : 465 time for calcul the mask position with numpy : 0.0043087005615234375 nb_pixel_total : 234087 time to create 1 rle with new method : 0.010565996170043945 length of segment : 793 time for calcul the mask position with numpy : 0.012066364288330078 nb_pixel_total : 354280 time to create 1 rle with new method : 0.023935556411743164 length of segment : 873 time for calcul the mask position with numpy : 0.012000560760498047 nb_pixel_total : 18353 time to create 1 rle with old method : 0.023012399673461914 length of segment : 289 time for calcul the mask position with numpy : 0.001444101333618164 nb_pixel_total : 89528 time to create 1 rle with old method : 0.09408974647521973 length of segment : 484 time for calcul the mask position with numpy : 0.000904083251953125 nb_pixel_total : 39015 time to create 1 rle with old method : 0.04381394386291504 length of segment : 168 time for calcul the mask position with numpy : 0.006330251693725586 nb_pixel_total : 78185 time to create 1 rle with old method : 0.08625340461730957 length of segment : 480 time for calcul the mask position with numpy : 0.0009980201721191406 nb_pixel_total : 35958 time to create 1 rle with old method : 0.04579472541809082 length of segment : 212 time for calcul the mask position with numpy : 0.00091552734375 nb_pixel_total : 33951 time to create 1 rle with old method : 0.03736472129821777 length of segment : 249 time for calcul the mask position with numpy : 0.02833414077758789 nb_pixel_total : 901982 time to create 1 rle with new method : 0.5909464359283447 length of segment : 1953 time for calcul the mask position with numpy : 0.002279996871948242 nb_pixel_total : 114509 time to create 1 rle with old method : 0.12643980979919434 length of segment : 388 time for calcul the mask position with numpy : 0.07564783096313477 nb_pixel_total : 1678117 time to create 1 rle with new method : 0.4768831729888916 length of segment : 2040 time for calcul the mask position with numpy : 0.002620220184326172 nb_pixel_total : 177876 time to create 1 rle with new method : 0.006114006042480469 length of segment : 405 time for calcul the mask position with numpy : 0.022526979446411133 nb_pixel_total : 34894 time to create 1 rle with old method : 0.04366016387939453 length of segment : 160 time for calcul the mask position with numpy : 0.0033769607543945312 nb_pixel_total : 210779 time to create 1 rle with new method : 0.009494304656982422 length of segment : 858 time for calcul the mask position with numpy : 0.01869940757751465 nb_pixel_total : 203010 time to create 1 rle with new method : 0.009808778762817383 length of segment : 903 time for calcul the mask position with numpy : 0.0025610923767089844 nb_pixel_total : 11930 time to create 1 rle with old method : 0.015137195587158203 length of segment : 183 time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 66603 time to create 1 rle with old method : 0.07573080062866211 length of segment : 314 time for calcul the mask position with numpy : 0.0007152557373046875 nb_pixel_total : 30551 time to create 1 rle with old method : 0.035212039947509766 length of segment : 171 time for calcul the mask position with numpy : 0.006552696228027344 nb_pixel_total : 15730 time to create 1 rle with old method : 0.01786494255065918 length of segment : 247 time for calcul the mask position with numpy : 0.001703023910522461 nb_pixel_total : 69207 time to create 1 rle with old method : 0.08124399185180664 length of segment : 418 time for calcul the mask position with numpy : 0.006417512893676758 nb_pixel_total : 254244 time to create 1 rle with new method : 0.012499570846557617 length of segment : 712 time for calcul the mask position with numpy : 0.0018703937530517578 nb_pixel_total : 63240 time to create 1 rle with old method : 0.07140183448791504 length of segment : 200 time for calcul the mask position with numpy : 0.001756906509399414 nb_pixel_total : 38329 time to create 1 rle with old method : 0.04580950736999512 length of segment : 219 time for calcul the mask position with numpy : 0.0015463829040527344 nb_pixel_total : 50195 time to create 1 rle with old method : 0.0570223331451416 length of segment : 257 time for calcul the mask position with numpy : 0.0023996829986572266 nb_pixel_total : 108784 time to create 1 rle with old method : 0.12592196464538574 length of segment : 454 time for calcul the mask position with numpy : 0.0024709701538085938 nb_pixel_total : 73475 time to create 1 rle with old method : 0.08059525489807129 length of segment : 208 time for calcul the mask position with numpy : 0.006249189376831055 nb_pixel_total : 294400 time to create 1 rle with new method : 0.019515037536621094 length of segment : 807 time for calcul the mask position with numpy : 0.01193547248840332 nb_pixel_total : 501469 time to create 1 rle with new method : 0.019330978393554688 length of segment : 623 time for calcul the mask position with numpy : 0.003407716751098633 nb_pixel_total : 73337 time to create 1 rle with old method : 0.08058595657348633 length of segment : 322 time for calcul the mask position with numpy : 0.0013577938079833984 nb_pixel_total : 82196 time to create 1 rle with old method : 0.09238743782043457 length of segment : 315 time for calcul the mask position with numpy : 0.0016036033630371094 nb_pixel_total : 99169 time to create 1 rle with old method : 0.10921239852905273 length of segment : 385 time for calcul the mask position with numpy : 0.0018591880798339844 nb_pixel_total : 108987 time to create 1 rle with old method : 0.11873459815979004 length of segment : 446 time for calcul the mask position with numpy : 0.00452113151550293 nb_pixel_total : 48788 time to create 1 rle with old method : 0.0541079044342041 length of segment : 240 time for calcul the mask position with numpy : 0.004094362258911133 nb_pixel_total : 219198 time to create 1 rle with new method : 0.009075164794921875 length of segment : 479 time for calcul the mask position with numpy : 0.08654570579528809 nb_pixel_total : 1162734 time to create 1 rle with new method : 0.6093823909759521 length of segment : 1372 time for calcul the mask position with numpy : 0.02672433853149414 nb_pixel_total : 212326 time to create 1 rle with new method : 0.008830070495605469 length of segment : 652 time for calcul the mask position with numpy : 0.02220439910888672 nb_pixel_total : 143941 time to create 1 rle with old method : 0.19117069244384766 length of segment : 246 time for calcul the mask position with numpy : 0.324939489364624 nb_pixel_total : 1400597 time to create 1 rle with new method : 0.2726454734802246 length of segment : 1190 time for calcul the mask position with numpy : 0.2434556484222412 nb_pixel_total : 1623168 time to create 1 rle with new method : 0.567103385925293 length of segment : 1942 time for calcul the mask position with numpy : 0.006468534469604492 nb_pixel_total : 279871 time to create 1 rle with new method : 0.017538070678710938 length of segment : 1008 time for calcul the mask position with numpy : 0.02675771713256836 nb_pixel_total : 89924 time to create 1 rle with old method : 0.10018444061279297 length of segment : 449 time for calcul the mask position with numpy : 0.013796806335449219 nb_pixel_total : 192047 time to create 1 rle with new method : 0.010974884033203125 length of segment : 541 time for calcul the mask position with numpy : 0.0036025047302246094 nb_pixel_total : 157522 time to create 1 rle with new method : 0.008762359619140625 length of segment : 502 time for calcul the mask position with numpy : 0.004778623580932617 nb_pixel_total : 65048 time to create 1 rle with old method : 0.09003353118896484 length of segment : 146 time for calcul the mask position with numpy : 0.03257393836975098 nb_pixel_total : 138972 time to create 1 rle with old method : 0.1548144817352295 length of segment : 515 time for calcul the mask position with numpy : 0.002955913543701172 nb_pixel_total : 71204 time to create 1 rle with old method : 0.0780177116394043 length of segment : 354 time for calcul the mask position with numpy : 0.007744789123535156 nb_pixel_total : 280811 time to create 1 rle with new method : 0.017438173294067383 length of segment : 1091 time for calcul the mask position with numpy : 0.038375139236450195 nb_pixel_total : 303895 time to create 1 rle with new method : 0.01355743408203125 length of segment : 755 time for calcul the mask position with numpy : 0.0061321258544921875 nb_pixel_total : 225407 time to create 1 rle with new method : 0.008733510971069336 length of segment : 550 time for calcul the mask position with numpy : 0.040224313735961914 nb_pixel_total : 351111 time to create 1 rle with new method : 0.01885700225830078 length of segment : 651 time for calcul the mask position with numpy : 0.009959697723388672 nb_pixel_total : 206899 time to create 1 rle with new method : 0.009507179260253906 length of segment : 622 time for calcul the mask position with numpy : 0.002322673797607422 nb_pixel_total : 26160 time to create 1 rle with old method : 0.029593944549560547 length of segment : 178 time for calcul the mask position with numpy : 0.0013756752014160156 nb_pixel_total : 72424 time to create 1 rle with old method : 0.11728572845458984 length of segment : 594 time for calcul the mask position with numpy : 0.0004913806915283203 nb_pixel_total : 23498 time to create 1 rle with old method : 0.026525259017944336 length of segment : 240 time for calcul the mask position with numpy : 0.005712270736694336 nb_pixel_total : 262487 time to create 1 rle with new method : 0.013896465301513672 length of segment : 460 time for calcul the mask position with numpy : 0.0037381649017333984 nb_pixel_total : 201637 time to create 1 rle with new method : 0.009767770767211914 length of segment : 352 time for calcul the mask position with numpy : 0.02398538589477539 nb_pixel_total : 206092 time to create 1 rle with new method : 0.0122528076171875 length of segment : 483 time for calcul the mask position with numpy : 0.002053976058959961 nb_pixel_total : 112858 time to create 1 rle with old method : 0.1270885467529297 length of segment : 467 time for calcul the mask position with numpy : 0.0061342716217041016 nb_pixel_total : 56007 time to create 1 rle with old method : 0.08279728889465332 length of segment : 334 time for calcul the mask position with numpy : 0.0033605098724365234 nb_pixel_total : 143419 time to create 1 rle with old method : 0.1610736846923828 length of segment : 746 time for calcul the mask position with numpy : 0.002624988555908203 nb_pixel_total : 170264 time to create 1 rle with new method : 0.006736040115356445 length of segment : 443 time for calcul the mask position with numpy : 0.05066490173339844 nb_pixel_total : 986598 time to create 1 rle with new method : 0.154829740524292 length of segment : 1358 time for calcul the mask position with numpy : 0.002687215805053711 nb_pixel_total : 80412 time to create 1 rle with old method : 0.10056376457214355 length of segment : 427 time for calcul the mask position with numpy : 0.008321285247802734 nb_pixel_total : 316437 time to create 1 rle with new method : 0.022193431854248047 length of segment : 869 time for calcul the mask position with numpy : 0.001117706298828125 nb_pixel_total : 36383 time to create 1 rle with old method : 0.04443860054016113 length of segment : 310 time for calcul the mask position with numpy : 0.0012505054473876953 nb_pixel_total : 54560 time to create 1 rle with old method : 0.06723666191101074 length of segment : 317 time for calcul the mask position with numpy : 0.0055065155029296875 nb_pixel_total : 94896 time to create 1 rle with old method : 0.11292910575866699 length of segment : 417 time for calcul the mask position with numpy : 0.0022521018981933594 nb_pixel_total : 115021 time to create 1 rle with old method : 0.1305232048034668 length of segment : 492 time for calcul the mask position with numpy : 0.008786201477050781 nb_pixel_total : 281652 time to create 1 rle with new method : 0.06084084510803223 length of segment : 1062 time for calcul the mask position with numpy : 0.001129150390625 nb_pixel_total : 53282 time to create 1 rle with old method : 0.05782723426818848 length of segment : 399 time for calcul the mask position with numpy : 0.0034885406494140625 nb_pixel_total : 197677 time to create 1 rle with new method : 0.009424924850463867 length of segment : 393 time for calcul the mask position with numpy : 0.003463268280029297 nb_pixel_total : 212230 time to create 1 rle with new method : 0.009350061416625977 length of segment : 648 time for calcul the mask position with numpy : 0.004801511764526367 nb_pixel_total : 207244 time to create 1 rle with new method : 0.014205455780029297 length of segment : 662 time for calcul the mask position with numpy : 0.0035114288330078125 nb_pixel_total : 161747 time to create 1 rle with new method : 0.006112098693847656 length of segment : 393 time for calcul the mask position with numpy : 0.000919342041015625 nb_pixel_total : 4596 time to create 1 rle with old method : 0.005804538726806641 length of segment : 224 time for calcul the mask position with numpy : 0.0037691593170166016 nb_pixel_total : 50417 time to create 1 rle with old method : 0.05874347686767578 length of segment : 224 time for calcul the mask position with numpy : 0.01720285415649414 nb_pixel_total : 742988 time to create 1 rle with new method : 0.09884953498840332 length of segment : 1098 time for calcul the mask position with numpy : 0.0058252811431884766 nb_pixel_total : 261107 time to create 1 rle with new method : 0.016760826110839844 length of segment : 820 time for calcul the mask position with numpy : 0.0009300708770751953 nb_pixel_total : 46652 time to create 1 rle with old method : 0.06879401206970215 length of segment : 213 time for calcul the mask position with numpy : 0.0016269683837890625 nb_pixel_total : 43703 time to create 1 rle with old method : 0.04813361167907715 length of segment : 277 time for calcul the mask position with numpy : 0.00493311882019043 nb_pixel_total : 247675 time to create 1 rle with new method : 0.011485815048217773 length of segment : 452 time for calcul the mask position with numpy : 0.01273345947265625 nb_pixel_total : 559829 time to create 1 rle with new method : 0.30104589462280273 length of segment : 1197 time for calcul the mask position with numpy : 0.0024881362915039062 nb_pixel_total : 129576 time to create 1 rle with old method : 0.14734649658203125 length of segment : 512 time for calcul the mask position with numpy : 0.001445770263671875 nb_pixel_total : 54233 time to create 1 rle with old method : 0.062340736389160156 length of segment : 276 time for calcul the mask position with numpy : 0.009100914001464844 nb_pixel_total : 310019 time to create 1 rle with new method : 0.020685911178588867 length of segment : 727 time for calcul the mask position with numpy : 0.01829051971435547 nb_pixel_total : 498059 time to create 1 rle with new method : 0.1597301959991455 length of segment : 929 time for calcul the mask position with numpy : 0.0013916492462158203 nb_pixel_total : 42831 time to create 1 rle with old method : 0.04759526252746582 length of segment : 256 time for calcul the mask position with numpy : 0.0036537647247314453 nb_pixel_total : 182437 time to create 1 rle with new method : 0.008885383605957031 length of segment : 413 time for calcul the mask position with numpy : 0.013753890991210938 nb_pixel_total : 522179 time to create 1 rle with new method : 0.03238987922668457 length of segment : 1105 time for calcul the mask position with numpy : 0.0011966228485107422 nb_pixel_total : 57481 time to create 1 rle with old method : 0.06587338447570801 length of segment : 237 time for calcul the mask position with numpy : 0.0020203590393066406 nb_pixel_total : 69048 time to create 1 rle with old method : 0.07666873931884766 length of segment : 356 time for calcul the mask position with numpy : 0.0050084590911865234 nb_pixel_total : 192850 time to create 1 rle with new method : 0.011294364929199219 length of segment : 764 time for calcul the mask position with numpy : 0.002922534942626953 nb_pixel_total : 96123 time to create 1 rle with old method : 0.1062161922454834 length of segment : 587 time for calcul the mask position with numpy : 0.0007660388946533203 nb_pixel_total : 34074 time to create 1 rle with old method : 0.038086652755737305 length of segment : 190 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 12706 time to create 1 rle with old method : 0.014811515808105469 length of segment : 122 time for calcul the mask position with numpy : 0.0010738372802734375 nb_pixel_total : 22641 time to create 1 rle with old method : 0.02556014060974121 length of segment : 211 time for calcul the mask position with numpy : 0.009792804718017578 nb_pixel_total : 272770 time to create 1 rle with new method : 0.029385805130004883 length of segment : 1093 time for calcul the mask position with numpy : 0.001077413558959961 nb_pixel_total : 58177 time to create 1 rle with old method : 0.07259845733642578 length of segment : 284 time for calcul the mask position with numpy : 0.000759124755859375 nb_pixel_total : 23970 time to create 1 rle with old method : 0.027335405349731445 length of segment : 156 time for calcul the mask position with numpy : 0.003499269485473633 nb_pixel_total : 68703 time to create 1 rle with old method : 0.07467961311340332 length of segment : 383 time for calcul the mask position with numpy : 0.008176326751708984 nb_pixel_total : 342242 time to create 1 rle with new method : 0.02217864990234375 length of segment : 991 time for calcul the mask position with numpy : 0.0029494762420654297 nb_pixel_total : 94255 time to create 1 rle with old method : 0.12250614166259766 length of segment : 376 time for calcul the mask position with numpy : 0.0007548332214355469 nb_pixel_total : 30855 time to create 1 rle with old method : 0.03446173667907715 length of segment : 249 time for calcul the mask position with numpy : 0.011394739151000977 nb_pixel_total : 432228 time to create 1 rle with new method : 0.030605316162109375 length of segment : 771 time for calcul the mask position with numpy : 0.002868175506591797 nb_pixel_total : 98560 time to create 1 rle with old method : 0.10893869400024414 length of segment : 459 time for calcul the mask position with numpy : 0.0031659603118896484 nb_pixel_total : 119738 time to create 1 rle with old method : 0.13425374031066895 length of segment : 421 time for calcul the mask position with numpy : 0.002000570297241211 nb_pixel_total : 88826 time to create 1 rle with old method : 0.09881186485290527 length of segment : 240 time for calcul the mask position with numpy : 0.005937099456787109 nb_pixel_total : 250273 time to create 1 rle with new method : 0.012041568756103516 length of segment : 833 time for calcul the mask position with numpy : 0.0029625892639160156 nb_pixel_total : 119527 time to create 1 rle with old method : 0.1345059871673584 length of segment : 402 time for calcul the mask position with numpy : 0.0014874935150146484 nb_pixel_total : 68680 time to create 1 rle with old method : 0.07804107666015625 length of segment : 449 time for calcul the mask position with numpy : 0.003892183303833008 nb_pixel_total : 105628 time to create 1 rle with old method : 0.1321091651916504 length of segment : 340 time for calcul the mask position with numpy : 0.00045490264892578125 nb_pixel_total : 12286 time to create 1 rle with old method : 0.014822721481323242 length of segment : 120 time for calcul the mask position with numpy : 0.0027480125427246094 nb_pixel_total : 96621 time to create 1 rle with old method : 0.11367082595825195 length of segment : 466 time for calcul the mask position with numpy : 0.004717588424682617 nb_pixel_total : 219246 time to create 1 rle with new method : 0.012325286865234375 length of segment : 881 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 27173 time to create 1 rle with old method : 0.04275035858154297 length of segment : 166 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 72521 time to create 1 rle with old method : 0.11490249633789062 length of segment : 446 time for calcul the mask position with numpy : 0.0173795223236084 nb_pixel_total : 531315 time to create 1 rle with new method : 0.06361746788024902 length of segment : 1151 time for calcul the mask position with numpy : 0.0012454986572265625 nb_pixel_total : 51588 time to create 1 rle with old method : 0.059790611267089844 length of segment : 213 time for calcul the mask position with numpy : 0.002214670181274414 nb_pixel_total : 64235 time to create 1 rle with old method : 0.07088971138000488 length of segment : 270 time for calcul the mask position with numpy : 0.0009739398956298828 nb_pixel_total : 41526 time to create 1 rle with old method : 0.045922040939331055 length of segment : 282 time for calcul the mask position with numpy : 0.0031130313873291016 nb_pixel_total : 140715 time to create 1 rle with old method : 0.1547529697418213 length of segment : 492 time for calcul the mask position with numpy : 0.009945392608642578 nb_pixel_total : 385944 time to create 1 rle with new method : 0.02772045135498047 length of segment : 1044 time for calcul the mask position with numpy : 0.00047016143798828125 nb_pixel_total : 26616 time to create 1 rle with old method : 0.030364513397216797 length of segment : 130 time for calcul the mask position with numpy : 0.002143383026123047 nb_pixel_total : 85867 time to create 1 rle with old method : 0.09866046905517578 length of segment : 451 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 51415 time to create 1 rle with old method : 0.05808115005493164 length of segment : 364 time for calcul the mask position with numpy : 0.002357959747314453 nb_pixel_total : 81479 time to create 1 rle with old method : 0.09579730033874512 length of segment : 473 time for calcul the mask position with numpy : 0.00844573974609375 nb_pixel_total : 395997 time to create 1 rle with new method : 0.021837949752807617 length of segment : 636 time for calcul the mask position with numpy : 0.0005881786346435547 nb_pixel_total : 30805 time to create 1 rle with old method : 0.03495383262634277 length of segment : 207 time for calcul the mask position with numpy : 0.0036618709564208984 nb_pixel_total : 169676 time to create 1 rle with new method : 0.007566213607788086 length of segment : 319 time for calcul the mask position with numpy : 0.0028510093688964844 nb_pixel_total : 120379 time to create 1 rle with old method : 0.1346137523651123 length of segment : 539 time for calcul the mask position with numpy : 0.0011637210845947266 nb_pixel_total : 74692 time to create 1 rle with old method : 0.09224748611450195 length of segment : 317 time for calcul the mask position with numpy : 0.0012238025665283203 nb_pixel_total : 44335 time to create 1 rle with old method : 0.05154252052307129 length of segment : 242 time for calcul the mask position with numpy : 0.0023484230041503906 nb_pixel_total : 38879 time to create 1 rle with old method : 0.04472637176513672 length of segment : 393 time for calcul the mask position with numpy : 0.0019474029541015625 nb_pixel_total : 117041 time to create 1 rle with old method : 0.1541295051574707 length of segment : 234 time for calcul the mask position with numpy : 0.0015785694122314453 nb_pixel_total : 65845 time to create 1 rle with old method : 0.07504677772521973 length of segment : 393 time for calcul the mask position with numpy : 0.00199127197265625 nb_pixel_total : 103906 time to create 1 rle with old method : 0.11682367324829102 length of segment : 296 time for calcul the mask position with numpy : 0.0039348602294921875 nb_pixel_total : 191528 time to create 1 rle with new method : 0.010107994079589844 length of segment : 309 time for calcul the mask position with numpy : 0.0019350051879882812 nb_pixel_total : 115019 time to create 1 rle with old method : 0.1284949779510498 length of segment : 292 time for calcul the mask position with numpy : 0.0013337135314941406 nb_pixel_total : 47576 time to create 1 rle with old method : 0.05681443214416504 length of segment : 276 time for calcul the mask position with numpy : 0.002264261245727539 nb_pixel_total : 76646 time to create 1 rle with old method : 0.0934903621673584 length of segment : 407 time for calcul the mask position with numpy : 0.004199981689453125 nb_pixel_total : 219337 time to create 1 rle with new method : 0.012459278106689453 length of segment : 834 time for calcul the mask position with numpy : 0.001338958740234375 nb_pixel_total : 72209 time to create 1 rle with old method : 0.07992267608642578 length of segment : 233 time for calcul the mask position with numpy : 0.0008754730224609375 nb_pixel_total : 31101 time to create 1 rle with old method : 0.033946990966796875 length of segment : 159 time for calcul the mask position with numpy : 0.0006492137908935547 nb_pixel_total : 21220 time to create 1 rle with old method : 0.03404736518859863 length of segment : 148 time for calcul the mask position with numpy : 0.0012788772583007812 nb_pixel_total : 41816 time to create 1 rle with old method : 0.05255937576293945 length of segment : 257 time for calcul the mask position with numpy : 0.001997232437133789 nb_pixel_total : 57317 time to create 1 rle with old method : 0.08670210838317871 length of segment : 262 time for calcul the mask position with numpy : 0.0010766983032226562 nb_pixel_total : 53805 time to create 1 rle with old method : 0.060903310775756836 length of segment : 320 time for calcul the mask position with numpy : 0.0017011165618896484 nb_pixel_total : 60146 time to create 1 rle with old method : 0.06741166114807129 length of segment : 262 time for calcul the mask position with numpy : 0.008193492889404297 nb_pixel_total : 358805 time to create 1 rle with new method : 0.017868995666503906 length of segment : 711 time for calcul the mask position with numpy : 0.001674652099609375 nb_pixel_total : 63695 time to create 1 rle with old method : 0.1048276424407959 length of segment : 227 time for calcul the mask position with numpy : 0.004965305328369141 nb_pixel_total : 213474 time to create 1 rle with new method : 0.011842966079711914 length of segment : 545 time for calcul the mask position with numpy : 0.022105693817138672 nb_pixel_total : 815374 time to create 1 rle with new method : 0.09026932716369629 length of segment : 1516 time for calcul the mask position with numpy : 0.0009317398071289062 nb_pixel_total : 18941 time to create 1 rle with old method : 0.021075010299682617 length of segment : 222 time for calcul the mask position with numpy : 0.004509925842285156 nb_pixel_total : 188495 time to create 1 rle with new method : 0.012765169143676758 length of segment : 578 time for calcul the mask position with numpy : 0.0027120113372802734 nb_pixel_total : 131615 time to create 1 rle with old method : 0.14912700653076172 length of segment : 379 time for calcul the mask position with numpy : 0.0041294097900390625 nb_pixel_total : 129448 time to create 1 rle with old method : 0.1509387493133545 length of segment : 412 time for calcul the mask position with numpy : 0.005498170852661133 nb_pixel_total : 321064 time to create 1 rle with new method : 0.011533737182617188 length of segment : 714 time for calcul the mask position with numpy : 0.0015685558319091797 nb_pixel_total : 46622 time to create 1 rle with old method : 0.051891326904296875 length of segment : 237 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 18322 time to create 1 rle with old method : 0.020659923553466797 length of segment : 227 time for calcul the mask position with numpy : 0.0007619857788085938 nb_pixel_total : 38653 time to create 1 rle with old method : 0.05707287788391113 length of segment : 253 time for calcul the mask position with numpy : 0.00805521011352539 nb_pixel_total : 413051 time to create 1 rle with new method : 0.029233217239379883 length of segment : 651 time for calcul the mask position with numpy : 0.0024077892303466797 nb_pixel_total : 117358 time to create 1 rle with old method : 0.1318216323852539 length of segment : 591 time for calcul the mask position with numpy : 0.001775503158569336 nb_pixel_total : 35914 time to create 1 rle with old method : 0.04158282279968262 length of segment : 305 time for calcul the mask position with numpy : 0.008837461471557617 nb_pixel_total : 413750 time to create 1 rle with new method : 0.022440433502197266 length of segment : 518 time for calcul the mask position with numpy : 0.0016543865203857422 nb_pixel_total : 54348 time to create 1 rle with old method : 0.06091189384460449 length of segment : 250 time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 26945 time to create 1 rle with old method : 0.03151583671569824 length of segment : 240 time for calcul the mask position with numpy : 0.003098726272583008 nb_pixel_total : 155907 time to create 1 rle with new method : 0.008152961730957031 length of segment : 540 time for calcul the mask position with numpy : 0.0020275115966796875 nb_pixel_total : 85294 time to create 1 rle with old method : 0.09249520301818848 length of segment : 448 time for calcul the mask position with numpy : 0.000743865966796875 nb_pixel_total : 40710 time to create 1 rle with old method : 0.04570651054382324 length of segment : 248 time for calcul the mask position with numpy : 0.0018429756164550781 nb_pixel_total : 74656 time to create 1 rle with old method : 0.08332276344299316 length of segment : 412 time for calcul the mask position with numpy : 0.0011501312255859375 nb_pixel_total : 44642 time to create 1 rle with old method : 0.04841327667236328 length of segment : 227 time for calcul the mask position with numpy : 0.007422924041748047 nb_pixel_total : 219640 time to create 1 rle with new method : 0.02066946029663086 length of segment : 619 time for calcul the mask position with numpy : 0.008695363998413086 nb_pixel_total : 431782 time to create 1 rle with new method : 0.02045750617980957 length of segment : 1172 time for calcul the mask position with numpy : 0.0013911724090576172 nb_pixel_total : 50422 time to create 1 rle with old method : 0.06608176231384277 length of segment : 411 time for calcul the mask position with numpy : 0.015689849853515625 nb_pixel_total : 480884 time to create 1 rle with new method : 0.0485081672668457 length of segment : 668 time for calcul the mask position with numpy : 0.00041985511779785156 nb_pixel_total : 18419 time to create 1 rle with old method : 0.020613431930541992 length of segment : 194 time for calcul the mask position with numpy : 0.0030808448791503906 nb_pixel_total : 130516 time to create 1 rle with old method : 0.1478128433227539 length of segment : 646 time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 24718 time to create 1 rle with old method : 0.03794980049133301 length of segment : 116 time for calcul the mask position with numpy : 0.0009381771087646484 nb_pixel_total : 45362 time to create 1 rle with old method : 0.05236482620239258 length of segment : 364 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 18640 time to create 1 rle with old method : 0.02157139778137207 length of segment : 130 time for calcul the mask position with numpy : 0.0012226104736328125 nb_pixel_total : 62494 time to create 1 rle with old method : 0.07091307640075684 length of segment : 206 time for calcul the mask position with numpy : 0.0015816688537597656 nb_pixel_total : 83826 time to create 1 rle with old method : 0.11434459686279297 length of segment : 252 time for calcul the mask position with numpy : 0.0015039443969726562 nb_pixel_total : 62042 time to create 1 rle with old method : 0.06953096389770508 length of segment : 252 time for calcul the mask position with numpy : 0.0013980865478515625 nb_pixel_total : 81249 time to create 1 rle with old method : 0.08959031105041504 length of segment : 467 time for calcul the mask position with numpy : 0.012027502059936523 nb_pixel_total : 332779 time to create 1 rle with new method : 0.03637409210205078 length of segment : 1304 time for calcul the mask position with numpy : 0.0012750625610351562 nb_pixel_total : 60279 time to create 1 rle with old method : 0.06625986099243164 length of segment : 303 time for calcul the mask position with numpy : 0.0020284652709960938 nb_pixel_total : 100076 time to create 1 rle with old method : 0.11102795600891113 length of segment : 400 time for calcul the mask position with numpy : 0.0026917457580566406 nb_pixel_total : 127077 time to create 1 rle with old method : 0.14457917213439941 length of segment : 235 time for calcul the mask position with numpy : 0.019258499145507812 nb_pixel_total : 906638 time to create 1 rle with new method : 0.17143511772155762 length of segment : 1943 time for calcul the mask position with numpy : 0.004069328308105469 nb_pixel_total : 129772 time to create 1 rle with old method : 0.1740100383758545 length of segment : 415 time for calcul the mask position with numpy : 0.0015783309936523438 nb_pixel_total : 70385 time to create 1 rle with old method : 0.07757425308227539 length of segment : 451 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 298733 time to create 1 rle with new method : 0.012945890426635742 length of segment : 403 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 33867 time to create 1 rle with old method : 0.07590556144714355 length of segment : 114 time for calcul the mask position with numpy : 0.012620687484741211 nb_pixel_total : 507910 time to create 1 rle with new method : 0.13262319564819336 length of segment : 677 time for calcul the mask position with numpy : 0.0029001235961914062 nb_pixel_total : 145762 time to create 1 rle with old method : 0.16615676879882812 length of segment : 441 time for calcul the mask position with numpy : 0.003118753433227539 nb_pixel_total : 150530 time to create 1 rle with new method : 0.01070547103881836 length of segment : 416 time for calcul the mask position with numpy : 0.002969503402709961 nb_pixel_total : 136285 time to create 1 rle with old method : 0.15594887733459473 length of segment : 410 time for calcul the mask position with numpy : 0.018532276153564453 nb_pixel_total : 525036 time to create 1 rle with new method : 0.05654120445251465 length of segment : 708 time for calcul the mask position with numpy : 0.003343820571899414 nb_pixel_total : 134025 time to create 1 rle with old method : 0.18543124198913574 length of segment : 501 time for calcul the mask position with numpy : 0.0013303756713867188 nb_pixel_total : 44257 time to create 1 rle with old method : 0.05155324935913086 length of segment : 267 time for calcul the mask position with numpy : 0.0012085437774658203 nb_pixel_total : 35619 time to create 1 rle with old method : 0.04348587989807129 length of segment : 216 time for calcul the mask position with numpy : 0.004533529281616211 nb_pixel_total : 200926 time to create 1 rle with new method : 0.01322627067565918 length of segment : 842 time for calcul the mask position with numpy : 0.0026786327362060547 nb_pixel_total : 87786 time to create 1 rle with old method : 0.10085439682006836 length of segment : 591 time for calcul the mask position with numpy : 0.007310390472412109 nb_pixel_total : 248254 time to create 1 rle with new method : 0.022068023681640625 length of segment : 614 time for calcul the mask position with numpy : 0.0010223388671875 nb_pixel_total : 42481 time to create 1 rle with old method : 0.048972129821777344 length of segment : 295 time for calcul the mask position with numpy : 0.0022575855255126953 nb_pixel_total : 95550 time to create 1 rle with old method : 0.1658937931060791 length of segment : 441 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 17526 time to create 1 rle with old method : 0.028814077377319336 length of segment : 135 time for calcul the mask position with numpy : 0.001316070556640625 nb_pixel_total : 37372 time to create 1 rle with old method : 0.044859886169433594 length of segment : 254 time for calcul the mask position with numpy : 0.0007674694061279297 nb_pixel_total : 15848 time to create 1 rle with old method : 0.018866539001464844 length of segment : 181 time for calcul the mask position with numpy : 0.0026900768280029297 nb_pixel_total : 83862 time to create 1 rle with old method : 0.09815764427185059 length of segment : 325 time for calcul the mask position with numpy : 0.002481222152709961 nb_pixel_total : 102070 time to create 1 rle with old method : 0.11386823654174805 length of segment : 403 time for calcul the mask position with numpy : 0.0015633106231689453 nb_pixel_total : 74084 time to create 1 rle with old method : 0.08406686782836914 length of segment : 288 time for calcul the mask position with numpy : 0.003334522247314453 nb_pixel_total : 148914 time to create 1 rle with old method : 0.18901729583740234 length of segment : 649 time for calcul the mask position with numpy : 0.008924245834350586 nb_pixel_total : 214121 time to create 1 rle with new method : 0.023389577865600586 length of segment : 526 time for calcul the mask position with numpy : 0.0009090900421142578 nb_pixel_total : 25796 time to create 1 rle with old method : 0.03005051612854004 length of segment : 239 time for calcul the mask position with numpy : 0.002053499221801758 nb_pixel_total : 100528 time to create 1 rle with old method : 0.11420679092407227 length of segment : 313 time for calcul the mask position with numpy : 0.0007078647613525391 nb_pixel_total : 13799 time to create 1 rle with old method : 0.0184328556060791 length of segment : 160 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 20460 time to create 1 rle with old method : 0.03350019454956055 length of segment : 170 time for calcul the mask position with numpy : 0.005411624908447266 nb_pixel_total : 198779 time to create 1 rle with new method : 0.01563715934753418 length of segment : 639 time for calcul the mask position with numpy : 0.006590843200683594 nb_pixel_total : 263901 time to create 1 rle with new method : 0.017709732055664062 length of segment : 1589 time for calcul the mask position with numpy : 0.0012340545654296875 nb_pixel_total : 41392 time to create 1 rle with old method : 0.04892897605895996 length of segment : 307 time for calcul the mask position with numpy : 0.0035276412963867188 nb_pixel_total : 196674 time to create 1 rle with new method : 0.00979161262512207 length of segment : 497 time for calcul the mask position with numpy : 0.0020275115966796875 nb_pixel_total : 73392 time to create 1 rle with old method : 0.08442020416259766 length of segment : 330 time for calcul the mask position with numpy : 0.0061337947845458984 nb_pixel_total : 206315 time to create 1 rle with new method : 0.019863128662109375 length of segment : 842 time for calcul the mask position with numpy : 0.0017740726470947266 nb_pixel_total : 93435 time to create 1 rle with old method : 0.10598874092102051 length of segment : 446 time for calcul the mask position with numpy : 0.005269050598144531 nb_pixel_total : 243650 time to create 1 rle with new method : 0.015290260314941406 length of segment : 816 time for calcul the mask position with numpy : 0.001062631607055664 nb_pixel_total : 40484 time to create 1 rle with old method : 0.04685544967651367 length of segment : 232 time for calcul the mask position with numpy : 0.0012638568878173828 nb_pixel_total : 43450 time to create 1 rle with old method : 0.05246758460998535 length of segment : 295 time for calcul the mask position with numpy : 0.0022559165954589844 nb_pixel_total : 119487 time to create 1 rle with old method : 0.1412811279296875 length of segment : 413 time for calcul the mask position with numpy : 0.008567571640014648 nb_pixel_total : 288689 time to create 1 rle with new method : 0.026896953582763672 length of segment : 822 time for calcul the mask position with numpy : 0.0017986297607421875 nb_pixel_total : 53027 time to create 1 rle with old method : 0.06012225151062012 length of segment : 261 time for calcul the mask position with numpy : 0.0007781982421875 nb_pixel_total : 29328 time to create 1 rle with old method : 0.03487420082092285 length of segment : 125 time for calcul the mask position with numpy : 0.0010035037994384766 nb_pixel_total : 32374 time to create 1 rle with old method : 0.03796195983886719 length of segment : 190 time for calcul the mask position with numpy : 0.01933145523071289 nb_pixel_total : 393257 time to create 1 rle with new method : 0.029952049255371094 length of segment : 671 time for calcul the mask position with numpy : 0.0026619434356689453 nb_pixel_total : 41948 time to create 1 rle with old method : 0.047542572021484375 length of segment : 190 time for calcul the mask position with numpy : 0.004994869232177734 nb_pixel_total : 163224 time to create 1 rle with new method : 0.014081239700317383 length of segment : 498 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 71287 time to create 1 rle with old method : 0.08815288543701172 length of segment : 240 time for calcul the mask position with numpy : 0.0032041072845458984 nb_pixel_total : 123845 time to create 1 rle with old method : 0.15215229988098145 length of segment : 413 time for calcul the mask position with numpy : 0.0031549930572509766 nb_pixel_total : 102682 time to create 1 rle with old method : 0.11224699020385742 length of segment : 465 time for calcul the mask position with numpy : 0.011111259460449219 nb_pixel_total : 469301 time to create 1 rle with new method : 0.030619144439697266 length of segment : 1002 time for calcul the mask position with numpy : 0.003683328628540039 nb_pixel_total : 52020 time to create 1 rle with old method : 0.05951333045959473 length of segment : 421 time for calcul the mask position with numpy : 0.0004942417144775391 nb_pixel_total : 9257 time to create 1 rle with old method : 0.010724067687988281 length of segment : 174 time for calcul the mask position with numpy : 0.005942583084106445 nb_pixel_total : 159029 time to create 1 rle with new method : 0.018262863159179688 length of segment : 780 time for calcul the mask position with numpy : 0.008664846420288086 nb_pixel_total : 139936 time to create 1 rle with old method : 0.18164324760437012 length of segment : 476 time for calcul the mask position with numpy : 0.003283977508544922 nb_pixel_total : 6578 time to create 1 rle with old method : 0.011070013046264648 length of segment : 110 time for calcul the mask position with numpy : 0.020890474319458008 nb_pixel_total : 191283 time to create 1 rle with new method : 0.026990175247192383 length of segment : 884 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 28854 time to create 1 rle with old method : 0.03300666809082031 length of segment : 218 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 20153 time to create 1 rle with old method : 0.022969722747802734 length of segment : 166 time for calcul the mask position with numpy : 0.0013186931610107422 nb_pixel_total : 35343 time to create 1 rle with old method : 0.046326398849487305 length of segment : 183 time for calcul the mask position with numpy : 0.004142284393310547 nb_pixel_total : 92834 time to create 1 rle with old method : 0.1037607192993164 length of segment : 477 time for calcul the mask position with numpy : 0.0035142898559570312 nb_pixel_total : 72261 time to create 1 rle with old method : 0.08181619644165039 length of segment : 340 time for calcul the mask position with numpy : 0.002466917037963867 nb_pixel_total : 41456 time to create 1 rle with old method : 0.047918081283569336 length of segment : 298 time for calcul the mask position with numpy : 0.007642269134521484 nb_pixel_total : 67800 time to create 1 rle with old method : 0.07559728622436523 length of segment : 629 time for calcul the mask position with numpy : 0.004797697067260742 nb_pixel_total : 69659 time to create 1 rle with old method : 0.0794210433959961 length of segment : 275 time for calcul the mask position with numpy : 0.0017075538635253906 nb_pixel_total : 91410 time to create 1 rle with old method : 0.10342264175415039 length of segment : 463 time for calcul the mask position with numpy : 0.0022497177124023438 nb_pixel_total : 102872 time to create 1 rle with old method : 0.12725019454956055 length of segment : 288 time for calcul the mask position with numpy : 0.010418176651000977 nb_pixel_total : 327907 time to create 1 rle with new method : 0.018122196197509766 length of segment : 1263 time for calcul the mask position with numpy : 0.0006592273712158203 nb_pixel_total : 29245 time to create 1 rle with old method : 0.046681880950927734 length of segment : 296 time for calcul the mask position with numpy : 0.004669666290283203 nb_pixel_total : 190483 time to create 1 rle with new method : 0.01211690902709961 length of segment : 507 time for calcul the mask position with numpy : 0.027655363082885742 nb_pixel_total : 553808 time to create 1 rle with new method : 0.049338340759277344 length of segment : 829 time for calcul the mask position with numpy : 0.0025115013122558594 nb_pixel_total : 49720 time to create 1 rle with old method : 0.061623334884643555 length of segment : 297 time for calcul the mask position with numpy : 0.015069007873535156 nb_pixel_total : 539040 time to create 1 rle with new method : 0.0411679744720459 length of segment : 1028 time for calcul the mask position with numpy : 0.007102012634277344 nb_pixel_total : 154653 time to create 1 rle with new method : 0.006989717483520508 length of segment : 482 time for calcul the mask position with numpy : 0.002045869827270508 nb_pixel_total : 91555 time to create 1 rle with old method : 0.1327829360961914 length of segment : 387 time for calcul the mask position with numpy : 0.03579425811767578 nb_pixel_total : 711366 time to create 1 rle with new method : 0.2866394519805908 length of segment : 968 time for calcul the mask position with numpy : 0.018404483795166016 nb_pixel_total : 259092 time to create 1 rle with new method : 0.028157949447631836 length of segment : 693 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 126893 time to create 1 rle with old method : 0.1439812183380127 length of segment : 484 time for calcul the mask position with numpy : 0.0028519630432128906 nb_pixel_total : 79499 time to create 1 rle with old method : 0.09333682060241699 length of segment : 324 time for calcul the mask position with numpy : 0.04013848304748535 nb_pixel_total : 714523 time to create 1 rle with new method : 0.11885523796081543 length of segment : 1039 time for calcul the mask position with numpy : 0.004969120025634766 nb_pixel_total : 103071 time to create 1 rle with old method : 0.11366796493530273 length of segment : 533 time for calcul the mask position with numpy : 0.00092315673828125 nb_pixel_total : 40186 time to create 1 rle with old method : 0.04597735404968262 length of segment : 255 time for calcul the mask position with numpy : 0.0006690025329589844 nb_pixel_total : 23955 time to create 1 rle with old method : 0.02819538116455078 length of segment : 246 time for calcul the mask position with numpy : 0.02258467674255371 nb_pixel_total : 876510 time to create 1 rle with new method : 0.10279583930969238 length of segment : 1691 time for calcul the mask position with numpy : 0.015804052352905273 nb_pixel_total : 349947 time to create 1 rle with new method : 0.03506875038146973 length of segment : 795 time for calcul the mask position with numpy : 0.007961750030517578 nb_pixel_total : 170980 time to create 1 rle with new method : 0.0182645320892334 length of segment : 773 time for calcul the mask position with numpy : 0.0021588802337646484 nb_pixel_total : 76239 time to create 1 rle with old method : 0.08700728416442871 length of segment : 438 time for calcul the mask position with numpy : 0.006052970886230469 nb_pixel_total : 247282 time to create 1 rle with new method : 0.018114566802978516 length of segment : 630 time for calcul the mask position with numpy : 0.004616260528564453 nb_pixel_total : 97603 time to create 1 rle with old method : 0.17341017723083496 length of segment : 766 time for calcul the mask position with numpy : 0.0025670528411865234 nb_pixel_total : 87459 time to create 1 rle with old method : 0.15041589736938477 length of segment : 399 time for calcul the mask position with numpy : 0.006529569625854492 nb_pixel_total : 198302 time to create 1 rle with new method : 0.019669294357299805 length of segment : 838 time for calcul the mask position with numpy : 0.0007762908935546875 nb_pixel_total : 25716 time to create 1 rle with old method : 0.02984023094177246 length of segment : 205 time for calcul the mask position with numpy : 0.015120983123779297 nb_pixel_total : 752381 time to create 1 rle with new method : 0.06572294235229492 length of segment : 1161 time for calcul the mask position with numpy : 0.005537748336791992 nb_pixel_total : 293618 time to create 1 rle with new method : 0.014939069747924805 length of segment : 638 time for calcul the mask position with numpy : 0.0049457550048828125 nb_pixel_total : 167408 time to create 1 rle with new method : 0.01472926139831543 length of segment : 526 time for calcul the mask position with numpy : 0.0012590885162353516 nb_pixel_total : 35280 time to create 1 rle with old method : 0.0411684513092041 length of segment : 296 time for calcul the mask position with numpy : 0.001070261001586914 nb_pixel_total : 34915 time to create 1 rle with old method : 0.039856672286987305 length of segment : 511 time for calcul the mask position with numpy : 0.00090789794921875 nb_pixel_total : 17744 time to create 1 rle with old method : 0.022945880889892578 length of segment : 201 time for calcul the mask position with numpy : 0.0030984878540039062 nb_pixel_total : 101545 time to create 1 rle with old method : 0.11380314826965332 length of segment : 527 time for calcul the mask position with numpy : 0.001535654067993164 nb_pixel_total : 37301 time to create 1 rle with old method : 0.053273677825927734 length of segment : 322 time for calcul the mask position with numpy : 0.0014584064483642578 nb_pixel_total : 29666 time to create 1 rle with old method : 0.04430699348449707 length of segment : 152 time for calcul the mask position with numpy : 0.0031342506408691406 nb_pixel_total : 69365 time to create 1 rle with old method : 0.0790719985961914 length of segment : 646 time for calcul the mask position with numpy : 0.0006732940673828125 nb_pixel_total : 19802 time to create 1 rle with old method : 0.024562358856201172 length of segment : 168 time for calcul the mask position with numpy : 0.007970333099365234 nb_pixel_total : 268404 time to create 1 rle with new method : 0.02211928367614746 length of segment : 469 time for calcul the mask position with numpy : 0.02900981903076172 nb_pixel_total : 880229 time to create 1 rle with new method : 0.13387012481689453 length of segment : 1348 time for calcul the mask position with numpy : 0.005234479904174805 nb_pixel_total : 240056 time to create 1 rle with new method : 0.017925262451171875 length of segment : 643 time for calcul the mask position with numpy : 0.0011227130889892578 nb_pixel_total : 33930 time to create 1 rle with old method : 0.03986334800720215 length of segment : 159 time for calcul the mask position with numpy : 0.0011355876922607422 nb_pixel_total : 28497 time to create 1 rle with old method : 0.03289318084716797 length of segment : 287 time for calcul the mask position with numpy : 0.007435321807861328 nb_pixel_total : 218861 time to create 1 rle with new method : 0.02166581153869629 length of segment : 923 time for calcul the mask position with numpy : 0.007811784744262695 nb_pixel_total : 203624 time to create 1 rle with new method : 0.014043331146240234 length of segment : 996 time for calcul the mask position with numpy : 0.002012491226196289 nb_pixel_total : 67067 time to create 1 rle with old method : 0.07510066032409668 length of segment : 615 time for calcul the mask position with numpy : 0.02964639663696289 nb_pixel_total : 958715 time to create 1 rle with new method : 0.23509860038757324 length of segment : 2060 time for calcul the mask position with numpy : 0.003831624984741211 nb_pixel_total : 144587 time to create 1 rle with old method : 0.16232848167419434 length of segment : 595 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 38576 time to create 1 rle with old method : 0.04548931121826172 length of segment : 224 time for calcul the mask position with numpy : 0.011597871780395508 nb_pixel_total : 390740 time to create 1 rle with new method : 0.03293871879577637 length of segment : 731 time for calcul the mask position with numpy : 0.002889394760131836 nb_pixel_total : 32604 time to create 1 rle with old method : 0.03931546211242676 length of segment : 425 time for calcul the mask position with numpy : 0.0018885135650634766 nb_pixel_total : 58824 time to create 1 rle with old method : 0.06553316116333008 length of segment : 486 time for calcul the mask position with numpy : 0.003634214401245117 nb_pixel_total : 156472 time to create 1 rle with new method : 0.011762619018554688 length of segment : 563 time for calcul the mask position with numpy : 0.0038487911224365234 nb_pixel_total : 131739 time to create 1 rle with old method : 0.17159461975097656 length of segment : 444 time for calcul the mask position with numpy : 0.0009417533874511719 nb_pixel_total : 30737 time to create 1 rle with old method : 0.03503775596618652 length of segment : 269 time for calcul the mask position with numpy : 0.002072572708129883 nb_pixel_total : 56880 time to create 1 rle with old method : 0.0695650577545166 length of segment : 390 time for calcul the mask position with numpy : 0.0015692710876464844 nb_pixel_total : 57959 time to create 1 rle with old method : 0.06675529479980469 length of segment : 310 time for calcul the mask position with numpy : 0.0032198429107666016 nb_pixel_total : 119620 time to create 1 rle with old method : 0.1383659839630127 length of segment : 752 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 17258 time to create 1 rle with old method : 0.019742250442504883 length of segment : 247 time for calcul the mask position with numpy : 0.010457277297973633 nb_pixel_total : 566875 time to create 1 rle with new method : 0.029296159744262695 length of segment : 1163 time for calcul the mask position with numpy : 0.00469517707824707 nb_pixel_total : 270463 time to create 1 rle with new method : 0.013631582260131836 length of segment : 491 time for calcul the mask position with numpy : 0.0021376609802246094 nb_pixel_total : 80780 time to create 1 rle with old method : 0.09197664260864258 length of segment : 495 time for calcul the mask position with numpy : 0.007263898849487305 nb_pixel_total : 322913 time to create 1 rle with new method : 0.02312779426574707 length of segment : 749 time for calcul the mask position with numpy : 0.021892309188842773 nb_pixel_total : 813331 time to create 1 rle with new method : 0.14180326461791992 length of segment : 1896 time for calcul the mask position with numpy : 0.0018961429595947266 nb_pixel_total : 99481 time to create 1 rle with old method : 0.11223745346069336 length of segment : 395 time for calcul the mask position with numpy : 0.0023953914642333984 nb_pixel_total : 97253 time to create 1 rle with old method : 0.10704517364501953 length of segment : 560 time for calcul the mask position with numpy : 0.0012273788452148438 nb_pixel_total : 52031 time to create 1 rle with old method : 0.059627532958984375 length of segment : 173 time for calcul the mask position with numpy : 0.002755880355834961 nb_pixel_total : 96453 time to create 1 rle with old method : 0.10880279541015625 length of segment : 407 time for calcul the mask position with numpy : 0.0019545555114746094 nb_pixel_total : 58386 time to create 1 rle with old method : 0.06720471382141113 length of segment : 311 time for calcul the mask position with numpy : 0.0012230873107910156 nb_pixel_total : 48073 time to create 1 rle with old method : 0.055060625076293945 length of segment : 237 time for calcul the mask position with numpy : 0.0019087791442871094 nb_pixel_total : 90214 time to create 1 rle with old method : 0.10167503356933594 length of segment : 531 time for calcul the mask position with numpy : 0.002620697021484375 nb_pixel_total : 89539 time to create 1 rle with old method : 0.1028892993927002 length of segment : 438 time for calcul the mask position with numpy : 0.0017163753509521484 nb_pixel_total : 74409 time to create 1 rle with old method : 0.08474087715148926 length of segment : 265 time for calcul the mask position with numpy : 0.009152412414550781 nb_pixel_total : 225159 time to create 1 rle with new method : 0.03868389129638672 length of segment : 947 time for calcul the mask position with numpy : 0.0022652149200439453 nb_pixel_total : 108459 time to create 1 rle with old method : 0.11962628364562988 length of segment : 476 time for calcul the mask position with numpy : 0.010226011276245117 nb_pixel_total : 232832 time to create 1 rle with new method : 0.03141283988952637 length of segment : 816 time for calcul the mask position with numpy : 0.00635075569152832 nb_pixel_total : 202272 time to create 1 rle with new method : 0.019166231155395508 length of segment : 761 time for calcul the mask position with numpy : 0.004128217697143555 nb_pixel_total : 184125 time to create 1 rle with new method : 0.009763240814208984 length of segment : 560 time for calcul the mask position with numpy : 0.0017826557159423828 nb_pixel_total : 68459 time to create 1 rle with old method : 0.07887673377990723 length of segment : 448 time for calcul the mask position with numpy : 0.003310680389404297 nb_pixel_total : 97847 time to create 1 rle with old method : 0.10786938667297363 length of segment : 519 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 38699 time to create 1 rle with old method : 0.04365038871765137 length of segment : 355 time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 32508 time to create 1 rle with old method : 0.03679084777832031 length of segment : 227 time for calcul the mask position with numpy : 0.002012968063354492 nb_pixel_total : 98680 time to create 1 rle with old method : 0.10752320289611816 length of segment : 465 time for calcul the mask position with numpy : 0.0036742687225341797 nb_pixel_total : 138234 time to create 1 rle with old method : 0.1558384895324707 length of segment : 624 time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 75935 time to create 1 rle with old method : 0.08562374114990234 length of segment : 429 time for calcul the mask position with numpy : 0.0011267662048339844 nb_pixel_total : 43453 time to create 1 rle with old method : 0.049977779388427734 length of segment : 263 time for calcul the mask position with numpy : 0.0023097991943359375 nb_pixel_total : 100399 time to create 1 rle with old method : 0.11065244674682617 length of segment : 472 time for calcul the mask position with numpy : 0.0023665428161621094 nb_pixel_total : 114974 time to create 1 rle with old method : 0.13255572319030762 length of segment : 397 time for calcul the mask position with numpy : 0.003367185592651367 nb_pixel_total : 146273 time to create 1 rle with old method : 0.16472244262695312 length of segment : 539 time for calcul the mask position with numpy : 0.12215781211853027 nb_pixel_total : 2670224 time to create 1 rle with new method : 0.35344862937927246 length of segment : 2742 time for calcul the mask position with numpy : 0.002286672592163086 nb_pixel_total : 90431 time to create 1 rle with old method : 0.1074972152709961 length of segment : 345 time for calcul the mask position with numpy : 0.0007200241088867188 nb_pixel_total : 18421 time to create 1 rle with old method : 0.021393775939941406 length of segment : 269 time for calcul the mask position with numpy : 0.00034809112548828125 nb_pixel_total : 15003 time to create 1 rle with old method : 0.017471790313720703 length of segment : 277 time for calcul the mask position with numpy : 0.0010349750518798828 nb_pixel_total : 57452 time to create 1 rle with old method : 0.0656580924987793 length of segment : 327 time for calcul the mask position with numpy : 0.0051326751708984375 nb_pixel_total : 238354 time to create 1 rle with new method : 0.01444697380065918 length of segment : 629 time for calcul the mask position with numpy : 0.0027642250061035156 nb_pixel_total : 113854 time to create 1 rle with old method : 0.1453866958618164 length of segment : 349 time for calcul the mask position with numpy : 0.005700111389160156 nb_pixel_total : 182495 time to create 1 rle with new method : 0.016073226928710938 length of segment : 585 time for calcul the mask position with numpy : 0.001989126205444336 nb_pixel_total : 88162 time to create 1 rle with old method : 0.09775996208190918 length of segment : 730 time for calcul the mask position with numpy : 0.0028002262115478516 nb_pixel_total : 130437 time to create 1 rle with old method : 0.1476736068725586 length of segment : 396 time for calcul the mask position with numpy : 0.0011048316955566406 nb_pixel_total : 48265 time to create 1 rle with old method : 0.05429577827453613 length of segment : 398 time for calcul the mask position with numpy : 0.0029234886169433594 nb_pixel_total : 104704 time to create 1 rle with old method : 0.11867642402648926 length of segment : 953 time for calcul the mask position with numpy : 0.0009350776672363281 nb_pixel_total : 38764 time to create 1 rle with old method : 0.045093536376953125 length of segment : 277 time for calcul the mask position with numpy : 0.0037522315979003906 nb_pixel_total : 194783 time to create 1 rle with new method : 0.010199308395385742 length of segment : 509 time for calcul the mask position with numpy : 0.017990827560424805 nb_pixel_total : 757960 time to create 1 rle with new method : 0.11582493782043457 length of segment : 1318 time for calcul the mask position with numpy : 0.0015418529510498047 nb_pixel_total : 52388 time to create 1 rle with old method : 0.058547019958496094 length of segment : 396 time for calcul the mask position with numpy : 0.0022661685943603516 nb_pixel_total : 46060 time to create 1 rle with old method : 0.05150961875915527 length of segment : 287 time for calcul the mask position with numpy : 0.008975505828857422 nb_pixel_total : 276088 time to create 1 rle with new method : 0.034430503845214844 length of segment : 1723 time for calcul the mask position with numpy : 0.0018470287322998047 nb_pixel_total : 62655 time to create 1 rle with old method : 0.0984954833984375 length of segment : 419 time for calcul the mask position with numpy : 0.0022554397583007812 nb_pixel_total : 72677 time to create 1 rle with old method : 0.08304882049560547 length of segment : 254 time for calcul the mask position with numpy : 0.001508951187133789 nb_pixel_total : 36513 time to create 1 rle with old method : 0.04079771041870117 length of segment : 244 time for calcul the mask position with numpy : 0.0059070587158203125 nb_pixel_total : 223667 time to create 1 rle with new method : 0.019407272338867188 length of segment : 659 time for calcul the mask position with numpy : 0.007088422775268555 nb_pixel_total : 261358 time to create 1 rle with new method : 0.02136087417602539 length of segment : 735 time for calcul the mask position with numpy : 0.0016939640045166016 nb_pixel_total : 60502 time to create 1 rle with old method : 0.06880021095275879 length of segment : 408 time for calcul the mask position with numpy : 0.004004001617431641 nb_pixel_total : 119766 time to create 1 rle with old method : 0.130143404006958 length of segment : 656 time for calcul the mask position with numpy : 0.014456748962402344 nb_pixel_total : 425036 time to create 1 rle with new method : 0.10129880905151367 length of segment : 1099 time for calcul the mask position with numpy : 0.0008304119110107422 nb_pixel_total : 30593 time to create 1 rle with old method : 0.03349590301513672 length of segment : 226 time for calcul the mask position with numpy : 0.003008604049682617 nb_pixel_total : 135310 time to create 1 rle with old method : 0.16321897506713867 length of segment : 429 time for calcul the mask position with numpy : 0.0023338794708251953 nb_pixel_total : 117050 time to create 1 rle with old method : 0.12680339813232422 length of segment : 671 time for calcul the mask position with numpy : 0.005465984344482422 nb_pixel_total : 288568 time to create 1 rle with new method : 0.014070272445678711 length of segment : 687 time for calcul the mask position with numpy : 0.00443720817565918 nb_pixel_total : 186368 time to create 1 rle with new method : 0.014071464538574219 length of segment : 710 time for calcul the mask position with numpy : 0.006318807601928711 nb_pixel_total : 328554 time to create 1 rle with new method : 0.026611804962158203 length of segment : 929 time for calcul the mask position with numpy : 0.0015566349029541016 nb_pixel_total : 93362 time to create 1 rle with old method : 0.10310053825378418 length of segment : 377 time for calcul the mask position with numpy : 0.004242897033691406 nb_pixel_total : 199315 time to create 1 rle with new method : 0.011919736862182617 length of segment : 1051 time for calcul the mask position with numpy : 0.0010247230529785156 nb_pixel_total : 35994 time to create 1 rle with old method : 0.040503740310668945 length of segment : 306 time for calcul the mask position with numpy : 0.00193023681640625 nb_pixel_total : 96718 time to create 1 rle with old method : 0.10938191413879395 length of segment : 417 time for calcul the mask position with numpy : 0.0016105175018310547 nb_pixel_total : 74519 time to create 1 rle with old method : 0.092437744140625 length of segment : 363 time for calcul the mask position with numpy : 0.007151365280151367 nb_pixel_total : 238036 time to create 1 rle with new method : 0.025724172592163086 length of segment : 835 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 59853 time to create 1 rle with old method : 0.09100532531738281 length of segment : 284 time for calcul the mask position with numpy : 0.002587556838989258 nb_pixel_total : 85665 time to create 1 rle with old method : 0.09763884544372559 length of segment : 353 time for calcul the mask position with numpy : 0.018528223037719727 nb_pixel_total : 714075 time to create 1 rle with new method : 0.1528782844543457 length of segment : 1277 time for calcul the mask position with numpy : 0.0038101673126220703 nb_pixel_total : 152133 time to create 1 rle with new method : 0.014014005661010742 length of segment : 687 time for calcul the mask position with numpy : 0.005281925201416016 nb_pixel_total : 251392 time to create 1 rle with new method : 0.015996932983398438 length of segment : 698 time for calcul the mask position with numpy : 0.27779173851013184 nb_pixel_total : 2228669 time to create 1 rle with new method : 1.2273387908935547 length of segment : 3015 time for calcul the mask position with numpy : 0.005147695541381836 nb_pixel_total : 222759 time to create 1 rle with new method : 0.03587603569030762 length of segment : 662 time for calcul the mask position with numpy : 0.06898140907287598 nb_pixel_total : 64562 time to create 1 rle with old method : 0.07839512825012207 length of segment : 190 time for calcul the mask position with numpy : 0.007780790328979492 nb_pixel_total : 274931 time to create 1 rle with new method : 0.01931619644165039 length of segment : 647 time for calcul the mask position with numpy : 0.004362583160400391 nb_pixel_total : 219003 time to create 1 rle with new method : 0.011883258819580078 length of segment : 627 time for calcul the mask position with numpy : 0.0019965171813964844 nb_pixel_total : 88815 time to create 1 rle with old method : 0.10435795783996582 length of segment : 420 time for calcul the mask position with numpy : 2.6578855514526367 nb_pixel_total : 7308322 time to create 1 rle with new method : 1.9110729694366455 length of segment : 4426 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 66316 time to create 1 rle with old method : 0.07637810707092285 length of segment : 357 time for calcul the mask position with numpy : 0.01257181167602539 nb_pixel_total : 198029 time to create 1 rle with new method : 0.21384143829345703 length of segment : 760 time for calcul the mask position with numpy : 0.0022165775299072266 nb_pixel_total : 145450 time to create 1 rle with old method : 0.17821645736694336 length of segment : 1147 time for calcul the mask position with numpy : 0.02579474449157715 nb_pixel_total : 1842899 time to create 1 rle with new method : 0.26976633071899414 length of segment : 1894 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 15805 time to create 1 rle with old method : 0.019199371337890625 length of segment : 127 time for calcul the mask position with numpy : 0.001893758773803711 nb_pixel_total : 152687 time to create 1 rle with new method : 0.003976583480834961 length of segment : 202 time for calcul the mask position with numpy : 0.00028228759765625 nb_pixel_total : 14538 time to create 1 rle with old method : 0.5311501026153564 length of segment : 185 time spent for convertir_results : 86.41239738464355 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 496 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 212.73127222061157 time spend to save output : 2.442098617553711 total time spend for step 2 : 215.17337083816528 step3:blur_detection Mon Mar 10 15:46:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 1568.8703103954708 (4160, 3120) 1650.9880773313832 (4160, 3120) 1242.1138543541047 (4160, 3120) 3532.624574506121 (4160, 3120) 3031.1259400523045 (4160, 3120) 3668.7942874908554 (4160, 3120) 2621.9976503613416 (4160, 3120) 382.40342498702825 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.036285400390625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.03388261795043945 save missing photos in datou_result : time spend for datou_step_exec : 3.717963695526123 time spend to save output : 0.08510470390319824 total time spend for step 3 : 3.8030683994293213 step4:brightness Mon Mar 10 15:46:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741617689_3228249_1342523745_6885cd6ca60518be49bf2b884172b70e.jpg treat image : temp/1741617689_3228249_1342523742_c953d8fc29b1338f1523a1cfe5d1071c.jpg treat image : temp/1741617689_3228249_1342523737_c0c9550753682c7adf5b6bebd2f1eaae.jpg treat image : temp/1741617689_3228249_1342523730_3de64b68a6e1409c570d4a589a5bb3e5.jpg treat image : temp/1741617689_3228249_1342523726_2ca8ce6a85b0b8165be5abd6e7f3e3a1.jpg treat image : temp/1741617689_3228249_1342523699_1ea22b2bf2f93ca32a97192993d839ae.jpg treat image : temp/1741617689_3228249_1342523693_d781109aa91e51350e4d1599377f8f51.jpg treat image : temp/1741617689_3228249_1342523687_de7d6899527b9595f1c1bdac514d0698.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.028476953506469727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.028074979782104492 save missing photos in datou_result : time spend for datou_step_exec : 14.220501899719238 time spend to save output : 0.06769895553588867 total time spend for step 4 : 14.288200855255127 step5:rle_unique_nms_with_priority Mon Mar 10 15:46:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 496 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 57 nb_hashtags : 9 time to prepare the origin masks : 56.51282620429993 time for calcul the mask position with numpy : 0.43984460830688477 nb_pixel_total : 4298596 time to create 1 rle with new method : 1.618882179260254 time for calcul the mask position with numpy : 0.05349421501159668 nb_pixel_total : 27009 time to create 1 rle with old method : 0.030156612396240234 time for calcul the mask position with numpy : 0.05605459213256836 nb_pixel_total : 25669 time to create 1 rle with old method : 0.029019832611083984 time for calcul the mask position with numpy : 0.053502798080444336 nb_pixel_total : 13974 time to create 1 rle with old method : 0.01554560661315918 time for calcul the mask position with numpy : 0.05247902870178223 nb_pixel_total : 608 time to create 1 rle with old method : 0.0009245872497558594 time for calcul the mask position with numpy : 0.05376935005187988 nb_pixel_total : 73169 time to create 1 rle with old method : 0.08014774322509766 time for calcul the mask position with numpy : 0.05206036567687988 nb_pixel_total : 1476 time to create 1 rle with old method : 0.0019397735595703125 time for calcul the mask position with numpy : 0.05187726020812988 nb_pixel_total : 25229 time to create 1 rle with old method : 0.027945756912231445 time for calcul the mask position with numpy : 0.052310943603515625 nb_pixel_total : 28303 time to create 1 rle with old method : 0.03179359436035156 time for calcul the mask position with numpy : 0.05386018753051758 nb_pixel_total : 111900 time to create 1 rle with old method : 0.12452912330627441 time for calcul the mask position with numpy : 0.05308270454406738 nb_pixel_total : 15673 time to create 1 rle with old method : 0.016923904418945312 time for calcul the mask position with numpy : 0.0522150993347168 nb_pixel_total : 1 time to create 1 rle with old method : 3.4332275390625e-05 time for calcul the mask position with numpy : 0.053665876388549805 nb_pixel_total : 208775 time to create 1 rle with new method : 1.5165364742279053 time for calcul the mask position with numpy : 0.05186867713928223 nb_pixel_total : 34769 time to create 1 rle with old method : 0.03817152976989746 time for calcul the mask position with numpy : 0.052674293518066406 nb_pixel_total : 219633 time to create 1 rle with new method : 1.195969820022583 time for calcul the mask position with numpy : 0.05427193641662598 nb_pixel_total : 99313 time to create 1 rle with old method : 0.11345791816711426 time for calcul the mask position with numpy : 0.0542607307434082 nb_pixel_total : 73090 time to create 1 rle with old method : 0.08064508438110352 time for calcul the mask position with numpy : 0.05464434623718262 nb_pixel_total : 167667 time to create 1 rle with new method : 1.2907865047454834 time for calcul the mask position with numpy : 0.06467890739440918 nb_pixel_total : 40794 time to create 1 rle with old method : 0.047170162200927734 time for calcul the mask position with numpy : 0.06759905815124512 nb_pixel_total : 78141 time to create 1 rle with old method : 0.10344624519348145 time for calcul the mask position with numpy : 0.11320233345031738 nb_pixel_total : 1567836 time to create 1 rle with new method : 1.9816029071807861 time for calcul the mask position with numpy : 0.054476022720336914 nb_pixel_total : 276390 time to create 1 rle with new method : 1.6883883476257324 time for calcul the mask position with numpy : 0.05510210990905762 nb_pixel_total : 38825 time to create 1 rle with old method : 0.0444338321685791 time for calcul the mask position with numpy : 0.05361628532409668 nb_pixel_total : 89416 time to create 1 rle with old method : 0.10476899147033691 time for calcul the mask position with numpy : 0.05437827110290527 nb_pixel_total : 33891 time to create 1 rle with old method : 0.03891897201538086 time for calcul the mask position with numpy : 0.05547976493835449 nb_pixel_total : 190657 time to create 1 rle with new method : 1.5944404602050781 time for calcul the mask position with numpy : 0.05257391929626465 nb_pixel_total : 46606 time to create 1 rle with old method : 0.05273270606994629 time for calcul the mask position with numpy : 0.05276226997375488 nb_pixel_total : 62007 time to create 1 rle with old method : 0.06958293914794922 time for calcul the mask position with numpy : 0.05267834663391113 nb_pixel_total : 3105 time to create 1 rle with old method : 0.003939151763916016 time for calcul the mask position with numpy : 0.05224108695983887 nb_pixel_total : 21518 time to create 1 rle with old method : 0.02345418930053711 time for calcul the mask position with numpy : 0.05284452438354492 nb_pixel_total : 16686 time to create 1 rle with old method : 0.017722129821777344 time for calcul the mask position with numpy : 0.05411219596862793 nb_pixel_total : 245617 time to create 1 rle with new method : 1.3441135883331299 time for calcul the mask position with numpy : 0.08074355125427246 nb_pixel_total : 1673351 time to create 1 rle with new method : 0.9995243549346924 time for calcul the mask position with numpy : 0.0547633171081543 nb_pixel_total : 18596 time to create 1 rle with old method : 0.022698163986206055 time for calcul the mask position with numpy : 0.05826067924499512 nb_pixel_total : 161279 time to create 1 rle with new method : 0.884814977645874 time for calcul the mask position with numpy : 0.05350899696350098 nb_pixel_total : 55328 time to create 1 rle with old method : 0.062308311462402344 time for calcul the mask position with numpy : 0.0548558235168457 nb_pixel_total : 6499 time to create 1 rle with old method : 0.00736689567565918 time for calcul the mask position with numpy : 0.05256175994873047 nb_pixel_total : 1293 time to create 1 rle with old method : 0.001783132553100586 time for calcul the mask position with numpy : 0.05191373825073242 nb_pixel_total : 35861 time to create 1 rle with old method : 0.0377500057220459 time for calcul the mask position with numpy : 0.05493044853210449 nb_pixel_total : 233762 time to create 1 rle with new method : 0.8127896785736084 time for calcul the mask position with numpy : 0.05977010726928711 nb_pixel_total : 623314 time to create 1 rle with new method : 0.9876008033752441 time for calcul the mask position with numpy : 0.05243992805480957 nb_pixel_total : 49776 time to create 1 rle with old method : 0.05324578285217285 time for calcul the mask position with numpy : 0.05206012725830078 nb_pixel_total : 26397 time to create 1 rle with old method : 0.028648853302001953 time for calcul the mask position with numpy : 0.05826878547668457 nb_pixel_total : 495701 time to create 1 rle with new method : 0.8105571269989014 time for calcul the mask position with numpy : 0.05871105194091797 nb_pixel_total : 15121 time to create 1 rle with old method : 0.017495155334472656 time for calcul the mask position with numpy : 0.058327674865722656 nb_pixel_total : 561904 time to create 1 rle with new method : 1.3752520084381104 time for calcul the mask position with numpy : 0.05523538589477539 nb_pixel_total : 14704 time to create 1 rle with old method : 0.01708984375 time for calcul the mask position with numpy : 0.05678510665893555 nb_pixel_total : 15586 time to create 1 rle with old method : 0.017565011978149414 time for calcul the mask position with numpy : 0.056642770767211914 nb_pixel_total : 18044 time to create 1 rle with old method : 0.02017998695373535 time for calcul the mask position with numpy : 0.055200815200805664 nb_pixel_total : 82326 time to create 1 rle with old method : 0.09355640411376953 time for calcul the mask position with numpy : 0.05573272705078125 nb_pixel_total : 118763 time to create 1 rle with old method : 0.13265371322631836 time for calcul the mask position with numpy : 0.06033682823181152 nb_pixel_total : 352987 time to create 1 rle with new method : 1.1056931018829346 time for calcul the mask position with numpy : 0.05419635772705078 nb_pixel_total : 2669 time to create 1 rle with old method : 0.003857135772705078 time for calcul the mask position with numpy : 0.057525634765625 nb_pixel_total : 188583 time to create 1 rle with new method : 1.1560273170471191 time for calcul the mask position with numpy : 0.055063724517822266 nb_pixel_total : 66302 time to create 1 rle with old method : 0.07326149940490723 time for calcul the mask position with numpy : 0.05471038818359375 nb_pixel_total : 1871 time to create 1 rle with old method : 0.002285480499267578 time for calcul the mask position with numpy : 0.054367780685424805 nb_pixel_total : 10744 time to create 1 rle with old method : 0.012126922607421875 time for calcul the mask position with numpy : 0.05627584457397461 nb_pixel_total : 12096 time to create 1 rle with old method : 0.01941990852355957 create new chi : 26.536823511123657 time to delete rle : 0.06512045860290527 batch 1 Loaded 58 chid ids of type : 4855 Number RLEs to save : 51375 TO DO : save crop sub photo not yet done ! save time : 5.5040504932403564 nb_obj : 54 nb_hashtags : 9 time to prepare the origin masks : 46.20698666572571 time for calcul the mask position with numpy : 0.3669745922088623 nb_pixel_total : 3296015 time to create 1 rle with new method : 1.3111426830291748 time for calcul the mask position with numpy : 0.05324959754943848 nb_pixel_total : 50266 time to create 1 rle with old method : 0.05349302291870117 time for calcul the mask position with numpy : 0.06172537803649902 nb_pixel_total : 302168 time to create 1 rle with new method : 1.297773838043213 time for calcul the mask position with numpy : 0.05610799789428711 nb_pixel_total : 25993 time to create 1 rle with old method : 0.02868175506591797 time for calcul the mask position with numpy : 0.05218005180358887 nb_pixel_total : 48678 time to create 1 rle with old method : 0.05377054214477539 time for calcul the mask position with numpy : 0.0506742000579834 nb_pixel_total : 4264 time to create 1 rle with old method : 0.004633903503417969 time for calcul the mask position with numpy : 0.051428794860839844 nb_pixel_total : 64633 time to create 1 rle with old method : 0.07078909873962402 time for calcul the mask position with numpy : 0.056694746017456055 nb_pixel_total : 27857 time to create 1 rle with old method : 0.030817031860351562 time for calcul the mask position with numpy : 0.05516409873962402 nb_pixel_total : 16824 time to create 1 rle with old method : 0.020561695098876953 time for calcul the mask position with numpy : 0.056792497634887695 nb_pixel_total : 17 time to create 1 rle with old method : 0.0002598762512207031 time for calcul the mask position with numpy : 0.05541563034057617 nb_pixel_total : 143456 time to create 1 rle with old method : 0.1575314998626709 time for calcul the mask position with numpy : 0.053571462631225586 nb_pixel_total : 7191 time to create 1 rle with old method : 0.00837850570678711 time for calcul the mask position with numpy : 0.052429914474487305 nb_pixel_total : 55921 time to create 1 rle with old method : 0.06399989128112793 time for calcul the mask position with numpy : 0.06714057922363281 nb_pixel_total : 689270 time to create 1 rle with new method : 0.7746474742889404 time for calcul the mask position with numpy : 0.04985380172729492 nb_pixel_total : 210 time to create 1 rle with old method : 0.0004112720489501953 time for calcul the mask position with numpy : 0.052471160888671875 nb_pixel_total : 81673 time to create 1 rle with old method : 0.08660674095153809 time for calcul the mask position with numpy : 0.051038265228271484 nb_pixel_total : 138674 time to create 1 rle with old method : 0.14638566970825195 time for calcul the mask position with numpy : 0.0505216121673584 nb_pixel_total : 4131 time to create 1 rle with old method : 0.0043964385986328125 time for calcul the mask position with numpy : 0.05157470703125 nb_pixel_total : 89585 time to create 1 rle with old method : 0.09299516677856445 time for calcul the mask position with numpy : 0.05213594436645508 nb_pixel_total : 161470 time to create 1 rle with new method : 0.9317598342895508 time for calcul the mask position with numpy : 0.05270695686340332 nb_pixel_total : 190962 time to create 1 rle with new method : 0.9743165969848633 time for calcul the mask position with numpy : 0.052260637283325195 nb_pixel_total : 4864 time to create 1 rle with old method : 0.005869150161743164 time for calcul the mask position with numpy : 0.053916215896606445 nb_pixel_total : 212287 time to create 1 rle with new method : 1.2786328792572021 time for calcul the mask position with numpy : 0.053336381912231445 nb_pixel_total : 224670 time to create 1 rle with new method : 1.1698086261749268 time for calcul the mask position with numpy : 0.05211138725280762 nb_pixel_total : 255815 time to create 1 rle with new method : 0.9002532958984375 time for calcul the mask position with numpy : 0.05492758750915527 nb_pixel_total : 25953 time to create 1 rle with old method : 0.030352115631103516 time for calcul the mask position with numpy : 0.054883480072021484 nb_pixel_total : 206558 time to create 1 rle with new method : 1.200965166091919 time for calcul the mask position with numpy : 0.0537869930267334 nb_pixel_total : 36271 time to create 1 rle with old method : 0.043623924255371094 time for calcul the mask position with numpy : 0.05382990837097168 nb_pixel_total : 80269 time to create 1 rle with old method : 0.09584236145019531 time for calcul the mask position with numpy : 0.053687095642089844 nb_pixel_total : 53397 time to create 1 rle with old method : 0.05976080894470215 time for calcul the mask position with numpy : 0.08562970161437988 nb_pixel_total : 1398559 time to create 1 rle with new method : 1.6280484199523926 time for calcul the mask position with numpy : 0.053488731384277344 nb_pixel_total : 632 time to create 1 rle with old method : 0.0008654594421386719 time for calcul the mask position with numpy : 0.05310559272766113 nb_pixel_total : 2783 time to create 1 rle with old method : 0.003475189208984375 time for calcul the mask position with numpy : 0.05469536781311035 nb_pixel_total : 74699 time to create 1 rle with old method : 0.08249306678771973 time for calcul the mask position with numpy : 0.05472207069396973 nb_pixel_total : 251661 time to create 1 rle with new method : 1.1930806636810303 time for calcul the mask position with numpy : 0.0560450553894043 nb_pixel_total : 132026 time to create 1 rle with old method : 0.14432692527770996 time for calcul the mask position with numpy : 0.06800174713134766 nb_pixel_total : 1497755 time to create 1 rle with new method : 0.9645299911499023 time for calcul the mask position with numpy : 0.053850650787353516 nb_pixel_total : 18056 time to create 1 rle with old method : 0.02031230926513672 time for calcul the mask position with numpy : 0.053716421127319336 nb_pixel_total : 28508 time to create 1 rle with old method : 0.03194761276245117 time for calcul the mask position with numpy : 0.05335640907287598 nb_pixel_total : 4267 time to create 1 rle with old method : 0.005197286605834961 time for calcul the mask position with numpy : 0.05720973014831543 nb_pixel_total : 348826 time to create 1 rle with new method : 0.9024264812469482 time for calcul the mask position with numpy : 0.05287289619445801 nb_pixel_total : 7640 time to create 1 rle with old method : 0.010089635848999023 time for calcul the mask position with numpy : 0.0543370246887207 nb_pixel_total : 195782 time to create 1 rle with new method : 1.1836748123168945 time for calcul the mask position with numpy : 0.05388140678405762 nb_pixel_total : 156617 time to create 1 rle with new method : 0.7824435234069824 time for calcul the mask position with numpy : 0.0530247688293457 nb_pixel_total : 72141 time to create 1 rle with old method : 0.07910466194152832 time for calcul the mask position with numpy : 0.05489230155944824 nb_pixel_total : 156198 time to create 1 rle with new method : 1.212958812713623 time for calcul the mask position with numpy : 0.07186746597290039 nb_pixel_total : 1088519 time to create 1 rle with new method : 0.9260578155517578 time for calcul the mask position with numpy : 0.05480360984802246 nb_pixel_total : 259434 time to create 1 rle with new method : 0.9571354389190674 time for calcul the mask position with numpy : 0.05380058288574219 nb_pixel_total : 72390 time to create 1 rle with old method : 0.0795297622680664 time for calcul the mask position with numpy : 0.0542445182800293 nb_pixel_total : 118287 time to create 1 rle with old method : 0.13186168670654297 time for calcul the mask position with numpy : 0.053663015365600586 nb_pixel_total : 12872 time to create 1 rle with old method : 0.015451431274414062 time for calcul the mask position with numpy : 0.05646181106567383 nb_pixel_total : 316157 time to create 1 rle with new method : 1.2453796863555908 time for calcul the mask position with numpy : 0.05404233932495117 nb_pixel_total : 46780 time to create 1 rle with old method : 0.05331230163574219 time for calcul the mask position with numpy : 0.06162405014038086 nb_pixel_total : 217662 time to create 1 rle with new method : 1.0637555122375488 time for calcul the mask position with numpy : 0.053903818130493164 nb_pixel_total : 1607 time to create 1 rle with old method : 0.002036571502685547 create new chi : 27.845911264419556 time to delete rle : 0.007401466369628906 batch 1 Loaded 55 chid ids of type : 4855 Number RLEs to save : 53295 TO DO : save crop sub photo not yet done ! save time : 6.888791084289551 nb_obj : 76 nb_hashtags : 9 time to prepare the origin masks : 60.17063236236572 time for calcul the mask position with numpy : 0.8469526767730713 nb_pixel_total : 5163186 time to create 1 rle with new method : 2.257133960723877 time for calcul the mask position with numpy : 0.05373382568359375 nb_pixel_total : 23891 time to create 1 rle with old method : 0.026221513748168945 time for calcul the mask position with numpy : 0.05412650108337402 nb_pixel_total : 37969 time to create 1 rle with old method : 0.04509377479553223 time for calcul the mask position with numpy : 0.05608940124511719 nb_pixel_total : 82047 time to create 1 rle with old method : 0.09423279762268066 time for calcul the mask position with numpy : 0.05823349952697754 nb_pixel_total : 224017 time to create 1 rle with new method : 1.702554702758789 time for calcul the mask position with numpy : 0.0544888973236084 nb_pixel_total : 95961 time to create 1 rle with old method : 0.1060800552368164 time for calcul the mask position with numpy : 0.05505871772766113 nb_pixel_total : 247200 time to create 1 rle with new method : 1.5499310493469238 time for calcul the mask position with numpy : 0.05601191520690918 nb_pixel_total : 218136 time to create 1 rle with new method : 1.8665497303009033 time for calcul the mask position with numpy : 0.057915449142456055 nb_pixel_total : 192368 time to create 1 rle with new method : 1.1332499980926514 time for calcul the mask position with numpy : 0.05546927452087402 nb_pixel_total : 182415 time to create 1 rle with new method : 1.1403839588165283 time for calcul the mask position with numpy : 0.055649518966674805 nb_pixel_total : 22575 time to create 1 rle with old method : 0.035546064376831055 time for calcul the mask position with numpy : 0.05938148498535156 nb_pixel_total : 140445 time to create 1 rle with old method : 0.17975926399230957 time for calcul the mask position with numpy : 0.05397772789001465 nb_pixel_total : 41211 time to create 1 rle with old method : 0.05511784553527832 time for calcul the mask position with numpy : 0.055005550384521484 nb_pixel_total : 60723 time to create 1 rle with old method : 0.07081460952758789 time for calcul the mask position with numpy : 0.05443549156188965 nb_pixel_total : 8482 time to create 1 rle with old method : 0.01042938232421875 time for calcul the mask position with numpy : 0.05570626258850098 nb_pixel_total : 46816 time to create 1 rle with old method : 0.05152535438537598 time for calcul the mask position with numpy : 0.057375431060791016 nb_pixel_total : 25482 time to create 1 rle with old method : 0.029674053192138672 time for calcul the mask position with numpy : 0.05462908744812012 nb_pixel_total : 32725 time to create 1 rle with old method : 0.03977203369140625 time for calcul the mask position with numpy : 0.05387473106384277 nb_pixel_total : 43594 time to create 1 rle with old method : 0.048127174377441406 time for calcul the mask position with numpy : 0.055815696716308594 nb_pixel_total : 169056 time to create 1 rle with new method : 1.9594190120697021 time for calcul the mask position with numpy : 0.0615849494934082 nb_pixel_total : 497412 time to create 1 rle with new method : 1.738919973373413 time for calcul the mask position with numpy : 0.05447721481323242 nb_pixel_total : 30424 time to create 1 rle with old method : 0.034780025482177734 time for calcul the mask position with numpy : 0.05470132827758789 nb_pixel_total : 26492 time to create 1 rle with old method : 0.029491901397705078 time for calcul the mask position with numpy : 0.056093692779541016 nb_pixel_total : 64006 time to create 1 rle with old method : 0.1230156421661377 time for calcul the mask position with numpy : 0.06882166862487793 nb_pixel_total : 98511 time to create 1 rle with old method : 0.11033010482788086 time for calcul the mask position with numpy : 0.05726766586303711 nb_pixel_total : 432082 time to create 1 rle with new method : 0.9965496063232422 time for calcul the mask position with numpy : 0.0537111759185791 nb_pixel_total : 219377 time to create 1 rle with new method : 0.9892711639404297 time for calcul the mask position with numpy : 0.05333876609802246 nb_pixel_total : 9061 time to create 1 rle with old method : 0.011053085327148438 time for calcul the mask position with numpy : 0.053741455078125 nb_pixel_total : 41476 time to create 1 rle with old method : 0.21880102157592773 time for calcul the mask position with numpy : 0.05415749549865723 nb_pixel_total : 76608 time to create 1 rle with old method : 0.0863187313079834 time for calcul the mask position with numpy : 0.05446124076843262 nb_pixel_total : 72506 time to create 1 rle with old method : 0.08150386810302734 time for calcul the mask position with numpy : 0.05380105972290039 nb_pixel_total : 67386 time to create 1 rle with old method : 0.07535672187805176 time for calcul the mask position with numpy : 0.05511736869812012 nb_pixel_total : 49390 time to create 1 rle with old method : 0.05838775634765625 time for calcul the mask position with numpy : 0.07897138595581055 nb_pixel_total : 68700 time to create 1 rle with old method : 0.0797281265258789 time for calcul the mask position with numpy : 0.05529665946960449 nb_pixel_total : 77918 time to create 1 rle with old method : 0.08755135536193848 time for calcul the mask position with numpy : 0.05452847480773926 nb_pixel_total : 5248 time to create 1 rle with old method : 0.0061647891998291016 time for calcul the mask position with numpy : 0.05653858184814453 nb_pixel_total : 125880 time to create 1 rle with old method : 0.14244937896728516 time for calcul the mask position with numpy : 0.0543520450592041 nb_pixel_total : 2156 time to create 1 rle with old method : 0.0026187896728515625 time for calcul the mask position with numpy : 0.05540275573730469 nb_pixel_total : 68549 time to create 1 rle with old method : 0.07536911964416504 time for calcul the mask position with numpy : 0.0562891960144043 nb_pixel_total : 64163 time to create 1 rle with old method : 0.07191753387451172 time for calcul the mask position with numpy : 0.05848979949951172 nb_pixel_total : 245900 time to create 1 rle with new method : 1.1323068141937256 time for calcul the mask position with numpy : 0.05312919616699219 nb_pixel_total : 9778 time to create 1 rle with old method : 0.01153254508972168 time for calcul the mask position with numpy : 0.05512547492980957 nb_pixel_total : 416311 time to create 1 rle with new method : 1.323378324508667 time for calcul the mask position with numpy : 0.053887128829956055 nb_pixel_total : 30611 time to create 1 rle with old method : 0.04490017890930176 time for calcul the mask position with numpy : 0.06153440475463867 nb_pixel_total : 94068 time to create 1 rle with old method : 0.10365867614746094 time for calcul the mask position with numpy : 0.05393338203430176 nb_pixel_total : 58174 time to create 1 rle with old method : 0.06446194648742676 time for calcul the mask position with numpy : 0.05449509620666504 nb_pixel_total : 7695 time to create 1 rle with old method : 0.00907588005065918 time for calcul the mask position with numpy : 0.05783724784851074 nb_pixel_total : 271189 time to create 1 rle with new method : 1.1013469696044922 time for calcul the mask position with numpy : 0.05411124229431152 nb_pixel_total : 12090 time to create 1 rle with old method : 0.013522863388061523 time for calcul the mask position with numpy : 0.05482029914855957 nb_pixel_total : 12228 time to create 1 rle with old method : 0.01469731330871582 time for calcul the mask position with numpy : 0.05365109443664551 nb_pixel_total : 54023 time to create 1 rle with old method : 0.060414791107177734 time for calcul the mask position with numpy : 0.05293750762939453 nb_pixel_total : 42653 time to create 1 rle with old method : 0.04674220085144043 time for calcul the mask position with numpy : 0.051569223403930664 nb_pixel_total : 85452 time to create 1 rle with old method : 0.09052538871765137 time for calcul the mask position with numpy : 0.05390620231628418 nb_pixel_total : 44109 time to create 1 rle with old method : 0.04716825485229492 time for calcul the mask position with numpy : 0.052559614181518555 nb_pixel_total : 284518 time to create 1 rle with new method : 1.4239652156829834 time for calcul the mask position with numpy : 0.07433319091796875 nb_pixel_total : 559120 time to create 1 rle with new method : 1.4043028354644775 time for calcul the mask position with numpy : 0.05401778221130371 nb_pixel_total : 30677 time to create 1 rle with old method : 0.03383159637451172 time for calcul the mask position with numpy : 0.05359196662902832 nb_pixel_total : 1510 time to create 1 rle with old method : 0.001995563507080078 time for calcul the mask position with numpy : 0.057042598724365234 nb_pixel_total : 249902 time to create 1 rle with new method : 0.7297072410583496 time for calcul the mask position with numpy : 0.0564885139465332 nb_pixel_total : 524208 time to create 1 rle with new method : 1.5211784839630127 time for calcul the mask position with numpy : 0.05288505554199219 nb_pixel_total : 40850 time to create 1 rle with old method : 0.04464864730834961 time for calcul the mask position with numpy : 0.0528559684753418 nb_pixel_total : 24900 time to create 1 rle with old method : 0.028040409088134766 time for calcul the mask position with numpy : 0.053063392639160156 nb_pixel_total : 2452 time to create 1 rle with old method : 0.0028769969940185547 time for calcul the mask position with numpy : 0.05235862731933594 nb_pixel_total : 46870 time to create 1 rle with old method : 0.05260753631591797 time for calcul the mask position with numpy : 0.05636930465698242 nb_pixel_total : 81188 time to create 1 rle with old method : 0.09047269821166992 time for calcul the mask position with numpy : 0.05308651924133301 nb_pixel_total : 51711 time to create 1 rle with old method : 0.055283546447753906 time for calcul the mask position with numpy : 0.05425834655761719 nb_pixel_total : 31625 time to create 1 rle with old method : 0.03714346885681152 time for calcul the mask position with numpy : 0.05721735954284668 nb_pixel_total : 18160 time to create 1 rle with old method : 0.021581411361694336 time for calcul the mask position with numpy : 0.055144309997558594 nb_pixel_total : 68802 time to create 1 rle with old method : 0.08642411231994629 time for calcul the mask position with numpy : 0.06749677658081055 nb_pixel_total : 30733 time to create 1 rle with old method : 0.036557912826538086 time for calcul the mask position with numpy : 0.055330753326416016 nb_pixel_total : 10244 time to create 1 rle with old method : 0.012173652648925781 time for calcul the mask position with numpy : 0.05756402015686035 nb_pixel_total : 129514 time to create 1 rle with old method : 0.15516352653503418 time for calcul the mask position with numpy : 0.056639671325683594 nb_pixel_total : 83661 time to create 1 rle with old method : 0.09999322891235352 time for calcul the mask position with numpy : 0.06091046333312988 nb_pixel_total : 18905 time to create 1 rle with old method : 0.023093700408935547 time for calcul the mask position with numpy : 0.05546402931213379 nb_pixel_total : 88556 time to create 1 rle with old method : 0.10626959800720215 time for calcul the mask position with numpy : 0.053064823150634766 nb_pixel_total : 3152 time to create 1 rle with old method : 0.003989458084106445 time for calcul the mask position with numpy : 0.052282094955444336 nb_pixel_total : 58017 time to create 1 rle with old method : 0.06542205810546875 create new chi : 33.40387320518494 time to delete rle : 0.007633209228515625 batch 1 Loaded 77 chid ids of type : 4855 Number RLEs to save : 61186 TO DO : save crop sub photo not yet done ! save time : 8.378906011581421 nb_obj : 70 nb_hashtags : 10 time to prepare the origin masks : 57.19170260429382 time for calcul the mask position with numpy : 0.23763608932495117 nb_pixel_total : 5775958 time to create 1 rle with new method : 4.350457429885864 time for calcul the mask position with numpy : 0.05851340293884277 nb_pixel_total : 63533 time to create 1 rle with old method : 0.07685375213623047 time for calcul the mask position with numpy : 0.0527191162109375 nb_pixel_total : 3970 time to create 1 rle with old method : 0.00473475456237793 time for calcul the mask position with numpy : 0.05293011665344238 nb_pixel_total : 72164 time to create 1 rle with old method : 0.0782785415649414 time for calcul the mask position with numpy : 0.053344011306762695 nb_pixel_total : 54675 time to create 1 rle with old method : 0.0719902515411377 time for calcul the mask position with numpy : 0.053267717361450195 nb_pixel_total : 32964 time to create 1 rle with old method : 0.03695058822631836 time for calcul the mask position with numpy : 0.054015159606933594 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.05427145957946777 nb_pixel_total : 40649 time to create 1 rle with old method : 0.04413604736328125 time for calcul the mask position with numpy : 0.0559840202331543 nb_pixel_total : 18346 time to create 1 rle with old method : 0.020484209060668945 time for calcul the mask position with numpy : 0.055539846420288086 nb_pixel_total : 131348 time to create 1 rle with old method : 0.14359188079833984 time for calcul the mask position with numpy : 0.054964542388916016 nb_pixel_total : 19430 time to create 1 rle with old method : 0.024721145629882812 time for calcul the mask position with numpy : 0.17430567741394043 nb_pixel_total : 433892 time to create 1 rle with new method : 0.8393661975860596 time for calcul the mask position with numpy : 0.054346323013305664 nb_pixel_total : 26671 time to create 1 rle with old method : 0.034877777099609375 time for calcul the mask position with numpy : 0.05247926712036133 nb_pixel_total : 46503 time to create 1 rle with old method : 0.05003237724304199 time for calcul the mask position with numpy : 0.051467180252075195 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008463859558105469 time for calcul the mask position with numpy : 0.05176877975463867 nb_pixel_total : 83360 time to create 1 rle with old method : 0.09174203872680664 time for calcul the mask position with numpy : 0.05382966995239258 nb_pixel_total : 44516 time to create 1 rle with old method : 0.050518035888671875 time for calcul the mask position with numpy : 0.053755760192871094 nb_pixel_total : 21905 time to create 1 rle with old method : 0.025569677352905273 time for calcul the mask position with numpy : 0.054575204849243164 nb_pixel_total : 6967 time to create 1 rle with old method : 0.008372783660888672 time for calcul the mask position with numpy : 0.054720163345336914 nb_pixel_total : 34643 time to create 1 rle with old method : 0.040366411209106445 time for calcul the mask position with numpy : 0.05457472801208496 nb_pixel_total : 115 time to create 1 rle with old method : 0.0004374980926513672 time for calcul the mask position with numpy : 0.061678409576416016 nb_pixel_total : 17793 time to create 1 rle with old method : 0.023905515670776367 time for calcul the mask position with numpy : 0.05406665802001953 nb_pixel_total : 31002 time to create 1 rle with old method : 0.03542733192443848 time for calcul the mask position with numpy : 0.054427385330200195 nb_pixel_total : 62292 time to create 1 rle with old method : 0.09437751770019531 time for calcul the mask position with numpy : 0.055115699768066406 nb_pixel_total : 57069 time to create 1 rle with old method : 0.06635069847106934 time for calcul the mask position with numpy : 0.055165767669677734 nb_pixel_total : 412844 time to create 1 rle with new method : 1.2637877464294434 time for calcul the mask position with numpy : 0.05249142646789551 nb_pixel_total : 85215 time to create 1 rle with old method : 0.09145617485046387 time for calcul the mask position with numpy : 0.05402565002441406 nb_pixel_total : 61990 time to create 1 rle with old method : 0.0677192211151123 time for calcul the mask position with numpy : 0.053905487060546875 nb_pixel_total : 2301 time to create 1 rle with old method : 0.002735614776611328 time for calcul the mask position with numpy : 0.053725242614746094 nb_pixel_total : 54142 time to create 1 rle with old method : 0.06374430656433105 time for calcul the mask position with numpy : 0.05417013168334961 nb_pixel_total : 298024 time to create 1 rle with new method : 0.9521918296813965 time for calcul the mask position with numpy : 0.06529498100280762 nb_pixel_total : 814197 time to create 1 rle with new method : 1.1125781536102295 time for calcul the mask position with numpy : 0.05428338050842285 nb_pixel_total : 18294 time to create 1 rle with old method : 0.0213472843170166 time for calcul the mask position with numpy : 0.05565142631530762 nb_pixel_total : 145520 time to create 1 rle with old method : 0.15621137619018555 time for calcul the mask position with numpy : 0.05409359931945801 nb_pixel_total : 8679 time to create 1 rle with old method : 0.01016998291015625 time for calcul the mask position with numpy : 0.054228782653808594 nb_pixel_total : 28108 time to create 1 rle with old method : 0.03264927864074707 time for calcul the mask position with numpy : 0.054621219635009766 nb_pixel_total : 70805 time to create 1 rle with old method : 0.07872509956359863 time for calcul the mask position with numpy : 0.05456829071044922 nb_pixel_total : 56851 time to create 1 rle with old method : 0.06285357475280762 time for calcul the mask position with numpy : 0.05969572067260742 nb_pixel_total : 1906 time to create 1 rle with old method : 0.002257108688354492 time for calcul the mask position with numpy : 0.05448460578918457 nb_pixel_total : 41753 time to create 1 rle with old method : 0.06686520576477051 time for calcul the mask position with numpy : 0.055286407470703125 nb_pixel_total : 28553 time to create 1 rle with old method : 0.03223419189453125 time for calcul the mask position with numpy : 0.05501604080200195 nb_pixel_total : 123656 time to create 1 rle with old method : 0.13443493843078613 time for calcul the mask position with numpy : 0.05501079559326172 nb_pixel_total : 129557 time to create 1 rle with old method : 0.1501293182373047 time for calcul the mask position with numpy : 0.06133699417114258 nb_pixel_total : 59787 time to create 1 rle with old method : 0.06461644172668457 time for calcul the mask position with numpy : 0.05205559730529785 nb_pixel_total : 38547 time to create 1 rle with old method : 0.04264569282531738 time for calcul the mask position with numpy : 0.052353620529174805 nb_pixel_total : 18702 time to create 1 rle with old method : 0.020119190216064453 time for calcul the mask position with numpy : 0.0534970760345459 nb_pixel_total : 126422 time to create 1 rle with old method : 0.1362311840057373 time for calcul the mask position with numpy : 0.053525447845458984 nb_pixel_total : 14772 time to create 1 rle with old method : 0.017429351806640625 time for calcul the mask position with numpy : 0.05499744415283203 nb_pixel_total : 409351 time to create 1 rle with new method : 0.8674671649932861 time for calcul the mask position with numpy : 0.05338120460510254 nb_pixel_total : 96256 time to create 1 rle with old method : 0.10967063903808594 time for calcul the mask position with numpy : 0.05566692352294922 nb_pixel_total : 94298 time to create 1 rle with old method : 0.11027717590332031 time for calcul the mask position with numpy : 0.05420374870300293 nb_pixel_total : 131171 time to create 1 rle with old method : 0.1589679718017578 time for calcul the mask position with numpy : 0.05769968032836914 nb_pixel_total : 358146 time to create 1 rle with new method : 0.8505673408508301 time for calcul the mask position with numpy : 0.05492734909057617 nb_pixel_total : 213099 time to create 1 rle with new method : 1.064521074295044 time for calcul the mask position with numpy : 0.05848431587219238 nb_pixel_total : 320526 time to create 1 rle with new method : 1.0719823837280273 time for calcul the mask position with numpy : 0.05453157424926758 nb_pixel_total : 126150 time to create 1 rle with old method : 0.1338646411895752 time for calcul the mask position with numpy : 0.05713629722595215 nb_pixel_total : 396138 time to create 1 rle with new method : 0.832791805267334 time for calcul the mask position with numpy : 0.05291581153869629 nb_pixel_total : 245547 time to create 1 rle with new method : 1.1498913764953613 time for calcul the mask position with numpy : 0.053922176361083984 nb_pixel_total : 14537 time to create 1 rle with old method : 0.01621842384338379 time for calcul the mask position with numpy : 0.05447554588317871 nb_pixel_total : 26805 time to create 1 rle with old method : 0.030297279357910156 time for calcul the mask position with numpy : 0.057023048400878906 nb_pixel_total : 155520 time to create 1 rle with new method : 0.8332700729370117 time for calcul the mask position with numpy : 0.05609846115112305 nb_pixel_total : 187984 time to create 1 rle with new method : 1.0091934204101562 time for calcul the mask position with numpy : 0.053374528884887695 nb_pixel_total : 35775 time to create 1 rle with old method : 0.038587093353271484 time for calcul the mask position with numpy : 0.05408525466918945 nb_pixel_total : 21106 time to create 1 rle with old method : 0.023366689682006836 time for calcul the mask position with numpy : 0.05370950698852539 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0021772384643554688 time for calcul the mask position with numpy : 0.055817604064941406 nb_pixel_total : 202603 time to create 1 rle with new method : 1.0131375789642334 time for calcul the mask position with numpy : 0.05415034294128418 nb_pixel_total : 134274 time to create 1 rle with old method : 0.15084624290466309 time for calcul the mask position with numpy : 0.05590558052062988 nb_pixel_total : 50207 time to create 1 rle with old method : 0.05692434310913086 time for calcul the mask position with numpy : 0.0533447265625 nb_pixel_total : 2955 time to create 1 rle with old method : 0.0036237239837646484 time for calcul the mask position with numpy : 0.051499128341674805 nb_pixel_total : 3 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.052349090576171875 nb_pixel_total : 33739 time to create 1 rle with old method : 0.03608989715576172 create new chi : 25.214674949645996 time to delete rle : 0.006699323654174805 batch 1 Loaded 71 chid ids of type : 4855 Number RLEs to save : 50215 TO DO : save crop sub photo not yet done ! save time : 7.406079530715942 nb_obj : 80 nb_hashtags : 10 time to prepare the origin masks : 57.2997932434082 time for calcul the mask position with numpy : 0.5279772281646729 nb_pixel_total : 5900745 time to create 1 rle with new method : 1.3921308517456055 time for calcul the mask position with numpy : 0.04973101615905762 nb_pixel_total : 28792 time to create 1 rle with old method : 0.029230117797851562 time for calcul the mask position with numpy : 0.0513608455657959 nb_pixel_total : 133788 time to create 1 rle with old method : 0.13918542861938477 time for calcul the mask position with numpy : 0.051998138427734375 nb_pixel_total : 83191 time to create 1 rle with old method : 0.0882880687713623 time for calcul the mask position with numpy : 0.05205392837524414 nb_pixel_total : 8391 time to create 1 rle with old method : 0.00929403305053711 time for calcul the mask position with numpy : 0.0522761344909668 nb_pixel_total : 32268 time to create 1 rle with old method : 0.036615610122680664 time for calcul the mask position with numpy : 0.05214738845825195 nb_pixel_total : 22819 time to create 1 rle with old method : 0.024062156677246094 time for calcul the mask position with numpy : 0.05383014678955078 nb_pixel_total : 158298 time to create 1 rle with new method : 1.0961666107177734 time for calcul the mask position with numpy : 0.05308651924133301 nb_pixel_total : 213537 time to create 1 rle with new method : 1.0426411628723145 time for calcul the mask position with numpy : 0.05099153518676758 nb_pixel_total : 41322 time to create 1 rle with old method : 0.04240536689758301 time for calcul the mask position with numpy : 0.050373077392578125 nb_pixel_total : 36527 time to create 1 rle with old method : 0.03790783882141113 time for calcul the mask position with numpy : 0.05198025703430176 nb_pixel_total : 93467 time to create 1 rle with old method : 0.09778571128845215 time for calcul the mask position with numpy : 0.05118727684020996 nb_pixel_total : 36205 time to create 1 rle with old method : 0.0373992919921875 time for calcul the mask position with numpy : 0.05221271514892578 nb_pixel_total : 135492 time to create 1 rle with old method : 0.14269685745239258 time for calcul the mask position with numpy : 0.0504908561706543 nb_pixel_total : 26997 time to create 1 rle with old method : 0.028963327407836914 time for calcul the mask position with numpy : 0.05217123031616211 nb_pixel_total : 20376 time to create 1 rle with old method : 0.027089595794677734 time for calcul the mask position with numpy : 0.05590367317199707 nb_pixel_total : 17490 time to create 1 rle with old method : 0.020970821380615234 time for calcul the mask position with numpy : 0.0697793960571289 nb_pixel_total : 61901 time to create 1 rle with old method : 0.07881855964660645 time for calcul the mask position with numpy : 0.05795168876647949 nb_pixel_total : 58624 time to create 1 rle with old method : 0.06596136093139648 time for calcul the mask position with numpy : 0.05478405952453613 nb_pixel_total : 43251 time to create 1 rle with old method : 0.04891848564147949 time for calcul the mask position with numpy : 0.0689384937286377 nb_pixel_total : 468923 time to create 1 rle with new method : 1.792179822921753 time for calcul the mask position with numpy : 0.05640530586242676 nb_pixel_total : 261244 time to create 1 rle with new method : 1.7322957515716553 time for calcul the mask position with numpy : 0.061707496643066406 nb_pixel_total : 8295 time to create 1 rle with old method : 0.013476848602294922 time for calcul the mask position with numpy : 0.06793999671936035 nb_pixel_total : 102619 time to create 1 rle with old method : 0.11869931221008301 time for calcul the mask position with numpy : 0.05389046669006348 nb_pixel_total : 25697 time to create 1 rle with old method : 0.030839920043945312 time for calcul the mask position with numpy : 0.05376696586608887 nb_pixel_total : 14616 time to create 1 rle with old method : 0.016352415084838867 time for calcul the mask position with numpy : 0.05439305305480957 nb_pixel_total : 138388 time to create 1 rle with old method : 0.15125751495361328 time for calcul the mask position with numpy : 0.05363106727600098 nb_pixel_total : 35476 time to create 1 rle with old method : 0.0391087532043457 time for calcul the mask position with numpy : 0.0530087947845459 nb_pixel_total : 26009 time to create 1 rle with old method : 0.029009342193603516 time for calcul the mask position with numpy : 0.05453753471374512 nb_pixel_total : 102466 time to create 1 rle with old method : 0.11314702033996582 time for calcul the mask position with numpy : 0.05223345756530762 nb_pixel_total : 9237 time to create 1 rle with old method : 0.009804248809814453 time for calcul the mask position with numpy : 0.05254554748535156 nb_pixel_total : 2966 time to create 1 rle with old method : 0.003561735153198242 time for calcul the mask position with numpy : 0.05315899848937988 nb_pixel_total : 95749 time to create 1 rle with old method : 0.10140132904052734 time for calcul the mask position with numpy : 0.05209636688232422 nb_pixel_total : 45540 time to create 1 rle with old method : 0.0510866641998291 time for calcul the mask position with numpy : 0.05249667167663574 nb_pixel_total : 243076 time to create 1 rle with new method : 1.1336779594421387 time for calcul the mask position with numpy : 0.0538945198059082 nb_pixel_total : 20119 time to create 1 rle with old method : 0.023543596267700195 time for calcul the mask position with numpy : 0.05392742156982422 nb_pixel_total : 95409 time to create 1 rle with old method : 0.10600829124450684 time for calcul the mask position with numpy : 0.053844451904296875 nb_pixel_total : 35747 time to create 1 rle with old method : 0.0411067008972168 time for calcul the mask position with numpy : 0.055970191955566406 nb_pixel_total : 358620 time to create 1 rle with new method : 0.9670133590698242 time for calcul the mask position with numpy : 0.05267763137817383 nb_pixel_total : 37246 time to create 1 rle with old method : 0.04410576820373535 time for calcul the mask position with numpy : 0.053789377212524414 nb_pixel_total : 121809 time to create 1 rle with old method : 0.13969826698303223 time for calcul the mask position with numpy : 0.05178189277648926 nb_pixel_total : 29173 time to create 1 rle with old method : 0.03125309944152832 time for calcul the mask position with numpy : 0.052854061126708984 nb_pixel_total : 247650 time to create 1 rle with new method : 0.8567538261413574 time for calcul the mask position with numpy : 0.05310463905334473 nb_pixel_total : 97461 time to create 1 rle with old method : 0.11400365829467773 time for calcul the mask position with numpy : 0.058034420013427734 nb_pixel_total : 553102 time to create 1 rle with new method : 1.8213591575622559 time for calcul the mask position with numpy : 0.05348777770996094 nb_pixel_total : 87794 time to create 1 rle with old method : 0.1020975112915039 time for calcul the mask position with numpy : 0.05355501174926758 nb_pixel_total : 41318 time to create 1 rle with old method : 0.04594922065734863 time for calcul the mask position with numpy : 0.05297994613647461 nb_pixel_total : 21238 time to create 1 rle with old method : 0.02402186393737793 time for calcul the mask position with numpy : 0.05323314666748047 nb_pixel_total : 12131 time to create 1 rle with old method : 0.013015031814575195 time for calcul the mask position with numpy : 0.05354714393615723 nb_pixel_total : 40349 time to create 1 rle with old method : 0.046584367752075195 time for calcul the mask position with numpy : 0.05185294151306152 nb_pixel_total : 49621 time to create 1 rle with old method : 0.054450273513793945 time for calcul the mask position with numpy : 0.054204702377319336 nb_pixel_total : 196275 time to create 1 rle with new method : 0.8174533843994141 time for calcul the mask position with numpy : 0.05273175239562988 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0019047260284423828 time for calcul the mask position with numpy : 0.05248236656188965 nb_pixel_total : 47321 time to create 1 rle with old method : 0.05655193328857422 time for calcul the mask position with numpy : 0.05225372314453125 nb_pixel_total : 72170 time to create 1 rle with old method : 0.07689070701599121 time for calcul the mask position with numpy : 0.05158591270446777 nb_pixel_total : 100271 time to create 1 rle with old method : 0.10567307472229004 time for calcul the mask position with numpy : 0.051203250885009766 nb_pixel_total : 200184 time to create 1 rle with new method : 1.250964879989624 time for calcul the mask position with numpy : 0.05240201950073242 nb_pixel_total : 44521 time to create 1 rle with old method : 0.04996061325073242 time for calcul the mask position with numpy : 0.052225589752197266 nb_pixel_total : 31559 time to create 1 rle with old method : 0.03702378273010254 time for calcul the mask position with numpy : 0.052895545959472656 nb_pixel_total : 6521 time to create 1 rle with old method : 0.007288217544555664 time for calcul the mask position with numpy : 0.05216479301452637 nb_pixel_total : 73111 time to create 1 rle with old method : 0.07758879661560059 time for calcul the mask position with numpy : 0.05148005485534668 nb_pixel_total : 15765 time to create 1 rle with old method : 0.01700139045715332 time for calcul the mask position with numpy : 0.05153012275695801 nb_pixel_total : 65888 time to create 1 rle with old method : 0.07056879997253418 time for calcul the mask position with numpy : 0.05344724655151367 nb_pixel_total : 42289 time to create 1 rle with old method : 0.0469975471496582 time for calcul the mask position with numpy : 0.054738759994506836 nb_pixel_total : 258933 time to create 1 rle with new method : 1.3346161842346191 time for calcul the mask position with numpy : 0.0504915714263916 nb_pixel_total : 12309 time to create 1 rle with old method : 0.013995647430419922 time for calcul the mask position with numpy : 0.053261756896972656 nb_pixel_total : 189797 time to create 1 rle with new method : 1.156139850616455 time for calcul the mask position with numpy : 0.05329489707946777 nb_pixel_total : 138778 time to create 1 rle with old method : 0.15073108673095703 time for calcul the mask position with numpy : 0.05172157287597656 nb_pixel_total : 9646 time to create 1 rle with old method : 0.011002779006958008 time for calcul the mask position with numpy : 0.05273556709289551 nb_pixel_total : 35232 time to create 1 rle with old method : 0.04618191719055176 time for calcul the mask position with numpy : 0.05280470848083496 nb_pixel_total : 7923 time to create 1 rle with old method : 0.00915074348449707 time for calcul the mask position with numpy : 0.053360700607299805 nb_pixel_total : 198457 time to create 1 rle with new method : 1.0877430438995361 time for calcul the mask position with numpy : 0.0515286922454834 nb_pixel_total : 101956 time to create 1 rle with old method : 0.11552047729492188 time for calcul the mask position with numpy : 0.053163766860961914 nb_pixel_total : 185648 time to create 1 rle with new method : 1.019684076309204 time for calcul the mask position with numpy : 0.05149245262145996 nb_pixel_total : 49594 time to create 1 rle with old method : 0.05343461036682129 time for calcul the mask position with numpy : 0.05160713195800781 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003399848937988281 time for calcul the mask position with numpy : 0.051810264587402344 nb_pixel_total : 6276 time to create 1 rle with old method : 0.006941080093383789 time for calcul the mask position with numpy : 0.053148746490478516 nb_pixel_total : 119403 time to create 1 rle with old method : 0.12949371337890625 time for calcul the mask position with numpy : 0.052995920181274414 nb_pixel_total : 73890 time to create 1 rle with old method : 0.07970046997070312 time for calcul the mask position with numpy : 0.05290937423706055 nb_pixel_total : 69480 time to create 1 rle with old method : 0.07432007789611816 time for calcul the mask position with numpy : 0.05292057991027832 nb_pixel_total : 41844 time to create 1 rle with old method : 0.04554581642150879 create new chi : 27.68966293334961 time to delete rle : 0.006726980209350586 batch 1 Loaded 81 chid ids of type : 4855 Number RLEs to save : 64292 TO DO : save crop sub photo not yet done ! save time : 13.444864749908447 nb_obj : 69 nb_hashtags : 10 time to prepare the origin masks : 56.27394437789917 time for calcul the mask position with numpy : 1.060340404510498 nb_pixel_total : 4389946 time to create 1 rle with new method : 1.6872384548187256 time for calcul the mask position with numpy : 0.05279111862182617 nb_pixel_total : 33735 time to create 1 rle with old method : 0.03626847267150879 time for calcul the mask position with numpy : 0.25385379791259766 nb_pixel_total : 348470 time to create 1 rle with new method : 1.5000710487365723 time for calcul the mask position with numpy : 0.07397913932800293 nb_pixel_total : 713291 time to create 1 rle with new method : 1.4875767230987549 time for calcul the mask position with numpy : 0.0540165901184082 nb_pixel_total : 35995 time to create 1 rle with old method : 0.04201173782348633 time for calcul the mask position with numpy : 0.05402731895446777 nb_pixel_total : 76113 time to create 1 rle with old method : 0.08383297920227051 time for calcul the mask position with numpy : 0.06636929512023926 nb_pixel_total : 815145 time to create 1 rle with new method : 1.1184473037719727 time for calcul the mask position with numpy : 0.05264449119567871 nb_pixel_total : 202320 time to create 1 rle with new method : 1.0726308822631836 time for calcul the mask position with numpy : 0.05351972579956055 nb_pixel_total : 35 time to create 1 rle with old method : 9.799003601074219e-05 time for calcul the mask position with numpy : 0.05300593376159668 nb_pixel_total : 2 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.05266070365905762 nb_pixel_total : 102791 time to create 1 rle with old method : 0.10477828979492188 time for calcul the mask position with numpy : 0.04970288276672363 nb_pixel_total : 3154 time to create 1 rle with old method : 0.003378629684448242 time for calcul the mask position with numpy : 0.04945492744445801 nb_pixel_total : 5422 time to create 1 rle with old method : 0.006166696548461914 time for calcul the mask position with numpy : 0.0493319034576416 nb_pixel_total : 14792 time to create 1 rle with old method : 0.015400171279907227 time for calcul the mask position with numpy : 0.05270528793334961 nb_pixel_total : 81316 time to create 1 rle with old method : 0.08583927154541016 time for calcul the mask position with numpy : 0.04962563514709473 nb_pixel_total : 28448 time to create 1 rle with old method : 0.029752492904663086 time for calcul the mask position with numpy : 0.05071663856506348 nb_pixel_total : 14310 time to create 1 rle with old method : 0.014935016632080078 time for calcul the mask position with numpy : 0.05292677879333496 nb_pixel_total : 170797 time to create 1 rle with new method : 1.7103769779205322 time for calcul the mask position with numpy : 0.05524182319641113 nb_pixel_total : 41453 time to create 1 rle with old method : 0.04702639579772949 time for calcul the mask position with numpy : 0.05510687828063965 nb_pixel_total : 9733 time to create 1 rle with old method : 0.012866497039794922 time for calcul the mask position with numpy : 0.054830074310302734 nb_pixel_total : 56498 time to create 1 rle with old method : 0.06249713897705078 time for calcul the mask position with numpy : 0.0565035343170166 nb_pixel_total : 218440 time to create 1 rle with new method : 1.640777587890625 time for calcul the mask position with numpy : 0.05473136901855469 nb_pixel_total : 36998 time to create 1 rle with old method : 0.04093599319458008 time for calcul the mask position with numpy : 0.06620311737060547 nb_pixel_total : 390231 time to create 1 rle with new method : 1.5514335632324219 time for calcul the mask position with numpy : 0.056389808654785156 nb_pixel_total : 78992 time to create 1 rle with old method : 0.09213900566101074 time for calcul the mask position with numpy : 0.05500340461730957 nb_pixel_total : 40104 time to create 1 rle with old method : 0.04426455497741699 time for calcul the mask position with numpy : 0.05373334884643555 nb_pixel_total : 905 time to create 1 rle with old method : 0.001964569091796875 time for calcul the mask position with numpy : 0.053603172302246094 nb_pixel_total : 35159 time to create 1 rle with old method : 0.03954458236694336 time for calcul the mask position with numpy : 0.054595947265625 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0016109943389892578 time for calcul the mask position with numpy : 0.05460333824157715 nb_pixel_total : 4789 time to create 1 rle with old method : 0.0055389404296875 time for calcul the mask position with numpy : 0.05489611625671387 nb_pixel_total : 36972 time to create 1 rle with old method : 0.042301177978515625 time for calcul the mask position with numpy : 0.054117441177368164 nb_pixel_total : 670 time to create 1 rle with old method : 0.001055002212524414 time for calcul the mask position with numpy : 0.05447745323181152 nb_pixel_total : 29454 time to create 1 rle with old method : 0.032686471939086914 time for calcul the mask position with numpy : 0.05424308776855469 nb_pixel_total : 19733 time to create 1 rle with old method : 0.022406578063964844 time for calcul the mask position with numpy : 0.06984710693359375 nb_pixel_total : 744588 time to create 1 rle with new method : 2.4795234203338623 time for calcul the mask position with numpy : 0.056778669357299805 nb_pixel_total : 198692 time to create 1 rle with new method : 1.9684574604034424 time for calcul the mask position with numpy : 0.05212068557739258 nb_pixel_total : 4873 time to create 1 rle with old method : 0.005954742431640625 time for calcul the mask position with numpy : 0.05441927909851074 nb_pixel_total : 57238 time to create 1 rle with old method : 0.06080937385559082 time for calcul the mask position with numpy : 0.06099271774291992 nb_pixel_total : 681364 time to create 1 rle with new method : 1.7984521389007568 time for calcul the mask position with numpy : 0.05761981010437012 nb_pixel_total : 293306 time to create 1 rle with new method : 1.9523706436157227 time for calcul the mask position with numpy : 0.055528879165649414 nb_pixel_total : 97220 time to create 1 rle with old method : 0.11054253578186035 time for calcul the mask position with numpy : 0.052019596099853516 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009188652038574219 time for calcul the mask position with numpy : 0.053133249282836914 nb_pixel_total : 17698 time to create 1 rle with old method : 0.019155025482177734 time for calcul the mask position with numpy : 0.05294990539550781 nb_pixel_total : 168874 time to create 1 rle with new method : 1.740328073501587 time for calcul the mask position with numpy : 0.062296390533447266 nb_pixel_total : 244659 time to create 1 rle with new method : 1.7151334285736084 time for calcul the mask position with numpy : 0.05337357521057129 nb_pixel_total : 17219 time to create 1 rle with old method : 0.020233869552612305 time for calcul the mask position with numpy : 0.05312037467956543 nb_pixel_total : 87348 time to create 1 rle with old method : 0.0944674015045166 time for calcul the mask position with numpy : 0.05415987968444824 nb_pixel_total : 58265 time to create 1 rle with old method : 0.06458902359008789 time for calcul the mask position with numpy : 0.060272216796875 nb_pixel_total : 569575 time to create 1 rle with new method : 1.8749427795410156 time for calcul the mask position with numpy : 0.05564546585083008 nb_pixel_total : 96753 time to create 1 rle with old method : 0.11085844039916992 time for calcul the mask position with numpy : 0.05450701713562012 nb_pixel_total : 25615 time to create 1 rle with old method : 0.028701305389404297 time for calcul the mask position with numpy : 0.05567598342895508 nb_pixel_total : 4259 time to create 1 rle with old method : 0.0050466060638427734 time for calcul the mask position with numpy : 0.05461406707763672 nb_pixel_total : 36876 time to create 1 rle with old method : 0.04709911346435547 time for calcul the mask position with numpy : 0.05439591407775879 nb_pixel_total : 4832 time to create 1 rle with old method : 0.006241321563720703 time for calcul the mask position with numpy : 0.057256460189819336 nb_pixel_total : 267746 time to create 1 rle with new method : 2.5931975841522217 time for calcul the mask position with numpy : 0.052692413330078125 nb_pixel_total : 32527 time to create 1 rle with old method : 0.03618645668029785 time for calcul the mask position with numpy : 0.05452561378479004 nb_pixel_total : 131304 time to create 1 rle with old method : 0.14370226860046387 time for calcul the mask position with numpy : 0.0533905029296875 nb_pixel_total : 68916 time to create 1 rle with old method : 0.0964365005493164 time for calcul the mask position with numpy : 0.0572357177734375 nb_pixel_total : 87091 time to create 1 rle with old method : 0.09972405433654785 time for calcul the mask position with numpy : 0.056775808334350586 nb_pixel_total : 436665 time to create 1 rle with new method : 2.333308696746826 time for calcul the mask position with numpy : 0.05474662780761719 nb_pixel_total : 101467 time to create 1 rle with old method : 0.11961078643798828 time for calcul the mask position with numpy : 0.055516719818115234 nb_pixel_total : 197804 time to create 1 rle with new method : 0.6798484325408936 time for calcul the mask position with numpy : 0.055580854415893555 nb_pixel_total : 58762 time to create 1 rle with old method : 0.06795167922973633 time for calcul the mask position with numpy : 0.055296897888183594 nb_pixel_total : 46967 time to create 1 rle with old method : 0.051637887954711914 time for calcul the mask position with numpy : 0.05727338790893555 nb_pixel_total : 13596 time to create 1 rle with old method : 0.015725374221801758 time for calcul the mask position with numpy : 0.05706501007080078 nb_pixel_total : 1125 time to create 1 rle with old method : 0.0016927719116210938 time for calcul the mask position with numpy : 0.05426025390625 nb_pixel_total : 26000 time to create 1 rle with old method : 0.02877640724182129 time for calcul the mask position with numpy : 0.05738353729248047 nb_pixel_total : 10019 time to create 1 rle with old method : 0.012145519256591797 time for calcul the mask position with numpy : 0.05395102500915527 nb_pixel_total : 36571 time to create 1 rle with old method : 0.041532278060913086 time for calcul the mask position with numpy : 0.054763078689575195 nb_pixel_total : 15174 time to create 1 rle with old method : 0.018729209899902344 create new chi : 39.06243562698364 time to delete rle : 0.0072252750396728516 batch 1 Loaded 70 chid ids of type : 4855 Number RLEs to save : 60914 TO DO : save crop sub photo not yet done ! save time : 8.417206764221191 nb_obj : 74 nb_hashtags : 10 time to prepare the origin masks : 68.7130126953125 time for calcul the mask position with numpy : 0.29387950897216797 nb_pixel_total : 3649655 time to create 1 rle with new method : 0.6625196933746338 time for calcul the mask position with numpy : 0.05312943458557129 nb_pixel_total : 89484 time to create 1 rle with old method : 0.0964822769165039 time for calcul the mask position with numpy : 0.05402994155883789 nb_pixel_total : 155400 time to create 1 rle with new method : 0.6219100952148438 time for calcul the mask position with numpy : 0.05481719970703125 nb_pixel_total : 20012 time to create 1 rle with old method : 0.024030447006225586 time for calcul the mask position with numpy : 0.05926108360290527 nb_pixel_total : 1568 time to create 1 rle with old method : 0.00220489501953125 time for calcul the mask position with numpy : 0.05473208427429199 nb_pixel_total : 44624 time to create 1 rle with old method : 0.05037093162536621 time for calcul the mask position with numpy : 0.05495810508728027 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008296966552734375 time for calcul the mask position with numpy : 0.15995407104492188 nb_pixel_total : 2542846 time to create 1 rle with new method : 1.0731232166290283 time for calcul the mask position with numpy : 0.055841922760009766 nb_pixel_total : 75762 time to create 1 rle with old method : 0.08880996704101562 time for calcul the mask position with numpy : 0.05841326713562012 nb_pixel_total : 72488 time to create 1 rle with old method : 0.08175396919250488 time for calcul the mask position with numpy : 0.05534553527832031 nb_pixel_total : 224317 time to create 1 rle with new method : 1.565502405166626 time for calcul the mask position with numpy : 0.057132720947265625 nb_pixel_total : 148271 time to create 1 rle with old method : 0.1668710708618164 time for calcul the mask position with numpy : 0.055863142013549805 nb_pixel_total : 15912 time to create 1 rle with old method : 0.018727779388427734 time for calcul the mask position with numpy : 0.05640721321105957 nb_pixel_total : 238152 time to create 1 rle with new method : 1.2982251644134521 time for calcul the mask position with numpy : 0.054162025451660156 nb_pixel_total : 201839 time to create 1 rle with new method : 1.3648254871368408 time for calcul the mask position with numpy : 0.055365800857543945 nb_pixel_total : 114752 time to create 1 rle with old method : 0.13125276565551758 time for calcul the mask position with numpy : 0.06183743476867676 nb_pixel_total : 62543 time to create 1 rle with old method : 0.06828188896179199 time for calcul the mask position with numpy : 0.05517911911010742 nb_pixel_total : 122 time to create 1 rle with old method : 0.0003464221954345703 time for calcul the mask position with numpy : 0.0544888973236084 nb_pixel_total : 38717 time to create 1 rle with old method : 0.04282236099243164 time for calcul the mask position with numpy : 0.054995059967041016 nb_pixel_total : 88727 time to create 1 rle with old method : 0.09822893142700195 time for calcul the mask position with numpy : 0.05633902549743652 nb_pixel_total : 138257 time to create 1 rle with old method : 0.15129995346069336 time for calcul the mask position with numpy : 0.05238175392150879 nb_pixel_total : 10893 time to create 1 rle with old method : 0.012170553207397461 time for calcul the mask position with numpy : 0.05403733253479004 nb_pixel_total : 32432 time to create 1 rle with old method : 0.03773307800292969 time for calcul the mask position with numpy : 0.054492950439453125 nb_pixel_total : 232208 time to create 1 rle with new method : 1.6691396236419678 time for calcul the mask position with numpy : 0.05401325225830078 nb_pixel_total : 186166 time to create 1 rle with new method : 1.3813648223876953 time for calcul the mask position with numpy : 0.05448722839355469 nb_pixel_total : 1569 time to create 1 rle with old method : 0.0020830631256103516 time for calcul the mask position with numpy : 0.05446028709411621 nb_pixel_total : 3708 time to create 1 rle with old method : 0.004563093185424805 time for calcul the mask position with numpy : 0.05601143836975098 nb_pixel_total : 46110 time to create 1 rle with old method : 0.05079770088195801 time for calcul the mask position with numpy : 0.05446362495422363 nb_pixel_total : 74471 time to create 1 rle with old method : 0.0860438346862793 time for calcul the mask position with numpy : 0.05434679985046387 nb_pixel_total : 40836 time to create 1 rle with old method : 0.04558849334716797 time for calcul the mask position with numpy : 0.05622744560241699 nb_pixel_total : 18359 time to create 1 rle with old method : 0.030029296875 time for calcul the mask position with numpy : 0.06207156181335449 nb_pixel_total : 100291 time to create 1 rle with old method : 0.11561965942382812 time for calcul the mask position with numpy : 0.05879783630371094 nb_pixel_total : 104485 time to create 1 rle with old method : 0.11946344375610352 time for calcul the mask position with numpy : 0.05801892280578613 nb_pixel_total : 213398 time to create 1 rle with new method : 1.9923622608184814 time for calcul the mask position with numpy : 0.05165863037109375 nb_pixel_total : 109452 time to create 1 rle with old method : 0.11474752426147461 time for calcul the mask position with numpy : 0.053853511810302734 nb_pixel_total : 69273 time to create 1 rle with old method : 0.07201576232910156 time for calcul the mask position with numpy : 0.05164980888366699 nb_pixel_total : 52845 time to create 1 rle with old method : 0.05826067924499512 time for calcul the mask position with numpy : 0.052782297134399414 nb_pixel_total : 30461 time to create 1 rle with old method : 0.032999277114868164 time for calcul the mask position with numpy : 0.05323290824890137 nb_pixel_total : 36357 time to create 1 rle with old method : 0.038507699966430664 time for calcul the mask position with numpy : 0.05212831497192383 nb_pixel_total : 90013 time to create 1 rle with old method : 0.09492993354797363 time for calcul the mask position with numpy : 0.05226016044616699 nb_pixel_total : 155225 time to create 1 rle with new method : 1.4547398090362549 time for calcul the mask position with numpy : 0.05627107620239258 nb_pixel_total : 285246 time to create 1 rle with new method : 1.038095235824585 time for calcul the mask position with numpy : 0.051197052001953125 nb_pixel_total : 29287 time to create 1 rle with old method : 0.03246140480041504 time for calcul the mask position with numpy : 0.05055689811706543 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0019822120666503906 time for calcul the mask position with numpy : 0.05043315887451172 nb_pixel_total : 13038 time to create 1 rle with old method : 0.013894796371459961 time for calcul the mask position with numpy : 0.050409793853759766 nb_pixel_total : 88967 time to create 1 rle with old method : 0.09273338317871094 time for calcul the mask position with numpy : 0.05153632164001465 nb_pixel_total : 173197 time to create 1 rle with new method : 1.2341203689575195 time for calcul the mask position with numpy : 0.052579402923583984 nb_pixel_total : 135066 time to create 1 rle with old method : 0.14211130142211914 time for calcul the mask position with numpy : 0.05218338966369629 nb_pixel_total : 37419 time to create 1 rle with old method : 0.0421142578125 time for calcul the mask position with numpy : 0.053656578063964844 nb_pixel_total : 55149 time to create 1 rle with old method : 1.363684892654419 time for calcul the mask position with numpy : 0.052330970764160156 nb_pixel_total : 4448 time to create 1 rle with old method : 0.0053539276123046875 time for calcul the mask position with numpy : 0.055121660232543945 nb_pixel_total : 221898 time to create 1 rle with new method : 0.9746119976043701 time for calcul the mask position with numpy : 0.06349635124206543 nb_pixel_total : 26001 time to create 1 rle with old method : 0.03001570701599121 time for calcul the mask position with numpy : 0.05421566963195801 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0020494461059570312 time for calcul the mask position with numpy : 0.06465721130371094 nb_pixel_total : 704845 time to create 1 rle with new method : 1.1322438716888428 time for calcul the mask position with numpy : 0.05401110649108887 nb_pixel_total : 5673 time to create 1 rle with old method : 0.006862163543701172 time for calcul the mask position with numpy : 0.05564236640930176 nb_pixel_total : 116656 time to create 1 rle with old method : 0.12854886054992676 time for calcul the mask position with numpy : 0.05662655830383301 nb_pixel_total : 98414 time to create 1 rle with old method : 0.13328123092651367 time for calcul the mask position with numpy : 0.0565488338470459 nb_pixel_total : 183588 time to create 1 rle with new method : 1.2510788440704346 time for calcul the mask position with numpy : 0.05275774002075195 nb_pixel_total : 145999 time to create 1 rle with old method : 0.15279293060302734 time for calcul the mask position with numpy : 0.05291128158569336 nb_pixel_total : 86130 time to create 1 rle with old method : 0.09302902221679688 time for calcul the mask position with numpy : 0.05106496810913086 nb_pixel_total : 58562 time to create 1 rle with old method : 0.06091046333312988 time for calcul the mask position with numpy : 0.051604270935058594 nb_pixel_total : 194338 time to create 1 rle with new method : 0.9363248348236084 time for calcul the mask position with numpy : 0.05419158935546875 nb_pixel_total : 5869 time to create 1 rle with old method : 0.006869792938232422 time for calcul the mask position with numpy : 0.05198192596435547 nb_pixel_total : 421 time to create 1 rle with old method : 0.0004971027374267578 time for calcul the mask position with numpy : 0.05235481262207031 nb_pixel_total : 97725 time to create 1 rle with old method : 0.10852646827697754 time for calcul the mask position with numpy : 0.05423879623413086 nb_pixel_total : 113535 time to create 1 rle with old method : 0.1203451156616211 time for calcul the mask position with numpy : 0.054219722747802734 nb_pixel_total : 129961 time to create 1 rle with old method : 0.14330029487609863 time for calcul the mask position with numpy : 0.05233192443847656 nb_pixel_total : 94046 time to create 1 rle with old method : 0.10290217399597168 time for calcul the mask position with numpy : 0.05420875549316406 nb_pixel_total : 114816 time to create 1 rle with old method : 0.12121415138244629 time for calcul the mask position with numpy : 0.050559282302856445 nb_pixel_total : 80710 time to create 1 rle with old method : 0.08355903625488281 time for calcul the mask position with numpy : 0.05082297325134277 nb_pixel_total : 3677 time to create 1 rle with old method : 0.004094362258911133 time for calcul the mask position with numpy : 0.050887346267700195 nb_pixel_total : 42719 time to create 1 rle with old method : 0.04558253288269043 time for calcul the mask position with numpy : 0.054111480712890625 nb_pixel_total : 32425 time to create 1 rle with old method : 0.035285234451293945 time for calcul the mask position with numpy : 0.05104374885559082 nb_pixel_total : 64034 time to create 1 rle with old method : 0.06846261024475098 create new chi : 30.001286268234253 time to delete rle : 0.008170843124389648 batch 1 Loaded 75 chid ids of type : 4855 Number RLEs to save : 68671 TO DO : save crop sub photo not yet done ! save time : 14.638091325759888 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 26.14180278778076 time for calcul the mask position with numpy : 0.11557888984680176 nb_pixel_total : 1466648 time to create 1 rle with new method : 1.1300334930419922 time for calcul the mask position with numpy : 0.0734097957611084 nb_pixel_total : 13945 time to create 1 rle with old method : 0.01837015151977539 time for calcul the mask position with numpy : 0.07548689842224121 nb_pixel_total : 14241 time to create 1 rle with old method : 0.017199277877807617 time for calcul the mask position with numpy : 0.07617950439453125 nb_pixel_total : 69784 time to create 1 rle with old method : 0.09593391418457031 time for calcul the mask position with numpy : 0.07521891593933105 nb_pixel_total : 48931 time to create 1 rle with old method : 0.06439495086669922 time for calcul the mask position with numpy : 0.07431769371032715 nb_pixel_total : 3294 time to create 1 rle with old method : 0.0039327144622802734 time for calcul the mask position with numpy : 0.08487987518310547 nb_pixel_total : 26271 time to create 1 rle with old method : 0.029788970947265625 time for calcul the mask position with numpy : 1.0530097484588623 nb_pixel_total : 3392312 time to create 1 rle with new method : 1.6153452396392822 time for calcul the mask position with numpy : 0.08663630485534668 nb_pixel_total : 640829 time to create 1 rle with new method : 1.2286999225616455 time for calcul the mask position with numpy : 0.9092669486999512 nb_pixel_total : 7302945 time to create 1 rle with new method : 1.3048515319824219 create new chi : 8.360787630081177 time to delete rle : 0.002895832061767578 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 22475 TO DO : save crop sub photo not yet done ! save time : 2.603543996810913 map_output_result : {1342523745: (0.42931759470892383, 'Should be the crop_list due to order', 0.17891284312378977), 1342523742: (0.42931759470892383, 'Should be the crop_list due to order', 0.5595060657561444), 1342523737: (0.42931759470892383, 'Should be the crop_list due to order', 0.4343928911026597), 1342523730: (0.42931759470892383, 'Should be the crop_list due to order', 0.08815062825832969), 1342523726: (0.42931759470892383, 'Should be the crop_list due to order', 0.38033009455294947), 1342523699: (0.42931759470892383, 'Should be the crop_list due to order', 0.4648777824705526), 1342523693: (0.42931759470892383, 'Should be the crop_list due to order', 0.353957030202542), 1342523687: (0.42931759470892383, 'Should be the crop_list due to order', 0.9744134222044225)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 8 /1342523745.Didn't retrieve data . /1342523742.Didn't retrieve data . /1342523737.Didn't retrieve data . /1342523730.Didn't retrieve data . /1342523726.Didn't retrieve data . /1342523699.Didn't retrieve data . /1342523693.Didn't retrieve data . /1342523687.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.032158851623535156 save_final save missing photos in datou_result : time spend for datou_step_exec : 717.0364265441895 time spend to save output : 0.03688693046569824 total time spend for step 5 : 717.0733134746552 step6:crop_condition Mon Mar 10 15:58:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 497 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 3015255 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741618795_3228249 we have uploaded 57 photos in the portfolio 3015255 time of upload the photos Elapsed time : 25.09920620918274 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 96 About to insert : list_path_to_insert length 96 new photo from crops ! About to upload 96 photos upload in portfolio : 3015255 init cache_photo without model_param we have 96 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741618899_3228249 we have uploaded 96 photos in the portfolio 3015255 time of upload the photos Elapsed time : 45.44580078125 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741618963_3228249 we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 30.793951272964478 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3015255 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619005_3228249 we have uploaded 18 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.584831476211548 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3015255 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619022_3228249 we have uploaded 9 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.7877321243286133 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3015255 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619069_3228249 we have uploaded 26 photos in the portfolio 3015255 time of upload the photos Elapsed time : 30.830158948898315 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3015255 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619106_3228249 we have uploaded 8 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.557809591293335 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 3015255 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619169_3228249 we have uploaded 53 photos in the portfolio 3015255 time of upload the photos Elapsed time : 24.40102219581604 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619199_3228249 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7609167098999023 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3015255 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619210_3228249 we have uploaded 15 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.514892816543579 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741619383_3228249 we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 22.769165992736816 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 374 /1342561912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342561999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342562914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342563720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342564934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342565777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1130 time used for this insertion : 0.5621297359466553 save_final save missing photos in datou_result : time spend for datou_step_exec : 677.5611617565155 time spend to save output : 0.7627272605895996 total time spend for step 6 : 678.3238890171051 step7:ventilate_hashtags_in_portfolio Mon Mar 10 16:10:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21222678 get user id for portfolio 21222678 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21226315,21226316,21226317,21226318,21226319,21226324,21226326,21226327,21226328,21226329,21226330,21226331,21226333,21226334,21226335,21226336,21226337,21226338,21226339,21226340?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222678 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 1 /21222678. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.03189373016357422 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.954080581665039 time spend to save output : 0.03215312957763672 total time spend for step 7 : 11.986233711242676 step8:final Mon Mar 10 16:10:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342523745: ('0.39564799928084676',), 1342523742: ('0.39564799928084676',), 1342523737: ('0.39564799928084676',), 1342523730: ('0.39564799928084676',), 1342523726: ('0.39564799928084676',), 1342523699: ('0.39564799928084676',), 1342523693: ('0.39564799928084676',), 1342523687: ('0.39564799928084676',)} new output for save of step final : {1342523745: ('0.39564799928084676',), 1342523742: ('0.39564799928084676',), 1342523737: ('0.39564799928084676',), 1342523730: ('0.39564799928084676',), 1342523726: ('0.39564799928084676',), 1342523699: ('0.39564799928084676',), 1342523693: ('0.39564799928084676',), 1342523687: ('0.39564799928084676',)} [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 8 /1342523745.Didn't retrieve data . /1342523742.Didn't retrieve data . /1342523737.Didn't retrieve data . /1342523730.Didn't retrieve data . /1342523726.Didn't retrieve data . /1342523699.Didn't retrieve data . /1342523693.Didn't retrieve data . /1342523687.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.033533334732055664 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.30662059783935547 time spend to save output : 0.03398847579956055 total time spend for step 8 : 0.340609073638916 step9:velours_tree Mon Mar 10 16:10:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.24245452880859375 time spend to save output : 4.9591064453125e-05 total time spend for step 9 : 0.24250411987304688 step10:send_mail_cod Mon Mar 10 16:10:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21222678_10-03-2025_16_10_23.pdf 21226289 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262891741619423 21226290 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262901741619432 21226291 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262911741619435 21226292 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262921741619444 21226293 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262931741619446 21226294 imagette212262941741619446 21226295 imagette212262951741619446 21226296 imagette212262961741619446 21226297 imagette212262971741619446 21226298 imagette212262981741619446 21226299 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212262991741619447 21226300 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212263001741619448 21226301 imagette212263011741619449 21226302 imagette212263021741619449 21226303 imagette212263031741619449 21226304 imagette212263041741619449 21226305 imagette212263051741619449 21226306 change filename to text .imagette212263061741619449 21226307 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212263071741619449 21226309 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212263091741619450 21226310 imagette212263101741619452 21226311 imagette212263111741619452 21226312 imagette212263121741619452 21226313 imagette212263131741619452 21226314 imagette212263141741619452 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21222678 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21226315,21226316,21226317,21226318,21226319,21226324,21226326,21226327,21226328,21226329,21226330,21226331,21226333,21226334,21226335,21226336,21226337,21226338,21226339,21226340?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222678 your option no_mail is active, we will not send the real mail to your client args[1342523745] : ((1342523745, 1568.8703103954708, 2107751945), (1342523745, -0.3146273727756639, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523742] : ((1342523742, 1650.9880773313832, 2107751945), (1342523742, -0.4007262820360925, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523737] : ((1342523737, 1242.1138543541047, 2107751945), (1342523737, -0.2885051408695641, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523730] : ((1342523730, 3532.624574506121, 492609224), (1342523730, -0.3324300403696507, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523726] : ((1342523726, 3031.1259400523045, 492609224), (1342523726, -0.276097536244851, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523699] : ((1342523699, 3668.7942874908554, 492609224), (1342523699, -0.2551242456115684, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523693] : ((1342523693, 2621.9976503613416, 492609224), (1342523693, -0.17636019609865142, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523687] : ((1342523687, 382.40342498702825, 492688767), (1342523687, -0.23793271508895278, 496442774), '0.39564799928084676') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.39564799928084676 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222678_10-03-2025_16_10_23.pdf results_Auto_P21222678_10-03-2025_16_10_23.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222678_10-03-2025_16_10_23.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21222678','results_Auto_P21222678_10-03-2025_16_10_23.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222678_10-03-2025_16_10_23.pdf','pdf','','3.69','0.39564799928084676') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.034337520599365234 save_final save missing photos in datou_result : time spend for datou_step_exec : 33.8674201965332 time spend to save output : 0.0347135066986084 total time spend for step 10 : 33.90213370323181 step11:split_time_score Mon Mar 10 16:10:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('37', 1), ('38', 1), ('39', 6)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04022025 21222678 Nombre de photos uploadées : 8 / 23040 (0%) 04022025 21222678 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 04022025 21222678 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 8.58306884765625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00046944618225097656 elapsed_time : insert_dashboard_record_day_entry 0.07164859771728516 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.41441132458681595 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222675_10-03-2025_15_19_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222675 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222675 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222677 order by id desc limit 1 Qualite : 0.39564799928084676 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222678_10-03-2025_16_10_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222678 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222678 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04022025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342523745, 1342523742, 1342523737, 1342523730, 1342523726, 1342523699, 1342523693, 1342523687] Looping around the photos to save general results len do output : 1 /21222678Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523745', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523742', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523737', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523730', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523726', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523699', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523693', None, None, None, None, None, '2654460') ('4741', None, None, None, None, None, None, None, '2654460') ('4741', '21222678', '1342523687', None, None, None, None, None, '2654460') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.03786635398864746 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.864017963409424 time spend to save output : 0.038191795349121094 total time spend for step 11 : 2.902209758758545 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 988.87user 503.26system 29:36.12elapsed 84%CPU (0avgtext+0avgdata 9110456maxresident)k 3621392inputs+1078792outputs (62274major+79150557minor)pagefaults 0swaps