python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3866059 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3669035'] with mtr_portfolio_ids : ['26569659'] and first list_photo_ids : [] new path : /proc/3866059/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.9518678188323975 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Sep 5 10:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1309 wait 20 seconds l 3637 free memory gpu now : 1309 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 10:21:51.889423: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 10:21:51.916603: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 10:21:51.918746: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbc34000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 10:21:51.918811: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 10:21:51.924926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 10:21:52.127226: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2f57c9e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 10:21:52.127288: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 10:21:52.128170: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:21:52.129686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:21:52.134068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:21:52.137839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:21:52.139471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:21:52.144378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:21:52.146063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:21:52.151786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:21:52.152822: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:21:52.152906: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:21:52.153419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 10:21:52.153435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 10:21:52.153445: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 10:21:52.154250: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 932 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 10:21:52.579619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:21:52.579729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:21:52.579746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:21:52.579762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:21:52.579776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:21:52.579791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:21:52.579805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:21:52.579819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:21:52.580590: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:21:52.592045: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:21:52.592127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:21:52.592143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:21:52.592169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:21:52.592184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:21:52.592198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:21:52.592211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:21:52.592226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:21:52.592970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:21:52.593002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 10:21:52.593010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 10:21:52.593019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 10:21:52.593787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 932 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 10:21:57.221429: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-09-05 10:22:03.360148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:22:03.547687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:22:04.992871: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:04.992967: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:04.999697: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:04.999730: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.005917: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.005952: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.037289: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.037319: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.091780: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:05.091896: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3866656 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4983 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6598 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0018813610076904297 nb_pixel_total : 81662 time to create 1 rle with old method : 0.09751677513122559 length of segment : 405 time for calcul the mask position with numpy : 0.00269317626953125 nb_pixel_total : 94104 time to create 1 rle with old method : 0.15545058250427246 length of segment : 257 time for calcul the mask position with numpy : 0.0011851787567138672 nb_pixel_total : 76189 time to create 1 rle with old method : 0.08549332618713379 length of segment : 412 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 42700 time to create 1 rle with old method : 0.04804801940917969 length of segment : 330 time for calcul the mask position with numpy : 0.00025534629821777344 nb_pixel_total : 10986 time to create 1 rle with old method : 0.013459205627441406 length of segment : 163 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 28548 time to create 1 rle with old method : 0.0352630615234375 length of segment : 303 time for calcul the mask position with numpy : 0.0017104148864746094 nb_pixel_total : 106200 time to create 1 rle with old method : 0.127699613571167 length of segment : 364 time for calcul the mask position with numpy : 0.0001800060272216797 nb_pixel_total : 8697 time to create 1 rle with old method : 0.010069847106933594 length of segment : 133 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 32625 time to create 1 rle with old method : 0.05371570587158203 length of segment : 173 time for calcul the mask position with numpy : 0.0022079944610595703 nb_pixel_total : 134926 time to create 1 rle with old method : 0.15381169319152832 length of segment : 310 time for calcul the mask position with numpy : 0.0007748603820800781 nb_pixel_total : 51496 time to create 1 rle with old method : 0.07868742942810059 length of segment : 290 time for calcul the mask position with numpy : 0.003165721893310547 nb_pixel_total : 191997 time to create 1 rle with new method : 0.011748552322387695 length of segment : 353 time for calcul the mask position with numpy : 0.0021724700927734375 nb_pixel_total : 71488 time to create 1 rle with old method : 0.08098340034484863 length of segment : 389 time for calcul the mask position with numpy : 0.0026712417602539062 nb_pixel_total : 76663 time to create 1 rle with old method : 0.09817743301391602 length of segment : 320 time for calcul the mask position with numpy : 0.005347251892089844 nb_pixel_total : 201749 time to create 1 rle with new method : 0.012637615203857422 length of segment : 352 time for calcul the mask position with numpy : 0.0003120899200439453 nb_pixel_total : 3967 time to create 1 rle with old method : 0.004851102828979492 length of segment : 104 time for calcul the mask position with numpy : 0.0016055107116699219 nb_pixel_total : 46804 time to create 1 rle with old method : 0.05455422401428223 length of segment : 265 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 6455 time to create 1 rle with old method : 0.0077970027923583984 length of segment : 92 time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 14632 time to create 1 rle with old method : 0.01844501495361328 length of segment : 146 time for calcul the mask position with numpy : 0.02390146255493164 nb_pixel_total : 390553 time to create 1 rle with new method : 0.032984018325805664 length of segment : 707 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 371370 time to create 1 rle with new method : 0.11292433738708496 length of segment : 590 time for calcul the mask position with numpy : 0.0015482902526855469 nb_pixel_total : 53293 time to create 1 rle with old method : 0.06718921661376953 length of segment : 255 time for calcul the mask position with numpy : 0.10933613777160645 nb_pixel_total : 463778 time to create 1 rle with new method : 0.026796579360961914 length of segment : 636 time for calcul the mask position with numpy : 0.005632638931274414 nb_pixel_total : 340301 time to create 1 rle with new method : 0.18724513053894043 length of segment : 682 time for calcul the mask position with numpy : 0.00534510612487793 nb_pixel_total : 119255 time to create 1 rle with old method : 0.1448535919189453 length of segment : 501 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 46721 time to create 1 rle with old method : 0.05257773399353027 length of segment : 211 time for calcul the mask position with numpy : 0.0005896091461181641 nb_pixel_total : 17134 time to create 1 rle with old method : 0.02023005485534668 length of segment : 203 time for calcul the mask position with numpy : 0.0021486282348632812 nb_pixel_total : 66378 time to create 1 rle with old method : 0.07669973373413086 length of segment : 296 time for calcul the mask position with numpy : 0.0006372928619384766 nb_pixel_total : 14938 time to create 1 rle with old method : 0.023221969604492188 length of segment : 152 time for calcul the mask position with numpy : 0.0011982917785644531 nb_pixel_total : 30986 time to create 1 rle with old method : 0.04187631607055664 length of segment : 249 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 7383 time to create 1 rle with old method : 0.009005069732666016 length of segment : 191 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 13287 time to create 1 rle with old method : 0.015880823135375977 length of segment : 129 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 6872 time to create 1 rle with old method : 0.008328437805175781 length of segment : 64 time for calcul the mask position with numpy : 0.007281303405761719 nb_pixel_total : 255356 time to create 1 rle with new method : 0.016883134841918945 length of segment : 625 time for calcul the mask position with numpy : 0.003384113311767578 nb_pixel_total : 161762 time to create 1 rle with new method : 0.007709503173828125 length of segment : 755 time for calcul the mask position with numpy : 0.005110263824462891 nb_pixel_total : 233081 time to create 1 rle with new method : 0.012865066528320312 length of segment : 465 time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 21250 time to create 1 rle with old method : 0.02670764923095703 length of segment : 187 time for calcul the mask position with numpy : 0.0031464099884033203 nb_pixel_total : 130258 time to create 1 rle with old method : 0.15631389617919922 length of segment : 372 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 43643 time to create 1 rle with old method : 0.05100584030151367 length of segment : 257 time for calcul the mask position with numpy : 0.002629518508911133 nb_pixel_total : 69680 time to create 1 rle with old method : 0.08364701271057129 length of segment : 234 time for calcul the mask position with numpy : 0.00032019615173339844 nb_pixel_total : 14754 time to create 1 rle with old method : 0.019138097763061523 length of segment : 122 time for calcul the mask position with numpy : 0.0027070045471191406 nb_pixel_total : 115404 time to create 1 rle with old method : 0.13599061965942383 length of segment : 553 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 15408 time to create 1 rle with old method : 0.01805591583251953 length of segment : 169 time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 21177 time to create 1 rle with old method : 0.02471780776977539 length of segment : 244 time for calcul the mask position with numpy : 0.00047659873962402344 nb_pixel_total : 16363 time to create 1 rle with old method : 0.018773555755615234 length of segment : 177 time for calcul the mask position with numpy : 0.00018143653869628906 nb_pixel_total : 3263 time to create 1 rle with old method : 0.005812168121337891 length of segment : 89 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 4752 time to create 1 rle with old method : 0.009214162826538086 length of segment : 98 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 47083 time to create 1 rle with old method : 0.06035804748535156 length of segment : 146 time for calcul the mask position with numpy : 0.0009691715240478516 nb_pixel_total : 28577 time to create 1 rle with old method : 0.03332161903381348 length of segment : 247 time for calcul the mask position with numpy : 0.0015802383422851562 nb_pixel_total : 29085 time to create 1 rle with old method : 0.03358960151672363 length of segment : 349 time for calcul the mask position with numpy : 0.0007357597351074219 nb_pixel_total : 13767 time to create 1 rle with old method : 0.01628565788269043 length of segment : 167 time for calcul the mask position with numpy : 0.0021758079528808594 nb_pixel_total : 84995 time to create 1 rle with old method : 0.09798073768615723 length of segment : 376 time for calcul the mask position with numpy : 0.00038051605224609375 nb_pixel_total : 18189 time to create 1 rle with old method : 0.023246049880981445 length of segment : 260 time for calcul the mask position with numpy : 0.003844738006591797 nb_pixel_total : 87180 time to create 1 rle with old method : 0.1077880859375 length of segment : 506 time for calcul the mask position with numpy : 0.010675907135009766 nb_pixel_total : 255689 time to create 1 rle with new method : 0.03320431709289551 length of segment : 672 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 7321 time to create 1 rle with old method : 0.00841522216796875 length of segment : 137 time for calcul the mask position with numpy : 1.3954074382781982 nb_pixel_total : 5392333 time to create 1 rle with new method : 0.6957249641418457 length of segment : 2483 time for calcul the mask position with numpy : 0.0005130767822265625 nb_pixel_total : 18588 time to create 1 rle with old method : 0.02176356315612793 length of segment : 284 time for calcul the mask position with numpy : 0.020676374435424805 nb_pixel_total : 763075 time to create 1 rle with new method : 0.05721020698547363 length of segment : 810 time for calcul the mask position with numpy : 0.029156923294067383 nb_pixel_total : 1887165 time to create 1 rle with new method : 0.34025096893310547 length of segment : 1839 time for calcul the mask position with numpy : 0.23279881477355957 nb_pixel_total : 2943905 time to create 1 rle with new method : 0.3243141174316406 length of segment : 1214 time spent for convertir_results : 12.141547679901123 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 65.68544816970825 time spend to save output : 0.1743941307067871 total time spend for step 1 : 65.85984230041504 step2:mask_detect Fri Sep 5 10:22:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6666 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 10:22:36.882090: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 10:22:36.908731: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 10:22:36.910831: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbc28000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 10:22:36.910880: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 10:22:36.914842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 10:22:37.056430: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x309551d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 10:22:37.056496: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 10:22:37.057811: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:22:37.058271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:22:37.061523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:22:37.063827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:22:37.064473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:22:37.067084: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:22:37.068602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:22:37.073051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:22:37.074386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:22:37.074464: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:22:37.075124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 10:22:37.075139: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 10:22:37.075148: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 10:22:37.076352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6123 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 10:22:37.229459: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:22:37.229560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:22:37.229591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:22:37.229620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:22:37.229648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:22:37.229676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:22:37.229703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:22:37.229731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:22:37.231500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:22:37.233009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 10:22:37.233065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 10:22:37.233096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:22:37.233123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 10:22:37.233150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 10:22:37.233176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 10:22:37.233203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 10:22:37.233229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:22:37.235113: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 10:22:37.235156: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 10:22:37.235171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 10:22:37.235184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 10:22:37.237051: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6123 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 10:22:49.775487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 10:22:49.949701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 10:22:51.340552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.341215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.341794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.342561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.343269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.343838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.344422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.344453: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.345050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.345066: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.352313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.352356: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.353408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.353430: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.359964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.359996: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.360603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.360622: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.391479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.391515: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.392087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.392103: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.397951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.397972: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.398542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.398558: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 10:22:51.432320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.432913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.434782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.435358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.479253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.479852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.482084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.482705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.513119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.513719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.515385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.515959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.522375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.522919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.524817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.525395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.532128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.532736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.534423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.534961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.568945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.569564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.570142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.570807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.574975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.575560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.594724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.595328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.595902: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.596497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.610913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.611522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.612096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.612696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.617128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.617710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.622410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.623006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.636119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.637009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.641323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.641922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.642496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.643092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.644057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.644662: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.655357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.655980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.656595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.657173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.657758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.658334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.658907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.659498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.669243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.669844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.676272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.676906: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.700243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.700395: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-05 10:22:51.701576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.702610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.709939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.710561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.711195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.711768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.719918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.720666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.740207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.741128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.741856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.742453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.746719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.747353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.747971: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.748583: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.749938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.759870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.760416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.769405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.769944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.770484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.771012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.771548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 10:22:51.772098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 80 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 71 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 3868703 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5626 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6819 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001748800277709961 nb_pixel_total : 36887 time to create 1 rle with old method : 0.052824974060058594 length of segment : 189 time for calcul the mask position with numpy : 0.001123666763305664 nb_pixel_total : 24671 time to create 1 rle with old method : 0.02765631675720215 length of segment : 324 time for calcul the mask position with numpy : 0.003494739532470703 nb_pixel_total : 141146 time to create 1 rle with old method : 0.16536402702331543 length of segment : 320 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 11890 time to create 1 rle with old method : 0.013852119445800781 length of segment : 139 time for calcul the mask position with numpy : 0.0017359256744384766 nb_pixel_total : 73703 time to create 1 rle with old method : 0.08539700508117676 length of segment : 256 time for calcul the mask position with numpy : 0.007566690444946289 nb_pixel_total : 362801 time to create 1 rle with new method : 0.018790483474731445 length of segment : 721 time for calcul the mask position with numpy : 0.004674196243286133 nb_pixel_total : 128697 time to create 1 rle with old method : 0.14377975463867188 length of segment : 411 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 17183 time to create 1 rle with old method : 0.019758939743041992 length of segment : 154 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 20149 time to create 1 rle with old method : 0.023168325424194336 length of segment : 254 time for calcul the mask position with numpy : 0.005148410797119141 nb_pixel_total : 177982 time to create 1 rle with new method : 0.014279842376708984 length of segment : 551 time for calcul the mask position with numpy : 0.0013227462768554688 nb_pixel_total : 44665 time to create 1 rle with old method : 0.07137346267700195 length of segment : 199 time for calcul the mask position with numpy : 0.0015439987182617188 nb_pixel_total : 53340 time to create 1 rle with old method : 0.06114339828491211 length of segment : 321 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 14767 time to create 1 rle with old method : 0.017107248306274414 length of segment : 164 time for calcul the mask position with numpy : 0.0011906623840332031 nb_pixel_total : 23267 time to create 1 rle with old method : 0.027289152145385742 length of segment : 537 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 7055 time to create 1 rle with old method : 0.008200883865356445 length of segment : 144 time for calcul the mask position with numpy : 0.0010483264923095703 nb_pixel_total : 23683 time to create 1 rle with old method : 0.0270082950592041 length of segment : 210 time for calcul the mask position with numpy : 0.0007834434509277344 nb_pixel_total : 36563 time to create 1 rle with old method : 0.041399478912353516 length of segment : 222 time for calcul the mask position with numpy : 0.002207040786743164 nb_pixel_total : 45306 time to create 1 rle with old method : 0.0507512092590332 length of segment : 628 time for calcul the mask position with numpy : 0.0008847713470458984 nb_pixel_total : 33860 time to create 1 rle with old method : 0.03807544708251953 length of segment : 314 time for calcul the mask position with numpy : 0.001390218734741211 nb_pixel_total : 45639 time to create 1 rle with old method : 0.05231928825378418 length of segment : 223 time for calcul the mask position with numpy : 0.0033445358276367188 nb_pixel_total : 155763 time to create 1 rle with new method : 0.008576154708862305 length of segment : 438 time for calcul the mask position with numpy : 0.001489400863647461 nb_pixel_total : 41920 time to create 1 rle with old method : 0.05312633514404297 length of segment : 303 time for calcul the mask position with numpy : 0.0017018318176269531 nb_pixel_total : 59054 time to create 1 rle with old method : 0.06677770614624023 length of segment : 422 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 18172 time to create 1 rle with old method : 0.021378755569458008 length of segment : 91 time for calcul the mask position with numpy : 0.002667665481567383 nb_pixel_total : 68403 time to create 1 rle with old method : 0.0810704231262207 length of segment : 532 time for calcul the mask position with numpy : 0.001142263412475586 nb_pixel_total : 34816 time to create 1 rle with old method : 0.040837764739990234 length of segment : 154 time for calcul the mask position with numpy : 0.0014407634735107422 nb_pixel_total : 56474 time to create 1 rle with old method : 0.06450414657592773 length of segment : 227 time for calcul the mask position with numpy : 0.001806497573852539 nb_pixel_total : 41242 time to create 1 rle with old method : 0.04811525344848633 length of segment : 277 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 38988 time to create 1 rle with old method : 0.04601168632507324 length of segment : 318 time for calcul the mask position with numpy : 0.0043315887451171875 nb_pixel_total : 200092 time to create 1 rle with new method : 0.012702465057373047 length of segment : 669 time for calcul the mask position with numpy : 0.00403285026550293 nb_pixel_total : 170850 time to create 1 rle with new method : 0.009560585021972656 length of segment : 367 time for calcul the mask position with numpy : 0.001672983169555664 nb_pixel_total : 55662 time to create 1 rle with old method : 0.06330585479736328 length of segment : 288 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 15551 time to create 1 rle with old method : 0.01799488067626953 length of segment : 132 time for calcul the mask position with numpy : 0.016100168228149414 nb_pixel_total : 712091 time to create 1 rle with new method : 0.06300973892211914 length of segment : 914 time for calcul the mask position with numpy : 0.0008053779602050781 nb_pixel_total : 28902 time to create 1 rle with old method : 0.03330230712890625 length of segment : 188 time for calcul the mask position with numpy : 0.002734661102294922 nb_pixel_total : 95517 time to create 1 rle with old method : 0.1088113784790039 length of segment : 459 time for calcul the mask position with numpy : 0.009816408157348633 nb_pixel_total : 346849 time to create 1 rle with new method : 0.029512405395507812 length of segment : 854 time for calcul the mask position with numpy : 0.014588356018066406 nb_pixel_total : 584730 time to create 1 rle with new method : 0.03989601135253906 length of segment : 737 time for calcul the mask position with numpy : 0.0014927387237548828 nb_pixel_total : 39165 time to create 1 rle with old method : 0.045381784439086914 length of segment : 290 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 46727 time to create 1 rle with old method : 0.05301785469055176 length of segment : 234 time for calcul the mask position with numpy : 0.0033981800079345703 nb_pixel_total : 133623 time to create 1 rle with old method : 0.15073442459106445 length of segment : 439 time for calcul the mask position with numpy : 0.003033876419067383 nb_pixel_total : 158363 time to create 1 rle with new method : 0.00819087028503418 length of segment : 472 time for calcul the mask position with numpy : 0.002940654754638672 nb_pixel_total : 77728 time to create 1 rle with old method : 0.08716797828674316 length of segment : 298 time for calcul the mask position with numpy : 0.001850128173828125 nb_pixel_total : 60621 time to create 1 rle with old method : 0.06900954246520996 length of segment : 258 time for calcul the mask position with numpy : 0.0005562305450439453 nb_pixel_total : 22684 time to create 1 rle with old method : 0.026018142700195312 length of segment : 175 time for calcul the mask position with numpy : 0.0022916793823242188 nb_pixel_total : 112604 time to create 1 rle with old method : 0.12707281112670898 length of segment : 457 time for calcul the mask position with numpy : 0.0005474090576171875 nb_pixel_total : 16253 time to create 1 rle with old method : 0.018483400344848633 length of segment : 299 time for calcul the mask position with numpy : 0.0012736320495605469 nb_pixel_total : 54647 time to create 1 rle with old method : 0.0636591911315918 length of segment : 195 time for calcul the mask position with numpy : 0.0017290115356445312 nb_pixel_total : 38754 time to create 1 rle with old method : 0.044768571853637695 length of segment : 524 time for calcul the mask position with numpy : 0.0026667118072509766 nb_pixel_total : 136844 time to create 1 rle with old method : 0.15419769287109375 length of segment : 400 time for calcul the mask position with numpy : 0.0029697418212890625 nb_pixel_total : 135551 time to create 1 rle with old method : 0.1519489288330078 length of segment : 363 time for calcul the mask position with numpy : 0.0014786720275878906 nb_pixel_total : 49670 time to create 1 rle with old method : 0.06742548942565918 length of segment : 346 time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 10420 time to create 1 rle with old method : 0.011845111846923828 length of segment : 137 time for calcul the mask position with numpy : 0.001791238784790039 nb_pixel_total : 66199 time to create 1 rle with old method : 0.07300806045532227 length of segment : 430 time for calcul the mask position with numpy : 0.0009646415710449219 nb_pixel_total : 35710 time to create 1 rle with old method : 0.04082345962524414 length of segment : 162 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 36837 time to create 1 rle with old method : 0.041390419006347656 length of segment : 204 time for calcul the mask position with numpy : 0.0017621517181396484 nb_pixel_total : 66017 time to create 1 rle with old method : 0.07376766204833984 length of segment : 460 time for calcul the mask position with numpy : 0.001894235610961914 nb_pixel_total : 94776 time to create 1 rle with old method : 0.10494279861450195 length of segment : 430 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 23569 time to create 1 rle with old method : 0.0273740291595459 length of segment : 141 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 11167 time to create 1 rle with old method : 0.012434005737304688 length of segment : 202 time for calcul the mask position with numpy : 0.0012116432189941406 nb_pixel_total : 60032 time to create 1 rle with old method : 0.0682826042175293 length of segment : 250 time for calcul the mask position with numpy : 0.00426936149597168 nb_pixel_total : 130014 time to create 1 rle with old method : 0.14798974990844727 length of segment : 1794 time for calcul the mask position with numpy : 0.0012164115905761719 nb_pixel_total : 41306 time to create 1 rle with old method : 0.04767179489135742 length of segment : 220 time for calcul the mask position with numpy : 0.0011947154998779297 nb_pixel_total : 47972 time to create 1 rle with old method : 0.0539395809173584 length of segment : 327 time for calcul the mask position with numpy : 0.004912614822387695 nb_pixel_total : 205429 time to create 1 rle with new method : 0.012838363647460938 length of segment : 874 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 22866 time to create 1 rle with old method : 0.026178359985351562 length of segment : 176 time for calcul the mask position with numpy : 0.0011382102966308594 nb_pixel_total : 47852 time to create 1 rle with old method : 0.0528712272644043 length of segment : 344 time for calcul the mask position with numpy : 0.0007903575897216797 nb_pixel_total : 40763 time to create 1 rle with old method : 0.0453639030456543 length of segment : 214 time for calcul the mask position with numpy : 0.0017709732055664062 nb_pixel_total : 93334 time to create 1 rle with old method : 0.10309910774230957 length of segment : 379 time for calcul the mask position with numpy : 0.0018966197967529297 nb_pixel_total : 58557 time to create 1 rle with old method : 0.06539011001586914 length of segment : 278 time for calcul the mask position with numpy : 0.001374959945678711 nb_pixel_total : 78342 time to create 1 rle with old method : 0.08849787712097168 length of segment : 385 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 36491 time to create 1 rle with old method : 0.041368961334228516 length of segment : 231 time for calcul the mask position with numpy : 0.001993894577026367 nb_pixel_total : 102272 time to create 1 rle with old method : 0.11399173736572266 length of segment : 258 time for calcul the mask position with numpy : 0.0030918121337890625 nb_pixel_total : 160821 time to create 1 rle with new method : 0.008734464645385742 length of segment : 537 time for calcul the mask position with numpy : 0.007117033004760742 nb_pixel_total : 296715 time to create 1 rle with new method : 0.02275824546813965 length of segment : 1077 time for calcul the mask position with numpy : 0.0020203590393066406 nb_pixel_total : 82650 time to create 1 rle with old method : 0.09246015548706055 length of segment : 470 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 25394 time to create 1 rle with old method : 0.028572797775268555 length of segment : 132 time for calcul the mask position with numpy : 0.002706766128540039 nb_pixel_total : 68812 time to create 1 rle with old method : 0.07577919960021973 length of segment : 1057 time for calcul the mask position with numpy : 0.0010671615600585938 nb_pixel_total : 46689 time to create 1 rle with old method : 0.052597999572753906 length of segment : 344 time for calcul the mask position with numpy : 0.0010554790496826172 nb_pixel_total : 53844 time to create 1 rle with old method : 0.06032395362854004 length of segment : 273 time for calcul the mask position with numpy : 0.00040912628173828125 nb_pixel_total : 16787 time to create 1 rle with old method : 0.019186735153198242 length of segment : 223 time for calcul the mask position with numpy : 0.0005307197570800781 nb_pixel_total : 19769 time to create 1 rle with old method : 0.023520469665527344 length of segment : 156 time for calcul the mask position with numpy : 0.0005021095275878906 nb_pixel_total : 17154 time to create 1 rle with old method : 0.020050764083862305 length of segment : 184 time for calcul the mask position with numpy : 0.004555702209472656 nb_pixel_total : 213964 time to create 1 rle with new method : 0.011331558227539062 length of segment : 612 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 15710 time to create 1 rle with old method : 0.017639636993408203 length of segment : 155 time for calcul the mask position with numpy : 0.0015218257904052734 nb_pixel_total : 73096 time to create 1 rle with old method : 0.08086824417114258 length of segment : 255 time for calcul the mask position with numpy : 0.0007135868072509766 nb_pixel_total : 30021 time to create 1 rle with old method : 0.03399085998535156 length of segment : 265 time for calcul the mask position with numpy : 0.0005350112915039062 nb_pixel_total : 19450 time to create 1 rle with old method : 0.02267742156982422 length of segment : 134 time for calcul the mask position with numpy : 0.003257274627685547 nb_pixel_total : 115268 time to create 1 rle with old method : 0.12934470176696777 length of segment : 488 time for calcul the mask position with numpy : 0.0013971328735351562 nb_pixel_total : 61055 time to create 1 rle with old method : 0.06914758682250977 length of segment : 453 time for calcul the mask position with numpy : 0.0004284381866455078 nb_pixel_total : 13456 time to create 1 rle with old method : 0.01561284065246582 length of segment : 189 time for calcul the mask position with numpy : 0.010351419448852539 nb_pixel_total : 523126 time to create 1 rle with new method : 0.023586750030517578 length of segment : 511 time for calcul the mask position with numpy : 0.0021338462829589844 nb_pixel_total : 83746 time to create 1 rle with old method : 0.09319734573364258 length of segment : 303 time for calcul the mask position with numpy : 0.0016498565673828125 nb_pixel_total : 68668 time to create 1 rle with old method : 0.07489013671875 length of segment : 608 time for calcul the mask position with numpy : 0.0009748935699462891 nb_pixel_total : 13264 time to create 1 rle with old method : 0.022431373596191406 length of segment : 167 time for calcul the mask position with numpy : 0.006028413772583008 nb_pixel_total : 295926 time to create 1 rle with new method : 0.014690160751342773 length of segment : 434 time for calcul the mask position with numpy : 0.0004456043243408203 nb_pixel_total : 19721 time to create 1 rle with old method : 0.02251601219177246 length of segment : 141 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 8326 time to create 1 rle with old method : 0.009480476379394531 length of segment : 156 time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 13966 time to create 1 rle with old method : 0.01583242416381836 length of segment : 169 time for calcul the mask position with numpy : 0.0012738704681396484 nb_pixel_total : 45278 time to create 1 rle with old method : 0.05121302604675293 length of segment : 358 time for calcul the mask position with numpy : 0.0047779083251953125 nb_pixel_total : 261697 time to create 1 rle with new method : 0.011527538299560547 length of segment : 503 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 33635 time to create 1 rle with old method : 0.03809642791748047 length of segment : 214 time for calcul the mask position with numpy : 0.008401632308959961 nb_pixel_total : 431758 time to create 1 rle with new method : 0.02192211151123047 length of segment : 701 time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 21465 time to create 1 rle with old method : 0.024152278900146484 length of segment : 301 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 9761 time to create 1 rle with old method : 0.01135706901550293 length of segment : 100 time for calcul the mask position with numpy : 0.005102872848510742 nb_pixel_total : 222852 time to create 1 rle with new method : 0.014029741287231445 length of segment : 819 time for calcul the mask position with numpy : 0.0005190372467041016 nb_pixel_total : 16028 time to create 1 rle with old method : 0.018864870071411133 length of segment : 170 time for calcul the mask position with numpy : 0.0006165504455566406 nb_pixel_total : 15632 time to create 1 rle with old method : 0.01751089096069336 length of segment : 183 time for calcul the mask position with numpy : 0.0069561004638671875 nb_pixel_total : 404047 time to create 1 rle with new method : 0.016102075576782227 length of segment : 688 time for calcul the mask position with numpy : 0.0026056766510009766 nb_pixel_total : 134596 time to create 1 rle with old method : 0.14871668815612793 length of segment : 545 time for calcul the mask position with numpy : 0.0020415782928466797 nb_pixel_total : 93462 time to create 1 rle with old method : 0.10702109336853027 length of segment : 335 time for calcul the mask position with numpy : 0.003726959228515625 nb_pixel_total : 115116 time to create 1 rle with old method : 0.1296215057373047 length of segment : 555 time for calcul the mask position with numpy : 0.0017402172088623047 nb_pixel_total : 58952 time to create 1 rle with old method : 0.0671682357788086 length of segment : 383 time for calcul the mask position with numpy : 0.004734516143798828 nb_pixel_total : 225643 time to create 1 rle with new method : 0.011574268341064453 length of segment : 567 time for calcul the mask position with numpy : 0.004681825637817383 nb_pixel_total : 210360 time to create 1 rle with new method : 0.011766672134399414 length of segment : 476 time for calcul the mask position with numpy : 0.0015115737915039062 nb_pixel_total : 62657 time to create 1 rle with old method : 0.07026362419128418 length of segment : 251 time for calcul the mask position with numpy : 0.0036780834197998047 nb_pixel_total : 136256 time to create 1 rle with old method : 0.17668914794921875 length of segment : 591 time for calcul the mask position with numpy : 0.0018231868743896484 nb_pixel_total : 57616 time to create 1 rle with old method : 0.06484460830688477 length of segment : 238 time for calcul the mask position with numpy : 0.0012958049774169922 nb_pixel_total : 45783 time to create 1 rle with old method : 0.051358699798583984 length of segment : 307 time for calcul the mask position with numpy : 0.003931760787963867 nb_pixel_total : 181077 time to create 1 rle with new method : 0.0103607177734375 length of segment : 489 time for calcul the mask position with numpy : 0.004160165786743164 nb_pixel_total : 138188 time to create 1 rle with old method : 0.15113544464111328 length of segment : 534 time for calcul the mask position with numpy : 0.0027027130126953125 nb_pixel_total : 128937 time to create 1 rle with old method : 0.1437981128692627 length of segment : 448 time for calcul the mask position with numpy : 0.0006647109985351562 nb_pixel_total : 30109 time to create 1 rle with old method : 0.03318643569946289 length of segment : 212 time for calcul the mask position with numpy : 0.0011243820190429688 nb_pixel_total : 52020 time to create 1 rle with old method : 0.05811953544616699 length of segment : 231 time for calcul the mask position with numpy : 0.013885974884033203 nb_pixel_total : 538096 time to create 1 rle with new method : 0.036802053451538086 length of segment : 1114 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 6154 time to create 1 rle with old method : 0.007386207580566406 length of segment : 76 time for calcul the mask position with numpy : 0.0010335445404052734 nb_pixel_total : 45576 time to create 1 rle with old method : 0.0521082878112793 length of segment : 288 time for calcul the mask position with numpy : 0.0003509521484375 nb_pixel_total : 10936 time to create 1 rle with old method : 0.01305079460144043 length of segment : 241 time for calcul the mask position with numpy : 0.005700349807739258 nb_pixel_total : 277181 time to create 1 rle with new method : 0.016361474990844727 length of segment : 623 time for calcul the mask position with numpy : 0.0010614395141601562 nb_pixel_total : 37109 time to create 1 rle with old method : 0.04273676872253418 length of segment : 288 time for calcul the mask position with numpy : 0.0005545616149902344 nb_pixel_total : 31438 time to create 1 rle with old method : 0.035437583923339844 length of segment : 213 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 37476 time to create 1 rle with old method : 0.04175710678100586 length of segment : 320 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 22647 time to create 1 rle with old method : 0.025055408477783203 length of segment : 194 time for calcul the mask position with numpy : 0.01079559326171875 nb_pixel_total : 544103 time to create 1 rle with new method : 0.02627253532409668 length of segment : 770 time for calcul the mask position with numpy : 0.0015523433685302734 nb_pixel_total : 70435 time to create 1 rle with old method : 0.07820391654968262 length of segment : 308 time for calcul the mask position with numpy : 0.0005619525909423828 nb_pixel_total : 21154 time to create 1 rle with old method : 0.02403569221496582 length of segment : 109 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 37447 time to create 1 rle with old method : 0.041013240814208984 length of segment : 170 time for calcul the mask position with numpy : 0.0011105537414550781 nb_pixel_total : 45284 time to create 1 rle with old method : 0.0495145320892334 length of segment : 291 time for calcul the mask position with numpy : 0.0014579296112060547 nb_pixel_total : 52043 time to create 1 rle with old method : 0.056824684143066406 length of segment : 268 time for calcul the mask position with numpy : 0.005043506622314453 nb_pixel_total : 147386 time to create 1 rle with old method : 0.16192245483398438 length of segment : 620 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 18441 time to create 1 rle with old method : 0.021045923233032227 length of segment : 108 time for calcul the mask position with numpy : 0.013384103775024414 nb_pixel_total : 612713 time to create 1 rle with new method : 0.040764808654785156 length of segment : 847 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 16438 time to create 1 rle with old method : 0.01891350746154785 length of segment : 116 time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 20838 time to create 1 rle with old method : 0.023224353790283203 length of segment : 213 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 28710 time to create 1 rle with old method : 0.03167128562927246 length of segment : 157 time for calcul the mask position with numpy : 0.0010526180267333984 nb_pixel_total : 54390 time to create 1 rle with old method : 0.05869770050048828 length of segment : 373 time for calcul the mask position with numpy : 0.0008215904235839844 nb_pixel_total : 36903 time to create 1 rle with old method : 0.04041767120361328 length of segment : 233 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 34545 time to create 1 rle with old method : 0.03799700736999512 length of segment : 188 time for calcul the mask position with numpy : 0.001580953598022461 nb_pixel_total : 84552 time to create 1 rle with old method : 0.09408950805664062 length of segment : 275 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 51158 time to create 1 rle with old method : 0.05717802047729492 length of segment : 255 time for calcul the mask position with numpy : 0.0030527114868164062 nb_pixel_total : 124629 time to create 1 rle with old method : 0.13649797439575195 length of segment : 461 time for calcul the mask position with numpy : 0.015558242797851562 nb_pixel_total : 814997 time to create 1 rle with new method : 0.06065678596496582 length of segment : 1480 time for calcul the mask position with numpy : 0.0020656585693359375 nb_pixel_total : 83246 time to create 1 rle with old method : 0.09620499610900879 length of segment : 513 time for calcul the mask position with numpy : 0.006055593490600586 nb_pixel_total : 291842 time to create 1 rle with new method : 0.016593456268310547 length of segment : 644 time for calcul the mask position with numpy : 0.0005331039428710938 nb_pixel_total : 22481 time to create 1 rle with old method : 0.02593374252319336 length of segment : 167 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 9200 time to create 1 rle with old method : 0.01062154769897461 length of segment : 123 time for calcul the mask position with numpy : 0.0008361339569091797 nb_pixel_total : 40607 time to create 1 rle with old method : 0.04736924171447754 length of segment : 163 time for calcul the mask position with numpy : 0.00494694709777832 nb_pixel_total : 296431 time to create 1 rle with new method : 0.0134735107421875 length of segment : 519 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 18245 time to create 1 rle with old method : 0.020999908447265625 length of segment : 146 time for calcul the mask position with numpy : 0.0038521289825439453 nb_pixel_total : 176005 time to create 1 rle with new method : 0.010945320129394531 length of segment : 693 time for calcul the mask position with numpy : 0.0009407997131347656 nb_pixel_total : 37320 time to create 1 rle with old method : 0.04402279853820801 length of segment : 174 time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 28837 time to create 1 rle with old method : 0.03352785110473633 length of segment : 262 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 41493 time to create 1 rle with old method : 0.04768562316894531 length of segment : 282 time for calcul the mask position with numpy : 0.0020902156829833984 nb_pixel_total : 112234 time to create 1 rle with old method : 0.12751054763793945 length of segment : 381 time for calcul the mask position with numpy : 0.0020751953125 nb_pixel_total : 99698 time to create 1 rle with old method : 0.11078238487243652 length of segment : 234 time for calcul the mask position with numpy : 0.0016665458679199219 nb_pixel_total : 48064 time to create 1 rle with old method : 0.056026458740234375 length of segment : 330 time for calcul the mask position with numpy : 0.0038328170776367188 nb_pixel_total : 182432 time to create 1 rle with new method : 0.010331869125366211 length of segment : 600 time for calcul the mask position with numpy : 0.0065250396728515625 nb_pixel_total : 231601 time to create 1 rle with new method : 0.017438650131225586 length of segment : 650 time for calcul the mask position with numpy : 0.000736236572265625 nb_pixel_total : 19228 time to create 1 rle with old method : 0.024322509765625 length of segment : 270 time for calcul the mask position with numpy : 0.0004031658172607422 nb_pixel_total : 18294 time to create 1 rle with old method : 0.02162623405456543 length of segment : 138 time for calcul the mask position with numpy : 0.0026237964630126953 nb_pixel_total : 74723 time to create 1 rle with old method : 0.08641386032104492 length of segment : 375 time for calcul the mask position with numpy : 0.0037088394165039062 nb_pixel_total : 137115 time to create 1 rle with old method : 0.152174711227417 length of segment : 607 time for calcul the mask position with numpy : 0.0036907196044921875 nb_pixel_total : 158672 time to create 1 rle with new method : 0.009783267974853516 length of segment : 577 time for calcul the mask position with numpy : 0.0009996891021728516 nb_pixel_total : 29624 time to create 1 rle with old method : 0.03424644470214844 length of segment : 263 time for calcul the mask position with numpy : 0.0021228790283203125 nb_pixel_total : 106313 time to create 1 rle with old method : 0.11743783950805664 length of segment : 334 time for calcul the mask position with numpy : 0.0018506050109863281 nb_pixel_total : 56248 time to create 1 rle with old method : 0.06417512893676758 length of segment : 212 time for calcul the mask position with numpy : 0.015436649322509766 nb_pixel_total : 495700 time to create 1 rle with new method : 0.05007767677307129 length of segment : 697 time for calcul the mask position with numpy : 0.007554769515991211 nb_pixel_total : 302691 time to create 1 rle with new method : 0.023738384246826172 length of segment : 701 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 24069 time to create 1 rle with old method : 0.026993274688720703 length of segment : 180 time for calcul the mask position with numpy : 0.0020477771759033203 nb_pixel_total : 112622 time to create 1 rle with old method : 0.1244974136352539 length of segment : 395 time for calcul the mask position with numpy : 0.002660512924194336 nb_pixel_total : 107744 time to create 1 rle with old method : 0.11769771575927734 length of segment : 334 time for calcul the mask position with numpy : 0.005930662155151367 nb_pixel_total : 289052 time to create 1 rle with new method : 0.016594648361206055 length of segment : 830 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 11272 time to create 1 rle with old method : 0.013479232788085938 length of segment : 106 time for calcul the mask position with numpy : 0.002346515655517578 nb_pixel_total : 74234 time to create 1 rle with old method : 0.08436942100524902 length of segment : 355 time for calcul the mask position with numpy : 0.0013399124145507812 nb_pixel_total : 26160 time to create 1 rle with old method : 0.030195236206054688 length of segment : 278 time for calcul the mask position with numpy : 0.0003342628479003906 nb_pixel_total : 10908 time to create 1 rle with old method : 0.012664318084716797 length of segment : 126 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 4668 time to create 1 rle with old method : 0.0055544376373291016 length of segment : 98 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 19281 time to create 1 rle with old method : 0.021737098693847656 length of segment : 160 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 7197 time to create 1 rle with old method : 0.008304834365844727 length of segment : 140 time for calcul the mask position with numpy : 0.002771139144897461 nb_pixel_total : 91256 time to create 1 rle with old method : 0.1009359359741211 length of segment : 387 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 3177 time to create 1 rle with old method : 0.003985881805419922 length of segment : 91 time for calcul the mask position with numpy : 0.0005571842193603516 nb_pixel_total : 18177 time to create 1 rle with old method : 0.020385265350341797 length of segment : 127 time for calcul the mask position with numpy : 0.003545045852661133 nb_pixel_total : 196774 time to create 1 rle with new method : 0.010317564010620117 length of segment : 572 time for calcul the mask position with numpy : 0.0036191940307617188 nb_pixel_total : 120188 time to create 1 rle with old method : 0.15855860710144043 length of segment : 713 time for calcul the mask position with numpy : 0.002798795700073242 nb_pixel_total : 132584 time to create 1 rle with old method : 0.14774417877197266 length of segment : 422 time for calcul the mask position with numpy : 0.0017285346984863281 nb_pixel_total : 80755 time to create 1 rle with old method : 0.08867549896240234 length of segment : 435 time for calcul the mask position with numpy : 0.0007116794586181641 nb_pixel_total : 30011 time to create 1 rle with old method : 0.03290271759033203 length of segment : 315 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 31339 time to create 1 rle with old method : 0.03597450256347656 length of segment : 205 time for calcul the mask position with numpy : 0.006755352020263672 nb_pixel_total : 177167 time to create 1 rle with new method : 0.02351856231689453 length of segment : 453 time for calcul the mask position with numpy : 0.0014390945434570312 nb_pixel_total : 66682 time to create 1 rle with old method : 0.07327580451965332 length of segment : 253 time for calcul the mask position with numpy : 0.0009989738464355469 nb_pixel_total : 40754 time to create 1 rle with old method : 0.04720950126647949 length of segment : 259 time for calcul the mask position with numpy : 0.0020148754119873047 nb_pixel_total : 74884 time to create 1 rle with old method : 0.08394527435302734 length of segment : 300 time for calcul the mask position with numpy : 0.0012483596801757812 nb_pixel_total : 34235 time to create 1 rle with old method : 0.03896665573120117 length of segment : 231 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 19354 time to create 1 rle with old method : 0.02119922637939453 length of segment : 224 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 21772 time to create 1 rle with old method : 0.024771928787231445 length of segment : 137 time for calcul the mask position with numpy : 0.010272026062011719 nb_pixel_total : 408389 time to create 1 rle with new method : 0.03383135795593262 length of segment : 1123 time for calcul the mask position with numpy : 0.0006601810455322266 nb_pixel_total : 18115 time to create 1 rle with old method : 0.021404027938842773 length of segment : 176 time for calcul the mask position with numpy : 0.0012729167938232422 nb_pixel_total : 38634 time to create 1 rle with old method : 0.04381394386291504 length of segment : 265 time for calcul the mask position with numpy : 0.0018765926361083984 nb_pixel_total : 50734 time to create 1 rle with old method : 0.05795598030090332 length of segment : 303 time for calcul the mask position with numpy : 0.0006186962127685547 nb_pixel_total : 22711 time to create 1 rle with old method : 0.026571273803710938 length of segment : 112 time for calcul the mask position with numpy : 0.0008721351623535156 nb_pixel_total : 28848 time to create 1 rle with old method : 0.03435945510864258 length of segment : 240 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 24472 time to create 1 rle with old method : 0.0276186466217041 length of segment : 193 time for calcul the mask position with numpy : 0.002060413360595703 nb_pixel_total : 78658 time to create 1 rle with old method : 0.10828924179077148 length of segment : 390 time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 12624 time to create 1 rle with old method : 0.014425516128540039 length of segment : 108 time for calcul the mask position with numpy : 0.0026235580444335938 nb_pixel_total : 100572 time to create 1 rle with old method : 0.11817741394042969 length of segment : 386 time for calcul the mask position with numpy : 0.0008909702301025391 nb_pixel_total : 41837 time to create 1 rle with old method : 0.04641842842102051 length of segment : 242 time for calcul the mask position with numpy : 0.0013277530670166016 nb_pixel_total : 47615 time to create 1 rle with old method : 0.05542469024658203 length of segment : 304 time for calcul the mask position with numpy : 0.0010936260223388672 nb_pixel_total : 33048 time to create 1 rle with old method : 0.04094076156616211 length of segment : 276 time for calcul the mask position with numpy : 0.0012557506561279297 nb_pixel_total : 73830 time to create 1 rle with old method : 0.0834197998046875 length of segment : 243 time for calcul the mask position with numpy : 0.0007474422454833984 nb_pixel_total : 28776 time to create 1 rle with old method : 0.03203439712524414 length of segment : 239 time for calcul the mask position with numpy : 0.0010766983032226562 nb_pixel_total : 51779 time to create 1 rle with old method : 0.05814313888549805 length of segment : 282 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 20478 time to create 1 rle with old method : 0.02359795570373535 length of segment : 144 time for calcul the mask position with numpy : 0.0031697750091552734 nb_pixel_total : 135682 time to create 1 rle with old method : 0.15212750434875488 length of segment : 458 time for calcul the mask position with numpy : 0.0012698173522949219 nb_pixel_total : 60523 time to create 1 rle with old method : 0.06826138496398926 length of segment : 280 time for calcul the mask position with numpy : 0.0021431446075439453 nb_pixel_total : 118905 time to create 1 rle with old method : 0.132094144821167 length of segment : 326 time for calcul the mask position with numpy : 0.0017673969268798828 nb_pixel_total : 62711 time to create 1 rle with old method : 0.06997990608215332 length of segment : 305 time for calcul the mask position with numpy : 0.0022482872009277344 nb_pixel_total : 84180 time to create 1 rle with old method : 0.09550929069519043 length of segment : 245 time for calcul the mask position with numpy : 0.0019872188568115234 nb_pixel_total : 80319 time to create 1 rle with old method : 0.09041762351989746 length of segment : 249 time for calcul the mask position with numpy : 0.002324819564819336 nb_pixel_total : 76787 time to create 1 rle with old method : 0.08597922325134277 length of segment : 537 time for calcul the mask position with numpy : 0.6451609134674072 nb_pixel_total : 6198288 time to create 1 rle with new method : 0.9867784976959229 length of segment : 3259 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 61825 time to create 1 rle with old method : 0.07044124603271484 length of segment : 346 time for calcul the mask position with numpy : 0.007017612457275391 nb_pixel_total : 546147 time to create 1 rle with new method : 0.012656211853027344 length of segment : 661 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 6363 time to create 1 rle with old method : 0.007721424102783203 length of segment : 209 time for calcul the mask position with numpy : 0.004639387130737305 nb_pixel_total : 38632 time to create 1 rle with old method : 0.04247570037841797 length of segment : 725 time for calcul the mask position with numpy : 0.0006647109985351562 nb_pixel_total : 57139 time to create 1 rle with old method : 0.06499552726745605 length of segment : 161 time for calcul the mask position with numpy : 0.00096893310546875 nb_pixel_total : 76756 time to create 1 rle with old method : 0.08687162399291992 length of segment : 408 time for calcul the mask position with numpy : 0.002889871597290039 nb_pixel_total : 236078 time to create 1 rle with new method : 0.005582332611083984 length of segment : 236 time spent for convertir_results : 29.845690727233887 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 298 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 94.1877121925354 time spend to save output : 0.1705331802368164 total time spend for step 2 : 94.35824537277222 step3:blur_detection Fri Sep 5 10:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 3120) 4111.457139353217 (3120, 3120) 1561.0474996864134 (3120, 3120) 3372.3060274600703 (3120, 3120) 214.96922930606019 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.013442516326904297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01516866683959961 save missing photos in datou_result : time spend for datou_step_exec : 0.5220720767974854 time spend to save output : 0.03295636177062988 total time spend for step 3 : 0.5550284385681152 step4:brightness Fri Sep 5 10:24:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757060487_3866059_1381664621_793f22ea37974c28c0c9e83aea4e6de2.jpg treat image : temp/1757060487_3866059_1381664619_4736736f38d93282a8f6fc596b0cdaa4.jpg treat image : temp/1757060487_3866059_1381664605_b45ea97211bdcb540ee186485755de7b.jpg treat image : temp/1757060487_3866059_1381664601_40c697796eaa4b57cae9e4ae55478095.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.017072200775146484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.014754295349121094 save missing photos in datou_result : time spend for datou_step_exec : 4.281400680541992 time spend to save output : 0.03588557243347168 total time spend for step 4 : 4.317286252975464 step5:rle_unique_nms_with_priority Fri Sep 5 10:24:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 298 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 98 nb_hashtags : 9 time to prepare the origin masks : 45.48357677459717 time for calcul the mask position with numpy : 0.6375114917755127 nb_pixel_total : 3263876 time to create 1 rle with new method : 1.7750954627990723 time for calcul the mask position with numpy : 0.03996419906616211 nb_pixel_total : 93995 time to create 1 rle with old method : 0.10083413124084473 time for calcul the mask position with numpy : 0.03803682327270508 nb_pixel_total : 54437 time to create 1 rle with old method : 0.05828142166137695 time for calcul the mask position with numpy : 0.03967165946960449 nb_pixel_total : 161563 time to create 1 rle with new method : 0.9625105857849121 time for calcul the mask position with numpy : 0.03860950469970703 nb_pixel_total : 41944 time to create 1 rle with old method : 0.0455930233001709 time for calcul the mask position with numpy : 0.038915157318115234 nb_pixel_total : 42627 time to create 1 rle with old method : 0.04628610610961914 time for calcul the mask position with numpy : 0.039299726486206055 nb_pixel_total : 36813 time to create 1 rle with old method : 0.03940296173095703 time for calcul the mask position with numpy : 0.0395503044128418 nb_pixel_total : 77519 time to create 1 rle with old method : 0.0843973159790039 time for calcul the mask position with numpy : 0.039678096771240234 nb_pixel_total : 35419 time to create 1 rle with old method : 0.03777718544006348 time for calcul the mask position with numpy : 0.038507938385009766 nb_pixel_total : 11842 time to create 1 rle with old method : 0.012937307357788086 time for calcul the mask position with numpy : 0.03855419158935547 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0016067028045654297 time for calcul the mask position with numpy : 0.03908133506774902 nb_pixel_total : 128482 time to create 1 rle with old method : 0.13547539710998535 time for calcul the mask position with numpy : 0.03717446327209473 nb_pixel_total : 937 time to create 1 rle with old method : 0.00113677978515625 time for calcul the mask position with numpy : 0.03924679756164551 nb_pixel_total : 47219 time to create 1 rle with old method : 0.050380706787109375 time for calcul the mask position with numpy : 0.03830981254577637 nb_pixel_total : 36492 time to create 1 rle with old method : 0.038649797439575195 time for calcul the mask position with numpy : 0.03906750679016113 nb_pixel_total : 1603 time to create 1 rle with old method : 0.001974821090698242 time for calcul the mask position with numpy : 0.03786182403564453 nb_pixel_total : 8675 time to create 1 rle with old method : 0.009472846984863281 time for calcul the mask position with numpy : 0.03752899169921875 nb_pixel_total : 6492 time to create 1 rle with old method : 0.006846904754638672 time for calcul the mask position with numpy : 0.038956642150878906 nb_pixel_total : 2897 time to create 1 rle with old method : 0.0032994747161865234 time for calcul the mask position with numpy : 0.03909730911254883 nb_pixel_total : 76059 time to create 1 rle with old method : 0.08182358741760254 time for calcul the mask position with numpy : 0.037817955017089844 nb_pixel_total : 55593 time to create 1 rle with old method : 0.059804677963256836 time for calcul the mask position with numpy : 0.03896474838256836 nb_pixel_total : 47969 time to create 1 rle with old method : 0.050681114196777344 time for calcul the mask position with numpy : 0.03826737403869629 nb_pixel_total : 133343 time to create 1 rle with old method : 0.1389484405517578 time for calcul the mask position with numpy : 0.03820633888244629 nb_pixel_total : 17140 time to create 1 rle with old method : 0.017459392547607422 time for calcul the mask position with numpy : 0.03789186477661133 nb_pixel_total : 7535 time to create 1 rle with old method : 0.00827169418334961 time for calcul the mask position with numpy : 0.03789114952087402 nb_pixel_total : 51471 time to create 1 rle with old method : 0.05556368827819824 time for calcul the mask position with numpy : 0.03758573532104492 nb_pixel_total : 44550 time to create 1 rle with old method : 0.04862570762634277 time for calcul the mask position with numpy : 0.038587331771850586 nb_pixel_total : 76371 time to create 1 rle with old method : 0.07977938652038574 time for calcul the mask position with numpy : 0.038336992263793945 nb_pixel_total : 60444 time to create 1 rle with old method : 0.06316781044006348 time for calcul the mask position with numpy : 0.03708338737487793 nb_pixel_total : 36462 time to create 1 rle with old method : 0.03725385665893555 time for calcul the mask position with numpy : 0.03999638557434082 nb_pixel_total : 32625 time to create 1 rle with old method : 0.03514385223388672 time for calcul the mask position with numpy : 0.03891897201538086 nb_pixel_total : 48694 time to create 1 rle with old method : 0.052164316177368164 time for calcul the mask position with numpy : 0.03968930244445801 nb_pixel_total : 105733 time to create 1 rle with old method : 0.11516213417053223 time for calcul the mask position with numpy : 0.038716793060302734 nb_pixel_total : 41044 time to create 1 rle with old method : 0.04301023483276367 time for calcul the mask position with numpy : 0.03780388832092285 nb_pixel_total : 28829 time to create 1 rle with old method : 0.029991865158081055 time for calcul the mask position with numpy : 0.039472103118896484 nb_pixel_total : 3638 time to create 1 rle with old method : 0.0041310787200927734 time for calcul the mask position with numpy : 0.039916276931762695 nb_pixel_total : 45479 time to create 1 rle with old method : 0.05259561538696289 time for calcul the mask position with numpy : 0.03882026672363281 nb_pixel_total : 53288 time to create 1 rle with old method : 0.058872222900390625 time for calcul the mask position with numpy : 0.040252685546875 nb_pixel_total : 136606 time to create 1 rle with old method : 0.14490222930908203 time for calcul the mask position with numpy : 0.0391840934753418 nb_pixel_total : 33807 time to create 1 rle with old method : 0.03628802299499512 time for calcul the mask position with numpy : 0.038360595703125 nb_pixel_total : 73523 time to create 1 rle with old method : 0.08012080192565918 time for calcul the mask position with numpy : 0.03845334053039551 nb_pixel_total : 10951 time to create 1 rle with old method : 0.013095617294311523 time for calcul the mask position with numpy : 0.039447784423828125 nb_pixel_total : 154442 time to create 1 rle with new method : 0.7723028659820557 time for calcul the mask position with numpy : 0.03839516639709473 nb_pixel_total : 14547 time to create 1 rle with old method : 0.01615285873413086 time for calcul the mask position with numpy : 0.03787350654602051 nb_pixel_total : 1367 time to create 1 rle with old method : 0.0017130374908447266 time for calcul the mask position with numpy : 0.03882908821105957 nb_pixel_total : 44868 time to create 1 rle with old method : 0.047509193420410156 time for calcul the mask position with numpy : 0.03862881660461426 nb_pixel_total : 24620 time to create 1 rle with old method : 0.02622246742248535 time for calcul the mask position with numpy : 0.03889656066894531 nb_pixel_total : 128161 time to create 1 rle with old method : 0.13465571403503418 time for calcul the mask position with numpy : 0.039893150329589844 nb_pixel_total : 10394 time to create 1 rle with old method : 0.011654138565063477 time for calcul the mask position with numpy : 0.03828716278076172 nb_pixel_total : 66 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.03912472724914551 nb_pixel_total : 41853 time to create 1 rle with old method : 0.04607057571411133 time for calcul the mask position with numpy : 0.03910493850708008 nb_pixel_total : 20086 time to create 1 rle with old method : 0.02175426483154297 time for calcul the mask position with numpy : 0.03853487968444824 nb_pixel_total : 33567 time to create 1 rle with old method : 0.036468505859375 time for calcul the mask position with numpy : 0.04423666000366211 nb_pixel_total : 704348 time to create 1 rle with new method : 0.9263916015625 time for calcul the mask position with numpy : 0.043294429779052734 nb_pixel_total : 59948 time to create 1 rle with old method : 0.0695950984954834 time for calcul the mask position with numpy : 0.04116368293762207 nb_pixel_total : 7049 time to create 1 rle with old method : 0.008298635482788086 time for calcul the mask position with numpy : 0.04200267791748047 nb_pixel_total : 177503 time to create 1 rle with new method : 0.8947582244873047 time for calcul the mask position with numpy : 0.03944516181945801 nb_pixel_total : 23391 time to create 1 rle with old method : 0.02542400360107422 time for calcul the mask position with numpy : 0.03955531120300293 nb_pixel_total : 58984 time to create 1 rle with old method : 0.06296634674072266 time for calcul the mask position with numpy : 0.03977608680725098 nb_pixel_total : 22637 time to create 1 rle with old method : 0.030898332595825195 time for calcul the mask position with numpy : 0.03787565231323242 nb_pixel_total : 14753 time to create 1 rle with old method : 0.0161135196685791 time for calcul the mask position with numpy : 0.03812742233276367 nb_pixel_total : 36489 time to create 1 rle with old method : 0.038338422775268555 time for calcul the mask position with numpy : 0.03863859176635742 nb_pixel_total : 2147 time to create 1 rle with old method : 0.002479076385498047 time for calcul the mask position with numpy : 0.037676334381103516 nb_pixel_total : 60142 time to create 1 rle with old method : 0.06336593627929688 time for calcul the mask position with numpy : 0.03800082206726074 nb_pixel_total : 19618 time to create 1 rle with old method : 0.02452850341796875 time for calcul the mask position with numpy : 0.03994035720825195 nb_pixel_total : 28505 time to create 1 rle with old method : 0.030212879180908203 time for calcul the mask position with numpy : 0.03868699073791504 nb_pixel_total : 113825 time to create 1 rle with old method : 0.12281918525695801 time for calcul the mask position with numpy : 0.03906702995300293 nb_pixel_total : 38934 time to create 1 rle with old method : 0.04288363456726074 time for calcul the mask position with numpy : 0.039049386978149414 nb_pixel_total : 4952 time to create 1 rle with old method : 0.005500316619873047 time for calcul the mask position with numpy : 0.03806591033935547 nb_pixel_total : 68315 time to create 1 rle with old method : 0.07388424873352051 time for calcul the mask position with numpy : 0.03823041915893555 nb_pixel_total : 46747 time to create 1 rle with old method : 0.05054926872253418 time for calcul the mask position with numpy : 0.03925323486328125 nb_pixel_total : 108326 time to create 1 rle with old method : 0.11854982376098633 time for calcul the mask position with numpy : 0.038347482681274414 nb_pixel_total : 42458 time to create 1 rle with old method : 0.0458979606628418 time for calcul the mask position with numpy : 0.039148807525634766 nb_pixel_total : 252563 time to create 1 rle with new method : 0.7151889801025391 time for calcul the mask position with numpy : 0.037435293197631836 nb_pixel_total : 5136 time to create 1 rle with old method : 0.005964040756225586 time for calcul the mask position with numpy : 0.03841257095336914 nb_pixel_total : 432 time to create 1 rle with old method : 0.0007183551788330078 time for calcul the mask position with numpy : 0.03921818733215332 nb_pixel_total : 7470 time to create 1 rle with old method : 0.008339405059814453 time for calcul the mask position with numpy : 0.04065823554992676 nb_pixel_total : 582896 time to create 1 rle with new method : 0.7109124660491943 time for calcul the mask position with numpy : 0.03731966018676758 nb_pixel_total : 94954 time to create 1 rle with old method : 0.0990915298461914 time for calcul the mask position with numpy : 0.039148569107055664 nb_pixel_total : 2800 time to create 1 rle with old method : 0.0030946731567382812 time for calcul the mask position with numpy : 0.03917050361633301 nb_pixel_total : 362136 time to create 1 rle with new method : 0.8304967880249023 time for calcul the mask position with numpy : 0.038315534591674805 nb_pixel_total : 23635 time to create 1 rle with old method : 0.024729251861572266 time for calcul the mask position with numpy : 0.03824925422668457 nb_pixel_total : 9937 time to create 1 rle with old method : 0.010432958602905273 time for calcul the mask position with numpy : 0.038587093353271484 nb_pixel_total : 141937 time to create 1 rle with old method : 0.15112614631652832 time for calcul the mask position with numpy : 0.038102149963378906 nb_pixel_total : 40968 time to create 1 rle with old method : 0.04438471794128418 time for calcul the mask position with numpy : 0.039348602294921875 nb_pixel_total : 198438 time to create 1 rle with new method : 0.7101900577545166 time for calcul the mask position with numpy : 0.03830838203430176 nb_pixel_total : 36726 time to create 1 rle with old method : 0.038763999938964844 time for calcul the mask position with numpy : 0.038413047790527344 nb_pixel_total : 81629 time to create 1 rle with old method : 0.08599281311035156 time for calcul the mask position with numpy : 0.03763127326965332 nb_pixel_total : 869 time to create 1 rle with old method : 0.00112152099609375 time for calcul the mask position with numpy : 0.036960601806640625 nb_pixel_total : 9291 time to create 1 rle with old method : 0.010413408279418945 time for calcul the mask position with numpy : 0.03904247283935547 nb_pixel_total : 190923 time to create 1 rle with new method : 0.6935486793518066 time for calcul the mask position with numpy : 0.03865170478820801 nb_pixel_total : 34598 time to create 1 rle with old method : 0.03628826141357422 time for calcul the mask position with numpy : 0.0384364128112793 nb_pixel_total : 1116 time to create 1 rle with old method : 0.0014624595642089844 time for calcul the mask position with numpy : 0.03774690628051758 nb_pixel_total : 403 time to create 1 rle with old method : 0.0009500980377197266 time for calcul the mask position with numpy : 0.039078712463378906 nb_pixel_total : 40946 time to create 1 rle with old method : 0.04331660270690918 time for calcul the mask position with numpy : 0.03819441795349121 nb_pixel_total : 140603 time to create 1 rle with old method : 0.14734458923339844 time for calcul the mask position with numpy : 0.03827834129333496 nb_pixel_total : 4319 time to create 1 rle with old method : 0.005211591720581055 time for calcul the mask position with numpy : 0.03815793991088867 nb_pixel_total : 56042 time to create 1 rle with old method : 0.06041669845581055 time for calcul the mask position with numpy : 0.03919410705566406 nb_pixel_total : 25316 time to create 1 rle with old method : 0.027988910675048828 create new chi : 17.703117847442627 time to delete rle : 0.03791332244873047 batch 1 Loaded 99 chid ids of type : 4855 Number RLEs to save : 59620 TO DO : save crop sub photo not yet done ! save time : 3.9601247310638428 nb_obj : 84 nb_hashtags : 10 time to prepare the origin masks : 39.13334083557129 time for calcul the mask position with numpy : 0.23944497108459473 nb_pixel_total : 3116253 time to create 1 rle with new method : 0.574167013168335 time for calcul the mask position with numpy : 0.04121661186218262 nb_pixel_total : 6436 time to create 1 rle with old method : 0.007143974304199219 time for calcul the mask position with numpy : 0.040880680084228516 nb_pixel_total : 20713 time to create 1 rle with old method : 0.024367094039916992 time for calcul the mask position with numpy : 0.051642656326293945 nb_pixel_total : 327591 time to create 1 rle with new method : 0.5707733631134033 time for calcul the mask position with numpy : 0.04134726524353027 nb_pixel_total : 13 time to create 1 rle with old method : 0.00026106834411621094 time for calcul the mask position with numpy : 0.041767120361328125 nb_pixel_total : 15037 time to create 1 rle with old method : 0.016778945922851562 time for calcul the mask position with numpy : 0.04139900207519531 nb_pixel_total : 1358 time to create 1 rle with old method : 0.0017194747924804688 time for calcul the mask position with numpy : 0.03945517539978027 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008883476257324219 time for calcul the mask position with numpy : 0.04919719696044922 nb_pixel_total : 463335 time to create 1 rle with new method : 0.44098472595214844 time for calcul the mask position with numpy : 0.04282069206237793 nb_pixel_total : 5513 time to create 1 rle with old method : 0.006339550018310547 time for calcul the mask position with numpy : 0.040412187576293945 nb_pixel_total : 24495 time to create 1 rle with old method : 0.027515411376953125 time for calcul the mask position with numpy : 0.040819644927978516 nb_pixel_total : 14217 time to create 1 rle with old method : 0.016419172286987305 time for calcul the mask position with numpy : 0.041294097900390625 nb_pixel_total : 33896 time to create 1 rle with old method : 0.038778066635131836 time for calcul the mask position with numpy : 0.04117226600646973 nb_pixel_total : 118896 time to create 1 rle with old method : 0.12732934951782227 time for calcul the mask position with numpy : 0.04529881477355957 nb_pixel_total : 389930 time to create 1 rle with new method : 0.4510037899017334 time for calcul the mask position with numpy : 0.040325164794921875 nb_pixel_total : 9143 time to create 1 rle with old method : 0.010078668594360352 time for calcul the mask position with numpy : 0.039682626724243164 nb_pixel_total : 3074 time to create 1 rle with old method : 0.003462076187133789 time for calcul the mask position with numpy : 0.041951656341552734 nb_pixel_total : 212267 time to create 1 rle with new method : 0.5488333702087402 time for calcul the mask position with numpy : 0.03991961479187012 nb_pixel_total : 9716 time to create 1 rle with old method : 0.010945796966552734 time for calcul the mask position with numpy : 0.04113316535949707 nb_pixel_total : 115047 time to create 1 rle with old method : 0.12944555282592773 time for calcul the mask position with numpy : 0.04144906997680664 nb_pixel_total : 45617 time to create 1 rle with old method : 0.05101895332336426 time for calcul the mask position with numpy : 0.04001450538635254 nb_pixel_total : 65985 time to create 1 rle with old method : 0.07103848457336426 time for calcul the mask position with numpy : 0.041661739349365234 nb_pixel_total : 19406 time to create 1 rle with old method : 0.022160053253173828 time for calcul the mask position with numpy : 0.04221343994140625 nb_pixel_total : 28580 time to create 1 rle with old method : 0.03157854080200195 time for calcul the mask position with numpy : 0.040369272232055664 nb_pixel_total : 46535 time to create 1 rle with old method : 0.05106163024902344 time for calcul the mask position with numpy : 0.0419769287109375 nb_pixel_total : 70267 time to create 1 rle with old method : 0.07529640197753906 time for calcul the mask position with numpy : 0.04155230522155762 nb_pixel_total : 17079 time to create 1 rle with old method : 0.0190432071685791 time for calcul the mask position with numpy : 0.04190468788146973 nb_pixel_total : 53087 time to create 1 rle with old method : 0.06016659736633301 time for calcul the mask position with numpy : 0.04235243797302246 nb_pixel_total : 2799 time to create 1 rle with old method : 0.003735065460205078 time for calcul the mask position with numpy : 0.04519796371459961 nb_pixel_total : 5182 time to create 1 rle with old method : 0.007405757904052734 time for calcul the mask position with numpy : 0.04468536376953125 nb_pixel_total : 178186 time to create 1 rle with new method : 0.5621323585510254 time for calcul the mask position with numpy : 0.04224419593811035 nb_pixel_total : 110702 time to create 1 rle with old method : 0.1206655502319336 time for calcul the mask position with numpy : 0.03981804847717285 nb_pixel_total : 1 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.04068326950073242 nb_pixel_total : 19388 time to create 1 rle with old method : 0.021186113357543945 time for calcul the mask position with numpy : 0.039942264556884766 nb_pixel_total : 6250 time to create 1 rle with old method : 0.007070302963256836 time for calcul the mask position with numpy : 0.03917050361633301 nb_pixel_total : 31360 time to create 1 rle with old method : 0.03391551971435547 time for calcul the mask position with numpy : 0.04066061973571777 nb_pixel_total : 135412 time to create 1 rle with old method : 0.1401829719543457 time for calcul the mask position with numpy : 0.0411376953125 nb_pixel_total : 6129 time to create 1 rle with old method : 0.006659746170043945 time for calcul the mask position with numpy : 0.04231429100036621 nb_pixel_total : 64351 time to create 1 rle with old method : 0.06924247741699219 time for calcul the mask position with numpy : 0.04069781303405762 nb_pixel_total : 123341 time to create 1 rle with old method : 0.13500285148620605 time for calcul the mask position with numpy : 0.040608882904052734 nb_pixel_total : 15955 time to create 1 rle with old method : 0.01773810386657715 time for calcul the mask position with numpy : 0.041800498962402344 nb_pixel_total : 210033 time to create 1 rle with new method : 0.4960312843322754 time for calcul the mask position with numpy : 0.04117083549499512 nb_pixel_total : 114884 time to create 1 rle with old method : 0.12211251258850098 time for calcul the mask position with numpy : 0.03904581069946289 nb_pixel_total : 10070 time to create 1 rle with old method : 0.011470317840576172 time for calcul the mask position with numpy : 0.03920602798461914 nb_pixel_total : 29873 time to create 1 rle with old method : 0.031180620193481445 time for calcul the mask position with numpy : 0.04209160804748535 nb_pixel_total : 27971 time to create 1 rle with old method : 0.030307292938232422 time for calcul the mask position with numpy : 0.041652679443359375 nb_pixel_total : 16575 time to create 1 rle with old method : 0.018275976181030273 time for calcul the mask position with numpy : 0.04254484176635742 nb_pixel_total : 505240 time to create 1 rle with new method : 0.5081672668457031 time for calcul the mask position with numpy : 0.04076552391052246 nb_pixel_total : 22574 time to create 1 rle with old method : 0.025269269943237305 time for calcul the mask position with numpy : 0.039139509201049805 nb_pixel_total : 83514 time to create 1 rle with old method : 0.10723185539245605 time for calcul the mask position with numpy : 0.03951859474182129 nb_pixel_total : 51859 time to create 1 rle with old method : 0.056281328201293945 time for calcul the mask position with numpy : 0.038541555404663086 nb_pixel_total : 33473 time to create 1 rle with old method : 0.035302162170410156 time for calcul the mask position with numpy : 0.04064321517944336 nb_pixel_total : 15677 time to create 1 rle with old method : 0.017454147338867188 time for calcul the mask position with numpy : 0.039835453033447266 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.04023265838623047 nb_pixel_total : 29976 time to create 1 rle with old method : 0.03319048881530762 time for calcul the mask position with numpy : 0.04277300834655762 nb_pixel_total : 273156 time to create 1 rle with new method : 1.2318012714385986 time for calcul the mask position with numpy : 0.038655996322631836 nb_pixel_total : 31993 time to create 1 rle with old method : 0.03424382209777832 time for calcul the mask position with numpy : 0.0388493537902832 nb_pixel_total : 20665 time to create 1 rle with old method : 0.021711349487304688 time for calcul the mask position with numpy : 0.039674997329711914 nb_pixel_total : 58797 time to create 1 rle with old method : 0.062309980392456055 time for calcul the mask position with numpy : 0.03993988037109375 nb_pixel_total : 260194 time to create 1 rle with new method : 0.49595117568969727 time for calcul the mask position with numpy : 0.04409527778625488 nb_pixel_total : 93216 time to create 1 rle with old method : 0.10435271263122559 time for calcul the mask position with numpy : 0.040871381759643555 nb_pixel_total : 15537 time to create 1 rle with old method : 0.01757335662841797 time for calcul the mask position with numpy : 0.04070591926574707 nb_pixel_total : 57253 time to create 1 rle with old method : 0.06069755554199219 time for calcul the mask position with numpy : 0.0386347770690918 nb_pixel_total : 47208 time to create 1 rle with old method : 0.04987359046936035 time for calcul the mask position with numpy : 0.04108071327209473 nb_pixel_total : 370802 time to create 1 rle with new method : 0.5706255435943604 time for calcul the mask position with numpy : 0.04137158393859863 nb_pixel_total : 7446 time to create 1 rle with old method : 0.008226156234741211 time for calcul the mask position with numpy : 0.040607452392578125 nb_pixel_total : 19707 time to create 1 rle with old method : 0.021486759185791016 time for calcul the mask position with numpy : 0.039235591888427734 nb_pixel_total : 13055 time to create 1 rle with old method : 0.014357805252075195 time for calcul the mask position with numpy : 0.0413970947265625 nb_pixel_total : 134374 time to create 1 rle with old method : 0.1476612091064453 time for calcul the mask position with numpy : 0.038622140884399414 nb_pixel_total : 61030 time to create 1 rle with old method : 0.06453251838684082 time for calcul the mask position with numpy : 0.03918886184692383 nb_pixel_total : 20671 time to create 1 rle with old method : 0.0222320556640625 time for calcul the mask position with numpy : 0.03858304023742676 nb_pixel_total : 45247 time to create 1 rle with old method : 0.04754972457885742 time for calcul the mask position with numpy : 0.03858137130737305 nb_pixel_total : 37294 time to create 1 rle with old method : 0.03903818130493164 time for calcul the mask position with numpy : 0.03903675079345703 nb_pixel_total : 122769 time to create 1 rle with old method : 0.12800073623657227 time for calcul the mask position with numpy : 0.04166221618652344 nb_pixel_total : 453782 time to create 1 rle with new method : 0.49767231941223145 time for calcul the mask position with numpy : 0.040212154388427734 nb_pixel_total : 16768 time to create 1 rle with old method : 0.01888751983642578 time for calcul the mask position with numpy : 0.042215824127197266 nb_pixel_total : 223749 time to create 1 rle with new method : 0.7345187664031982 time for calcul the mask position with numpy : 0.040427446365356445 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0016400814056396484 time for calcul the mask position with numpy : 0.039782047271728516 nb_pixel_total : 601 time to create 1 rle with old method : 0.0009696483612060547 time for calcul the mask position with numpy : 0.04089784622192383 nb_pixel_total : 43770 time to create 1 rle with old method : 0.04708743095397949 time for calcul the mask position with numpy : 0.041053056716918945 nb_pixel_total : 68377 time to create 1 rle with old method : 0.07468223571777344 time for calcul the mask position with numpy : 0.041376590728759766 nb_pixel_total : 50944 time to create 1 rle with old method : 0.056990861892700195 time for calcul the mask position with numpy : 0.040398359298706055 nb_pixel_total : 13433 time to create 1 rle with old method : 0.014455795288085938 time for calcul the mask position with numpy : 0.03983139991760254 nb_pixel_total : 72916 time to create 1 rle with old method : 0.07797408103942871 time for calcul the mask position with numpy : 0.04001283645629883 nb_pixel_total : 13127 time to create 1 rle with old method : 0.014512777328491211 create new chi : 14.847352981567383 time to delete rle : 0.005521297454833984 batch 1 Loaded 85 chid ids of type : 4855 Number RLEs to save : 49988 TO DO : save crop sub photo not yet done ! save time : 2.658055305480957 nb_obj : 100 nb_hashtags : 8 time to prepare the origin masks : 53.66728138923645 time for calcul the mask position with numpy : 0.2741811275482178 nb_pixel_total : 2981070 time to create 1 rle with new method : 1.1763584613800049 time for calcul the mask position with numpy : 0.038825273513793945 nb_pixel_total : 3091 time to create 1 rle with old method : 0.0033593177795410156 time for calcul the mask position with numpy : 0.03890681266784668 nb_pixel_total : 10291 time to create 1 rle with old method : 0.01104879379272461 time for calcul the mask position with numpy : 0.03929471969604492 nb_pixel_total : 231328 time to create 1 rle with new method : 0.9837818145751953 time for calcul the mask position with numpy : 0.03878593444824219 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0014731884002685547 time for calcul the mask position with numpy : 0.03978729248046875 nb_pixel_total : 165001 time to create 1 rle with new method : 1.0839736461639404 time for calcul the mask position with numpy : 0.03983497619628906 nb_pixel_total : 129775 time to create 1 rle with old method : 0.13891029357910156 time for calcul the mask position with numpy : 0.03824973106384277 nb_pixel_total : 6960 time to create 1 rle with old method : 0.007474184036254883 time for calcul the mask position with numpy : 0.04579901695251465 nb_pixel_total : 254940 time to create 1 rle with new method : 1.3200793266296387 time for calcul the mask position with numpy : 0.04072451591491699 nb_pixel_total : 24449 time to create 1 rle with old method : 0.026972055435180664 time for calcul the mask position with numpy : 0.03918313980102539 nb_pixel_total : 4540 time to create 1 rle with old method : 0.005045175552368164 time for calcul the mask position with numpy : 0.03829193115234375 nb_pixel_total : 3357 time to create 1 rle with old method : 0.0038614273071289062 time for calcul the mask position with numpy : 0.037877798080444336 nb_pixel_total : 16796 time to create 1 rle with old method : 0.017731904983520508 time for calcul the mask position with numpy : 0.0385739803314209 nb_pixel_total : 3458 time to create 1 rle with old method : 0.004010200500488281 time for calcul the mask position with numpy : 0.04029393196105957 nb_pixel_total : 182111 time to create 1 rle with new method : 1.0327374935150146 time for calcul the mask position with numpy : 0.04084062576293945 nb_pixel_total : 74559 time to create 1 rle with old method : 0.07772135734558105 time for calcul the mask position with numpy : 0.03811788558959961 nb_pixel_total : 513 time to create 1 rle with old method : 0.00070953369140625 time for calcul the mask position with numpy : 0.04310750961303711 nb_pixel_total : 320808 time to create 1 rle with new method : 0.7662639617919922 time for calcul the mask position with numpy : 0.03785204887390137 nb_pixel_total : 2743 time to create 1 rle with old method : 0.0030431747436523438 time for calcul the mask position with numpy : 0.03911757469177246 nb_pixel_total : 109804 time to create 1 rle with old method : 0.11671018600463867 time for calcul the mask position with numpy : 0.04044532775878906 nb_pixel_total : 152872 time to create 1 rle with new method : 1.1719067096710205 time for calcul the mask position with numpy : 0.039220571517944336 nb_pixel_total : 21 time to create 1 rle with old method : 8.225440979003906e-05 time for calcul the mask position with numpy : 0.0380556583404541 nb_pixel_total : 2942 time to create 1 rle with old method : 0.0032875537872314453 time for calcul the mask position with numpy : 0.03838610649108887 nb_pixel_total : 73372 time to create 1 rle with old method : 0.09818100929260254 time for calcul the mask position with numpy : 0.043313026428222656 nb_pixel_total : 3018 time to create 1 rle with old method : 0.0037691593170166016 time for calcul the mask position with numpy : 0.039222002029418945 nb_pixel_total : 22450 time to create 1 rle with old method : 0.02411675453186035 time for calcul the mask position with numpy : 0.03813362121582031 nb_pixel_total : 15364 time to create 1 rle with old method : 0.016299009323120117 time for calcul the mask position with numpy : 0.04311513900756836 nb_pixel_total : 21216 time to create 1 rle with old method : 0.023154258728027344 time for calcul the mask position with numpy : 0.0395359992980957 nb_pixel_total : 15265 time to create 1 rle with old method : 0.016622304916381836 time for calcul the mask position with numpy : 0.03958702087402344 nb_pixel_total : 19217 time to create 1 rle with old method : 0.020863771438598633 time for calcul the mask position with numpy : 0.03940391540527344 nb_pixel_total : 91021 time to create 1 rle with old method : 0.09992599487304688 time for calcul the mask position with numpy : 0.04047799110412598 nb_pixel_total : 74199 time to create 1 rle with old method : 0.0782632827758789 time for calcul the mask position with numpy : 0.038373708724975586 nb_pixel_total : 18166 time to create 1 rle with old method : 0.018978118896484375 time for calcul the mask position with numpy : 0.039137840270996094 nb_pixel_total : 24437 time to create 1 rle with old method : 0.025533199310302734 time for calcul the mask position with numpy : 0.03881216049194336 nb_pixel_total : 37178 time to create 1 rle with old method : 0.0402834415435791 time for calcul the mask position with numpy : 0.038919925689697266 nb_pixel_total : 80639 time to create 1 rle with old method : 0.08435869216918945 time for calcul the mask position with numpy : 0.03974509239196777 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0017597675323486328 time for calcul the mask position with numpy : 0.040544748306274414 nb_pixel_total : 3218 time to create 1 rle with old method : 0.004539966583251953 time for calcul the mask position with numpy : 0.053452253341674805 nb_pixel_total : 267988 time to create 1 rle with new method : 1.2439844608306885 time for calcul the mask position with numpy : 0.041060447692871094 nb_pixel_total : 14687 time to create 1 rle with old method : 0.01674675941467285 time for calcul the mask position with numpy : 0.04122495651245117 nb_pixel_total : 104 time to create 1 rle with old method : 0.0002067089080810547 time for calcul the mask position with numpy : 0.040120840072631836 nb_pixel_total : 34154 time to create 1 rle with old method : 0.03610038757324219 time for calcul the mask position with numpy : 0.0387570858001709 nb_pixel_total : 22646 time to create 1 rle with old method : 0.024908065795898438 time for calcul the mask position with numpy : 0.04073047637939453 nb_pixel_total : 7984 time to create 1 rle with old method : 0.00936579704284668 time for calcul the mask position with numpy : 0.0410313606262207 nb_pixel_total : 43510 time to create 1 rle with old method : 0.04892325401306152 time for calcul the mask position with numpy : 0.04156851768493652 nb_pixel_total : 124127 time to create 1 rle with old method : 0.14566540718078613 time for calcul the mask position with numpy : 0.04490327835083008 nb_pixel_total : 2604 time to create 1 rle with old method : 0.0031731128692626953 time for calcul the mask position with numpy : 0.040880680084228516 nb_pixel_total : 17993 time to create 1 rle with old method : 0.020694255828857422 time for calcul the mask position with numpy : 0.04270005226135254 nb_pixel_total : 291009 time to create 1 rle with new method : 0.9577198028564453 time for calcul the mask position with numpy : 0.04194021224975586 nb_pixel_total : 41272 time to create 1 rle with old method : 0.046241044998168945 time for calcul the mask position with numpy : 0.04178881645202637 nb_pixel_total : 77621 time to create 1 rle with old method : 0.08710408210754395 time for calcul the mask position with numpy : 0.04342150688171387 nb_pixel_total : 295671 time to create 1 rle with new method : 1.1714162826538086 time for calcul the mask position with numpy : 0.04163312911987305 nb_pixel_total : 16312 time to create 1 rle with old method : 0.018355369567871094 time for calcul the mask position with numpy : 0.04108238220214844 nb_pixel_total : 1 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.04319000244140625 nb_pixel_total : 231193 time to create 1 rle with new method : 2.0900566577911377 time for calcul the mask position with numpy : 0.03862619400024414 nb_pixel_total : 23719 time to create 1 rle with old method : 0.025529146194458008 time for calcul the mask position with numpy : 0.038346290588378906 nb_pixel_total : 2472 time to create 1 rle with old method : 0.002933502197265625 time for calcul the mask position with numpy : 0.04056191444396973 nb_pixel_total : 18235 time to create 1 rle with old method : 0.022812843322753906 time for calcul the mask position with numpy : 0.04142951965332031 nb_pixel_total : 6925 time to create 1 rle with old method : 0.011290311813354492 time for calcul the mask position with numpy : 0.04607701301574707 nb_pixel_total : 118099 time to create 1 rle with old method : 0.1308584213256836 time for calcul the mask position with numpy : 0.03965425491333008 nb_pixel_total : 10801 time to create 1 rle with old method : 0.01215052604675293 time for calcul the mask position with numpy : 0.03920435905456543 nb_pixel_total : 47864 time to create 1 rle with old method : 0.05460500717163086 time for calcul the mask position with numpy : 0.040017127990722656 nb_pixel_total : 18052 time to create 1 rle with old method : 0.019934415817260742 time for calcul the mask position with numpy : 0.039957284927368164 nb_pixel_total : 3008 time to create 1 rle with old method : 0.0036058425903320312 time for calcul the mask position with numpy : 0.039313316345214844 nb_pixel_total : 9145 time to create 1 rle with old method : 0.009930610656738281 time for calcul the mask position with numpy : 0.039639949798583984 nb_pixel_total : 29461 time to create 1 rle with old method : 0.03210616111755371 time for calcul the mask position with numpy : 0.03970956802368164 nb_pixel_total : 40901 time to create 1 rle with old method : 0.0448000431060791 time for calcul the mask position with numpy : 0.039345502853393555 nb_pixel_total : 32881 time to create 1 rle with old method : 0.03645753860473633 time for calcul the mask position with numpy : 0.039885520935058594 nb_pixel_total : 50671 time to create 1 rle with old method : 0.05560874938964844 time for calcul the mask position with numpy : 0.040128469467163086 nb_pixel_total : 3797 time to create 1 rle with old method : 0.004351615905761719 time for calcul the mask position with numpy : 0.039566993713378906 nb_pixel_total : 102956 time to create 1 rle with old method : 0.1114952564239502 time for calcul the mask position with numpy : 0.0399472713470459 nb_pixel_total : 40667 time to create 1 rle with old method : 0.045047760009765625 time for calcul the mask position with numpy : 0.04480409622192383 nb_pixel_total : 19172 time to create 1 rle with old method : 0.021732807159423828 time for calcul the mask position with numpy : 0.0479891300201416 nb_pixel_total : 817303 time to create 1 rle with new method : 0.8739008903503418 time for calcul the mask position with numpy : 0.04497218132019043 nb_pixel_total : 47065 time to create 1 rle with old method : 0.054376840591430664 time for calcul the mask position with numpy : 0.0400547981262207 nb_pixel_total : 81322 time to create 1 rle with old method : 0.08934879302978516 time for calcul the mask position with numpy : 0.040233612060546875 nb_pixel_total : 816 time to create 1 rle with old method : 0.001239776611328125 time for calcul the mask position with numpy : 0.04001426696777344 nb_pixel_total : 30421 time to create 1 rle with old method : 0.0335848331451416 time for calcul the mask position with numpy : 0.03976154327392578 nb_pixel_total : 38373 time to create 1 rle with old method : 0.047432661056518555 time for calcul the mask position with numpy : 0.04291391372680664 nb_pixel_total : 55960 time to create 1 rle with old method : 0.06152844429016113 time for calcul the mask position with numpy : 0.03899502754211426 nb_pixel_total : 69340 time to create 1 rle with old method : 0.07597851753234863 time for calcul the mask position with numpy : 0.04072070121765137 nb_pixel_total : 77444 time to create 1 rle with old method : 0.08568644523620605 time for calcul the mask position with numpy : 0.043992042541503906 nb_pixel_total : 494240 time to create 1 rle with new method : 1.4192636013031006 time for calcul the mask position with numpy : 0.04621767997741699 nb_pixel_total : 65676 time to create 1 rle with old method : 0.07398819923400879 time for calcul the mask position with numpy : 0.03992152214050293 nb_pixel_total : 12466 time to create 1 rle with old method : 0.01417231559753418 time for calcul the mask position with numpy : 0.041029930114746094 nb_pixel_total : 158422 time to create 1 rle with new method : 0.8217151165008545 time for calcul the mask position with numpy : 0.03977394104003906 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016734600067138672 time for calcul the mask position with numpy : 0.04111671447753906 nb_pixel_total : 85718 time to create 1 rle with old method : 0.10052704811096191 time for calcul the mask position with numpy : 0.041405439376831055 nb_pixel_total : 112497 time to create 1 rle with old method : 0.12665629386901855 time for calcul the mask position with numpy : 0.04073905944824219 nb_pixel_total : 3062 time to create 1 rle with old method : 0.003760099411010742 time for calcul the mask position with numpy : 0.04117774963378906 nb_pixel_total : 27052 time to create 1 rle with old method : 0.030585050582885742 time for calcul the mask position with numpy : 0.041391849517822266 nb_pixel_total : 131321 time to create 1 rle with old method : 0.15152597427368164 time for calcul the mask position with numpy : 0.040506839752197266 nb_pixel_total : 25817 time to create 1 rle with old method : 0.029211997985839844 time for calcul the mask position with numpy : 0.04180908203125 nb_pixel_total : 59998 time to create 1 rle with old method : 0.06671333312988281 time for calcul the mask position with numpy : 0.04193592071533203 nb_pixel_total : 28317 time to create 1 rle with old method : 0.03184223175048828 time for calcul the mask position with numpy : 0.04060816764831543 nb_pixel_total : 28786 time to create 1 rle with old method : 0.032386064529418945 time for calcul the mask position with numpy : 0.04122281074523926 nb_pixel_total : 427 time to create 1 rle with old method : 0.0007328987121582031 time for calcul the mask position with numpy : 0.039495229721069336 nb_pixel_total : 13314 time to create 1 rle with old method : 0.014723062515258789 time for calcul the mask position with numpy : 0.04063701629638672 nb_pixel_total : 9400 time to create 1 rle with old method : 0.010779857635498047 time for calcul the mask position with numpy : 0.040239572525024414 nb_pixel_total : 3163 time to create 1 rle with old method : 0.0034923553466796875 time for calcul the mask position with numpy : 0.039309024810791016 nb_pixel_total : 4775 time to create 1 rle with old method : 0.00530695915222168 create new chi : 24.261183500289917 time to delete rle : 0.004984617233276367 batch 1 Loaded 101 chid ids of type : 4855 Number RLEs to save : 52731 TO DO : save crop sub photo not yet done ! save time : 2.749995708465576 nb_obj : 11 nb_hashtags : 6 time to prepare the origin masks : 13.242117881774902 time for calcul the mask position with numpy : 0.08237957954406738 nb_pixel_total : 969918 time to create 1 rle with new method : 1.3028743267059326 time for calcul the mask position with numpy : 0.04717397689819336 nb_pixel_total : 72252 time to create 1 rle with old method : 0.07449746131896973 time for calcul the mask position with numpy : 0.03989863395690918 nb_pixel_total : 36582 time to create 1 rle with old method : 0.037780046463012695 time for calcul the mask position with numpy : 0.030903100967407227 nb_pixel_total : 26510 time to create 1 rle with old method : 0.02757096290588379 time for calcul the mask position with numpy : 0.030321836471557617 nb_pixel_total : 6438 time to create 1 rle with old method : 0.006890773773193359 time for calcul the mask position with numpy : 0.031903982162475586 nb_pixel_total : 23680 time to create 1 rle with old method : 0.024488210678100586 time for calcul the mask position with numpy : 0.03576970100402832 nb_pixel_total : 330239 time to create 1 rle with new method : 0.7206220626831055 time for calcul the mask position with numpy : 0.032360076904296875 nb_pixel_total : 591 time to create 1 rle with old method : 0.0006878376007080078 time for calcul the mask position with numpy : 0.04738593101501465 nb_pixel_total : 1509077 time to create 1 rle with new method : 0.6762182712554932 time for calcul the mask position with numpy : 0.039902687072753906 nb_pixel_total : 533700 time to create 1 rle with new method : 1.0647790431976318 time for calcul the mask position with numpy : 0.03719973564147949 nb_pixel_total : 31518 time to create 1 rle with old method : 0.037421464920043945 time for calcul the mask position with numpy : 0.2852497100830078 nb_pixel_total : 6193895 time to create 1 rle with new method : 0.8043978214263916 create new chi : 5.706786155700684 time to delete rle : 0.002142190933227539 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 17935 TO DO : save crop sub photo not yet done ! save time : 0.918076753616333 map_output_result : {1381664621: (0.4670891573558572, 'Should be the crop_list due to order', 0.47276174862998965), 1381664619: (0.4670891573558572, 'Should be the crop_list due to order', 0.4225210697226641), 1381664605: (0.4670891573558572, 'Should be the crop_list due to order', 0.23190644529127954), 1381664601: (0.4670891573558572, 'Should be the crop_list due to order', 0.7411673657794955)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 4 /1381664621.Didn't retrieve data . /1381664619.Didn't retrieve data . /1381664605.Didn't retrieve data . /1381664601.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012033462524414062 save_final save missing photos in datou_result : time spend for datou_step_exec : 225.3890769481659 time spend to save output : 0.04227638244628906 total time spend for step 5 : 225.43135333061218 step6:crop_condition Fri Sep 5 10:27:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 297 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060897_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.250487327575684 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3015255 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060930_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 56 photos in the portfolio 3015255 time of upload the photos Elapsed time : 18.293894052505493 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3015255 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060955_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.95703911781311 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3015255 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060967_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.3583052158355713 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3015255 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060978_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.073523759841919 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757060986_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.409613847732544 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3015255 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757061007_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.047749757766724 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757061022_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.9666564464569092 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3015255 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757061109_3866059 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 41 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.975974798202515 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 223 /1381680455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381680914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 673 time used for this insertion : 0.07574272155761719 save_final save missing photos in datou_result : time spend for datou_step_exec : 244.60964369773865 time spend to save output : 0.0802454948425293 total time spend for step 6 : 244.68988919258118 step7:ventilate_hashtags_in_portfolio Fri Sep 5 10:32:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26569659 get user id for portfolio 26569659 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569659 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569659 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569659 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569659 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26571890,26571891,26571892,26571893,26571894,26571899,26571901,26571902,26571903,26571904,26571905,26571906,26571908,26571909,26571910,26571911,26571912,26571913,26571914,26571915?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26569659 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 1 /26569659. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.0206298828125 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.728662014007568 time spend to save output : 0.020946979522705078 total time spend for step 7 : 4.749608993530273 step8:final Fri Sep 5 10:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381664621: ('0.4151656312883284',), 1381664619: ('0.4151656312883284',), 1381664605: ('0.4151656312883284',), 1381664601: ('0.4151656312883284',)} new output for save of step final : {1381664621: ('0.4151656312883284',), 1381664619: ('0.4151656312883284',), 1381664605: ('0.4151656312883284',), 1381664601: ('0.4151656312883284',)} [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 4 /1381664621.Didn't retrieve data . /1381664619.Didn't retrieve data . /1381664605.Didn't retrieve data . /1381664601.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014852762222290039 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14137005805969238 time spend to save output : 0.015712499618530273 total time spend for step 8 : 0.15708255767822266 step9:velours_tree Fri Sep 5 10:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16893553733825684 time spend to save output : 3.6716461181640625e-05 total time spend for step 9 : 0.16897225379943848 step10:send_mail_cod Fri Sep 5 10:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26569659_05-09-2025_10_32_08.pdf 26571850 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718501757061128 26571851 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718511757061130 26571852 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718521757061132 26571853 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718531757061133 26571854 imagette265718541757061134 26571855 imagette265718551757061134 26571856 imagette265718561757061134 26571857 imagette265718571757061134 26571858 imagette265718581757061134 26571859 imagette265718591757061134 26571860 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718601757061134 26571861 change filename to text .change filename to text .change filename to text .change filename to text .imagette265718611757061135 26571862 imagette265718621757061136 26571863 imagette265718631757061136 26571864 imagette265718641757061136 26571865 imagette265718651757061136 26571866 imagette265718661757061136 26571867 imagette265718671757061136 26571868 change filename to text .change filename to text .imagette265718681757061136 26571870 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265718701757061136 26571871 imagette265718711757061138 26571872 imagette265718721757061138 26571873 imagette265718731757061138 26571875 imagette265718751757061138 26571876 imagette265718761757061138 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26569659 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26571890,26571891,26571892,26571893,26571894,26571899,26571901,26571902,26571903,26571904,26571905,26571906,26571908,26571909,26571910,26571911,26571912,26571913,26571914,26571915?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=26569659 your option no_mail is active, we will not send the real mail to your client args[1381664621] : ((1381664621, 4111.457139353217, 492609224), (1381664621, -0.23955564009122385, 496442774), '0.4151656312883284') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1381664619] : ((1381664619, 1561.0474996864134, 2107751945), (1381664619, -0.5292931799060875, 501862349), '0.4151656312883284') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1381664605] : ((1381664605, 3372.3060274600703, 492609224), (1381664605, -0.30263558552135406, 496442774), '0.4151656312883284') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1381664601] : ((1381664601, 214.96922930606019, 492688767), (1381664601, -1.0100046989462665, 501862349), '0.4151656312883284') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.4151656312883284 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569659_05-09-2025_10_32_08.pdf results_Auto_P26569659_05-09-2025_10_32_08.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569659_05-09-2025_10_32_08.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','26569659','results_Auto_P26569659_05-09-2025_10_32_08.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569659_05-09-2025_10_32_08.pdf','pdf','','1.57','0.4151656312883284') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.032103776931762695 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.127981185913086 time spend to save output : 0.03231000900268555 total time spend for step 10 : 12.160291194915771 step11:split_time_score Fri Sep 5 10:32:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('46', 1), ('47', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05092025 26569659 Nombre de photos uploadées : 4 / 23040 (0%) 05092025 26569659 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 05092025 26569659 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 8.821487426757812e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0007083415985107422 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21538782119750977 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.4151656312883284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569659_05-09-2025_10_32_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26569659 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569659 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05092025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381664621, 1381664619, 1381664605, 1381664601] Looping around the photos to save general results len do output : 1 /26569659Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664621', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664619', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664605', None, None, None, None, None, '3669035') ('4741', None, None, None, None, None, None, None, '3669035') ('4741', '26569659', '1381664601', None, None, None, None, None, '3669035') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.0169069766998291 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4813096523284912 time spend to save output : 0.017217159271240234 total time spend for step 11 : 0.49852681159973145 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 405.21user 164.70system 10:57.48elapsed 86%CPU (0avgtext+0avgdata 6289404maxresident)k 1361168inputs+437352outputs (8283major+29406736minor)pagefaults 0swaps