python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3445111 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['3316120'] with mtr_portfolio_ids : ['25152624'] and first list_photo_ids : [] new path : /proc/3445111/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.9082999229431152 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Jul 21 22:41:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1667 wait 20 seconds l 3637 free memory gpu now : 1667 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-21 22:41:52.934529: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-21 22:41:52.959414: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-21 22:41:52.961591: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f66a4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-21 22:41:52.961662: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-21 22:41:52.965933: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-21 22:41:53.096563: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4359c510 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-21 22:41:53.096620: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-21 22:41:53.097889: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:41:53.111530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:41:53.116007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:41:53.118870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:41:53.119603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:41:53.122664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:41:53.124011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:41:53.130074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:41:53.131276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:41:53.131369: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:41:53.132035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-21 22:41:53.132052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-21 22:41:53.132062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-21 22:41:53.133105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-21 22:41:53.420261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:41:53.420349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:41:53.420371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:41:53.420390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:41:53.420408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:41:53.420426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:41:53.420443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:41:53.420462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:41:53.421743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:41:53.423060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:41:53.423131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:41:53.423154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:41:53.423227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:41:53.423260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:41:53.423286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:41:53.423308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:41:53.423328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:41:53.424523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:41:53.424558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-21 22:41:53.424570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-21 22:41:53.424580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-21 22:41:53.425882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-21 22:42:02.120781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:42:02.305275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.13750 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 3120.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 3445752 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 376 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.001485586166381836 nb_pixel_total : 63994 time to create 1 rle with old method : 0.0693521499633789 length of segment : 362 time for calcul the mask position with numpy : 0.0014994144439697266 nb_pixel_total : 89284 time to create 1 rle with old method : 0.09601593017578125 length of segment : 201 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 21778 time to create 1 rle with old method : 0.023389816284179688 length of segment : 231 time for calcul the mask position with numpy : 0.0003216266632080078 nb_pixel_total : 15500 time to create 1 rle with old method : 0.01686835289001465 length of segment : 129 time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 13599 time to create 1 rle with old method : 0.014812469482421875 length of segment : 199 time for calcul the mask position with numpy : 0.0009527206420898438 nb_pixel_total : 61914 time to create 1 rle with old method : 0.06661796569824219 length of segment : 456 time for calcul the mask position with numpy : 0.0006940364837646484 nb_pixel_total : 44942 time to create 1 rle with old method : 0.06521773338317871 length of segment : 335 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 11250 time to create 1 rle with old method : 0.01313018798828125 length of segment : 62 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 10987 time to create 1 rle with old method : 0.011905193328857422 length of segment : 150 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 30179 time to create 1 rle with old method : 0.0321345329284668 length of segment : 184 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 17076 time to create 1 rle with old method : 0.0188138484954834 length of segment : 141 time for calcul the mask position with numpy : 0.0004622936248779297 nb_pixel_total : 33025 time to create 1 rle with old method : 0.03543806076049805 length of segment : 276 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 11381 time to create 1 rle with old method : 0.012352705001831055 length of segment : 183 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 23992 time to create 1 rle with old method : 0.02610182762145996 length of segment : 216 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 18242 time to create 1 rle with old method : 0.021127700805664062 length of segment : 154 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 6734 time to create 1 rle with old method : 0.007508516311645508 length of segment : 80 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0022275447845458984 length of segment : 108 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 5813 time to create 1 rle with old method : 0.006677150726318359 length of segment : 86 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 21467 time to create 1 rle with old method : 0.023687124252319336 length of segment : 173 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 21806 time to create 1 rle with old method : 0.024127960205078125 length of segment : 209 time for calcul the mask position with numpy : 0.0007922649383544922 nb_pixel_total : 61128 time to create 1 rle with old method : 0.06676125526428223 length of segment : 263 time for calcul the mask position with numpy : 0.0007092952728271484 nb_pixel_total : 41667 time to create 1 rle with old method : 0.045702457427978516 length of segment : 199 time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 49227 time to create 1 rle with old method : 0.052384138107299805 length of segment : 263 time for calcul the mask position with numpy : 0.0007014274597167969 nb_pixel_total : 38960 time to create 1 rle with old method : 0.042046546936035156 length of segment : 200 time for calcul the mask position with numpy : 0.0001201629638671875 nb_pixel_total : 6070 time to create 1 rle with old method : 0.007023811340332031 length of segment : 100 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 12912 time to create 1 rle with old method : 0.014108419418334961 length of segment : 154 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 24942 time to create 1 rle with old method : 0.028479814529418945 length of segment : 157 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 7921 time to create 1 rle with old method : 0.008808374404907227 length of segment : 74 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 41530 time to create 1 rle with old method : 0.04451489448547363 length of segment : 183 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 9480 time to create 1 rle with old method : 0.010209798812866211 length of segment : 181 time for calcul the mask position with numpy : 0.000217437744140625 nb_pixel_total : 11794 time to create 1 rle with old method : 0.013292312622070312 length of segment : 151 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 8711 time to create 1 rle with old method : 0.009810447692871094 length of segment : 86 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 43247 time to create 1 rle with old method : 0.04821920394897461 length of segment : 203 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 8575 time to create 1 rle with old method : 0.00980830192565918 length of segment : 108 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 13921 time to create 1 rle with old method : 0.01537942886352539 length of segment : 159 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 12126 time to create 1 rle with old method : 0.013306617736816406 length of segment : 130 time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 43590 time to create 1 rle with old method : 0.04791402816772461 length of segment : 236 time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 56413 time to create 1 rle with old method : 0.06015157699584961 length of segment : 247 time for calcul the mask position with numpy : 0.0002961158752441406 nb_pixel_total : 14784 time to create 1 rle with old method : 0.01659083366394043 length of segment : 175 time for calcul the mask position with numpy : 0.00017881393432617188 nb_pixel_total : 9289 time to create 1 rle with old method : 0.010590553283691406 length of segment : 148 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 24175 time to create 1 rle with old method : 0.0272066593170166 length of segment : 270 time for calcul the mask position with numpy : 0.0002579689025878906 nb_pixel_total : 12603 time to create 1 rle with old method : 0.014532089233398438 length of segment : 152 time for calcul the mask position with numpy : 0.00020647048950195312 nb_pixel_total : 7203 time to create 1 rle with old method : 0.029699325561523438 length of segment : 88 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 39958 time to create 1 rle with old method : 0.12354636192321777 length of segment : 194 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 11863 time to create 1 rle with old method : 0.01892995834350586 length of segment : 221 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 5224 time to create 1 rle with old method : 0.009385347366333008 length of segment : 164 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 20676 time to create 1 rle with old method : 0.029601335525512695 length of segment : 173 time for calcul the mask position with numpy : 0.0004839897155761719 nb_pixel_total : 26937 time to create 1 rle with old method : 0.03181767463684082 length of segment : 126 time for calcul the mask position with numpy : 0.0001800060272216797 nb_pixel_total : 4630 time to create 1 rle with old method : 0.0056002140045166016 length of segment : 146 time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 42446 time to create 1 rle with old method : 0.04817485809326172 length of segment : 219 time for calcul the mask position with numpy : 0.40410947799682617 nb_pixel_total : 1870607 time to create 1 rle with new method : 0.47871828079223633 length of segment : 1475 time for calcul the mask position with numpy : 0.564873218536377 nb_pixel_total : 5063031 time to create 1 rle with new method : 0.4535491466522217 length of segment : 1826 time for calcul the mask position with numpy : 0.39018869400024414 nb_pixel_total : 4986007 time to create 1 rle with new method : 0.7639260292053223 length of segment : 3154 time for calcul the mask position with numpy : 0.001547098159790039 nb_pixel_total : 55248 time to create 1 rle with old method : 0.059782981872558594 length of segment : 346 time for calcul the mask position with numpy : 0.00136566162109375 nb_pixel_total : 62835 time to create 1 rle with old method : 0.06803107261657715 length of segment : 501 time spent for convertir_results : 9.296156406402588 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 55 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 61.96133637428284 time spend to save output : 0.10469484329223633 total time spend for step 1 : 62.06603121757507 step2:mask_detect Mon Jul 21 22:42:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-21 22:42:34.656992: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-21 22:42:34.687569: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-21 22:42:34.689808: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6698000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-21 22:42:34.689873: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-21 22:42:34.694312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-21 22:42:34.838306: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x44ccee90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-21 22:42:34.838367: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-21 22:42:34.839366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:42:34.839762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:42:34.842027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:42:34.847813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:42:34.848236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:42:34.850709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:42:34.851916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:42:34.857398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:42:34.858680: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:42:34.858784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:42:34.859412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-21 22:42:34.859430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-21 22:42:34.859439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-21 22:42:34.860522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-21 22:42:35.087099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:42:35.087255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:42:35.087296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:42:35.087326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:42:35.087355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:42:35.087383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:42:35.087411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:42:35.087439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:42:35.088834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:42:35.089748: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-21 22:42:35.089779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-21 22:42:35.089797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:42:35.089813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-21 22:42:35.089830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-21 22:42:35.089846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-21 22:42:35.089862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-21 22:42:35.089878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-21 22:42:35.090845: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-21 22:42:35.090870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-21 22:42:35.090879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-21 22:42:35.090887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-21 22:42:35.091931: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-21 22:42:45.455750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-21 22:42:45.628934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 80 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 90 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 100 NEW PHOTO Processing 1 images image shape: (3120, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.13750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3120.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 3446903 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 376 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0194704532623291 nb_pixel_total : 221339 time to create 1 rle with new method : 0.010204315185546875 length of segment : 407 time for calcul the mask position with numpy : 0.0009610652923583984 nb_pixel_total : 40063 time to create 1 rle with old method : 0.042557716369628906 length of segment : 239 time for calcul the mask position with numpy : 0.0011565685272216797 nb_pixel_total : 51861 time to create 1 rle with old method : 0.05716061592102051 length of segment : 374 time for calcul the mask position with numpy : 0.0005903244018554688 nb_pixel_total : 16868 time to create 1 rle with old method : 0.019209861755371094 length of segment : 176 time for calcul the mask position with numpy : 0.00064849853515625 nb_pixel_total : 27419 time to create 1 rle with old method : 0.030160903930664062 length of segment : 197 time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 14537 time to create 1 rle with old method : 0.016109466552734375 length of segment : 144 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 26309 time to create 1 rle with old method : 0.02978825569152832 length of segment : 154 time for calcul the mask position with numpy : 0.002570629119873047 nb_pixel_total : 107374 time to create 1 rle with old method : 0.11765837669372559 length of segment : 421 time for calcul the mask position with numpy : 0.00042366981506347656 nb_pixel_total : 17840 time to create 1 rle with old method : 0.019866943359375 length of segment : 126 time for calcul the mask position with numpy : 0.0015578269958496094 nb_pixel_total : 52069 time to create 1 rle with old method : 0.06222391128540039 length of segment : 307 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 8814 time to create 1 rle with old method : 0.010102510452270508 length of segment : 80 time for calcul the mask position with numpy : 0.005158901214599609 nb_pixel_total : 236466 time to create 1 rle with new method : 0.016774654388427734 length of segment : 846 time for calcul the mask position with numpy : 0.002160787582397461 nb_pixel_total : 90304 time to create 1 rle with old method : 0.09931445121765137 length of segment : 446 time for calcul the mask position with numpy : 0.0017452239990234375 nb_pixel_total : 60464 time to create 1 rle with old method : 0.06788134574890137 length of segment : 284 time for calcul the mask position with numpy : 0.002569437026977539 nb_pixel_total : 108507 time to create 1 rle with old method : 0.12058377265930176 length of segment : 326 time for calcul the mask position with numpy : 0.0006127357482910156 nb_pixel_total : 25521 time to create 1 rle with old method : 0.02867746353149414 length of segment : 226 time for calcul the mask position with numpy : 0.0015044212341308594 nb_pixel_total : 54077 time to create 1 rle with old method : 0.06117701530456543 length of segment : 177 time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 16516 time to create 1 rle with old method : 0.018364429473876953 length of segment : 157 time for calcul the mask position with numpy : 0.0007691383361816406 nb_pixel_total : 34269 time to create 1 rle with old method : 0.0386960506439209 length of segment : 279 time for calcul the mask position with numpy : 0.01151728630065918 nb_pixel_total : 357429 time to create 1 rle with new method : 0.04726052284240723 length of segment : 603 time for calcul the mask position with numpy : 0.0012123584747314453 nb_pixel_total : 55795 time to create 1 rle with old method : 0.06083965301513672 length of segment : 259 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 11063 time to create 1 rle with old method : 0.012520551681518555 length of segment : 126 time for calcul the mask position with numpy : 0.0006618499755859375 nb_pixel_total : 27613 time to create 1 rle with old method : 0.030350923538208008 length of segment : 157 time for calcul the mask position with numpy : 0.0005147457122802734 nb_pixel_total : 25161 time to create 1 rle with old method : 0.028064489364624023 length of segment : 230 time for calcul the mask position with numpy : 0.0024843215942382812 nb_pixel_total : 115544 time to create 1 rle with old method : 0.1245732307434082 length of segment : 380 time for calcul the mask position with numpy : 0.0010268688201904297 nb_pixel_total : 27922 time to create 1 rle with old method : 0.04299426078796387 length of segment : 220 time for calcul the mask position with numpy : 0.0005085468292236328 nb_pixel_total : 19381 time to create 1 rle with old method : 0.0217440128326416 length of segment : 188 time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 28084 time to create 1 rle with old method : 0.030838966369628906 length of segment : 186 time for calcul the mask position with numpy : 0.0008871555328369141 nb_pixel_total : 28722 time to create 1 rle with old method : 0.031876325607299805 length of segment : 286 time for calcul the mask position with numpy : 0.0011074542999267578 nb_pixel_total : 46114 time to create 1 rle with old method : 0.0503385066986084 length of segment : 241 time for calcul the mask position with numpy : 0.0009543895721435547 nb_pixel_total : 38081 time to create 1 rle with old method : 0.04252052307128906 length of segment : 335 time for calcul the mask position with numpy : 0.001901388168334961 nb_pixel_total : 103211 time to create 1 rle with old method : 0.11186957359313965 length of segment : 436 time for calcul the mask position with numpy : 0.0012230873107910156 nb_pixel_total : 46718 time to create 1 rle with old method : 0.05126667022705078 length of segment : 295 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 10517 time to create 1 rle with old method : 0.012061834335327148 length of segment : 176 time for calcul the mask position with numpy : 0.003923654556274414 nb_pixel_total : 192128 time to create 1 rle with new method : 0.011663436889648438 length of segment : 723 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 24469 time to create 1 rle with old method : 0.028078794479370117 length of segment : 225 time for calcul the mask position with numpy : 0.0016965866088867188 nb_pixel_total : 63326 time to create 1 rle with old method : 0.07065582275390625 length of segment : 343 time for calcul the mask position with numpy : 0.0042629241943359375 nb_pixel_total : 163618 time to create 1 rle with new method : 0.011965513229370117 length of segment : 465 time for calcul the mask position with numpy : 0.0038301944732666016 nb_pixel_total : 151914 time to create 1 rle with new method : 0.011689186096191406 length of segment : 647 time for calcul the mask position with numpy : 0.001463174819946289 nb_pixel_total : 56439 time to create 1 rle with old method : 0.059504032135009766 length of segment : 417 time for calcul the mask position with numpy : 0.0009951591491699219 nb_pixel_total : 27929 time to create 1 rle with old method : 0.044129371643066406 length of segment : 202 time for calcul the mask position with numpy : 0.0007944107055664062 nb_pixel_total : 27886 time to create 1 rle with old method : 0.03246450424194336 length of segment : 214 time for calcul the mask position with numpy : 0.002955198287963867 nb_pixel_total : 94882 time to create 1 rle with old method : 0.1122589111328125 length of segment : 652 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 15650 time to create 1 rle with old method : 0.017789602279663086 length of segment : 145 time for calcul the mask position with numpy : 0.0006301403045654297 nb_pixel_total : 29805 time to create 1 rle with old method : 0.03367304801940918 length of segment : 163 time for calcul the mask position with numpy : 0.0005102157592773438 nb_pixel_total : 22086 time to create 1 rle with old method : 0.024230241775512695 length of segment : 224 time for calcul the mask position with numpy : 0.0018498897552490234 nb_pixel_total : 57105 time to create 1 rle with old method : 0.0632774829864502 length of segment : 424 time for calcul the mask position with numpy : 0.0013320446014404297 nb_pixel_total : 46641 time to create 1 rle with old method : 0.05234074592590332 length of segment : 206 time for calcul the mask position with numpy : 0.0002665519714355469 nb_pixel_total : 11907 time to create 1 rle with old method : 0.01369333267211914 length of segment : 110 time for calcul the mask position with numpy : 0.0006415843963623047 nb_pixel_total : 28752 time to create 1 rle with old method : 0.0323333740234375 length of segment : 222 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 8832 time to create 1 rle with old method : 0.010035991668701172 length of segment : 109 time for calcul the mask position with numpy : 0.0024416446685791016 nb_pixel_total : 107093 time to create 1 rle with old method : 0.12165188789367676 length of segment : 440 time for calcul the mask position with numpy : 0.0007212162017822266 nb_pixel_total : 30046 time to create 1 rle with old method : 0.0331425666809082 length of segment : 268 time for calcul the mask position with numpy : 0.015486001968383789 nb_pixel_total : 647404 time to create 1 rle with new method : 0.08606433868408203 length of segment : 1482 time for calcul the mask position with numpy : 0.0005209445953369141 nb_pixel_total : 17312 time to create 1 rle with old method : 0.019933700561523438 length of segment : 188 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 15684 time to create 1 rle with old method : 0.017612457275390625 length of segment : 150 time for calcul the mask position with numpy : 0.0012104511260986328 nb_pixel_total : 67428 time to create 1 rle with old method : 0.07330918312072754 length of segment : 212 time for calcul the mask position with numpy : 0.0032968521118164062 nb_pixel_total : 107441 time to create 1 rle with old method : 0.11892318725585938 length of segment : 542 time for calcul the mask position with numpy : 0.001180410385131836 nb_pixel_total : 24646 time to create 1 rle with old method : 0.0283200740814209 length of segment : 300 time for calcul the mask position with numpy : 0.002596139907836914 nb_pixel_total : 112208 time to create 1 rle with old method : 0.1267402172088623 length of segment : 337 time for calcul the mask position with numpy : 0.0015728473663330078 nb_pixel_total : 44766 time to create 1 rle with old method : 0.05463457107543945 length of segment : 291 time for calcul the mask position with numpy : 0.0020291805267333984 nb_pixel_total : 69279 time to create 1 rle with old method : 0.07572102546691895 length of segment : 441 time for calcul the mask position with numpy : 0.001997709274291992 nb_pixel_total : 86323 time to create 1 rle with old method : 0.09325432777404785 length of segment : 266 time for calcul the mask position with numpy : 0.0017688274383544922 nb_pixel_total : 86387 time to create 1 rle with old method : 0.09421038627624512 length of segment : 213 time for calcul the mask position with numpy : 0.002032041549682617 nb_pixel_total : 69360 time to create 1 rle with old method : 0.0875861644744873 length of segment : 400 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 18377 time to create 1 rle with old method : 0.020236492156982422 length of segment : 164 time for calcul the mask position with numpy : 0.0006630420684814453 nb_pixel_total : 23137 time to create 1 rle with old method : 0.026081562042236328 length of segment : 248 time for calcul the mask position with numpy : 0.0008492469787597656 nb_pixel_total : 32782 time to create 1 rle with old method : 0.0360414981842041 length of segment : 193 time for calcul the mask position with numpy : 0.0005831718444824219 nb_pixel_total : 32338 time to create 1 rle with old method : 0.035863399505615234 length of segment : 150 time for calcul the mask position with numpy : 0.0014050006866455078 nb_pixel_total : 57882 time to create 1 rle with old method : 0.06330132484436035 length of segment : 288 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 10159 time to create 1 rle with old method : 0.011379003524780273 length of segment : 134 time for calcul the mask position with numpy : 0.0016632080078125 nb_pixel_total : 66638 time to create 1 rle with old method : 0.0717463493347168 length of segment : 472 time for calcul the mask position with numpy : 0.000934600830078125 nb_pixel_total : 32002 time to create 1 rle with old method : 0.03570365905761719 length of segment : 258 time for calcul the mask position with numpy : 0.0009493827819824219 nb_pixel_total : 38086 time to create 1 rle with old method : 0.04264545440673828 length of segment : 263 time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 21351 time to create 1 rle with old method : 0.024033069610595703 length of segment : 163 time for calcul the mask position with numpy : 0.0005545616149902344 nb_pixel_total : 28658 time to create 1 rle with old method : 0.03186464309692383 length of segment : 181 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 47081 time to create 1 rle with old method : 0.05180048942565918 length of segment : 250 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 31243 time to create 1 rle with old method : 0.034407615661621094 length of segment : 180 time for calcul the mask position with numpy : 0.0025360584259033203 nb_pixel_total : 103634 time to create 1 rle with old method : 0.11357522010803223 length of segment : 375 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 31725 time to create 1 rle with old method : 0.03550457954406738 length of segment : 208 time for calcul the mask position with numpy : 0.001186370849609375 nb_pixel_total : 50406 time to create 1 rle with old method : 0.057146549224853516 length of segment : 239 time for calcul the mask position with numpy : 0.0014450550079345703 nb_pixel_total : 69335 time to create 1 rle with old method : 0.07721328735351562 length of segment : 279 time for calcul the mask position with numpy : 0.006471157073974609 nb_pixel_total : 239093 time to create 1 rle with new method : 0.031200170516967773 length of segment : 576 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 21656 time to create 1 rle with old method : 0.024699687957763672 length of segment : 130 time for calcul the mask position with numpy : 0.0025081634521484375 nb_pixel_total : 119092 time to create 1 rle with old method : 0.12685370445251465 length of segment : 563 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 8026 time to create 1 rle with old method : 0.009326696395874023 length of segment : 148 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 13998 time to create 1 rle with old method : 0.015858173370361328 length of segment : 255 time for calcul the mask position with numpy : 0.003544330596923828 nb_pixel_total : 152310 time to create 1 rle with new method : 0.010482549667358398 length of segment : 418 time for calcul the mask position with numpy : 0.005295753479003906 nb_pixel_total : 184276 time to create 1 rle with new method : 0.01474761962890625 length of segment : 456 time for calcul the mask position with numpy : 0.001033782958984375 nb_pixel_total : 49738 time to create 1 rle with old method : 0.05778956413269043 length of segment : 201 time for calcul the mask position with numpy : 0.003758668899536133 nb_pixel_total : 198512 time to create 1 rle with new method : 0.010337352752685547 length of segment : 588 time for calcul the mask position with numpy : 0.004653215408325195 nb_pixel_total : 198250 time to create 1 rle with new method : 0.011332035064697266 length of segment : 523 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 18815 time to create 1 rle with old method : 0.021235227584838867 length of segment : 230 time for calcul the mask position with numpy : 0.004860639572143555 nb_pixel_total : 190673 time to create 1 rle with new method : 0.012197256088256836 length of segment : 441 time for calcul the mask position with numpy : 0.0008804798126220703 nb_pixel_total : 27678 time to create 1 rle with old method : 0.03149223327636719 length of segment : 164 time for calcul the mask position with numpy : 0.0005259513854980469 nb_pixel_total : 24829 time to create 1 rle with old method : 0.02913379669189453 length of segment : 174 time for calcul the mask position with numpy : 0.001421213150024414 nb_pixel_total : 45859 time to create 1 rle with old method : 0.05094313621520996 length of segment : 354 time for calcul the mask position with numpy : 0.0009212493896484375 nb_pixel_total : 37827 time to create 1 rle with old method : 0.0429537296295166 length of segment : 170 time for calcul the mask position with numpy : 0.021814823150634766 nb_pixel_total : 845312 time to create 1 rle with new method : 0.47325778007507324 length of segment : 1351 time for calcul the mask position with numpy : 0.0025475025177001953 nb_pixel_total : 90193 time to create 1 rle with old method : 0.10236382484436035 length of segment : 341 time for calcul the mask position with numpy : 0.0162050724029541 nb_pixel_total : 793678 time to create 1 rle with new method : 0.29733848571777344 length of segment : 1028 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 11342 time to create 1 rle with old method : 0.01345205307006836 length of segment : 115 time for calcul the mask position with numpy : 0.0023140907287597656 nb_pixel_total : 113550 time to create 1 rle with old method : 0.1412208080291748 length of segment : 387 time for calcul the mask position with numpy : 0.003442049026489258 nb_pixel_total : 92886 time to create 1 rle with old method : 0.12608766555786133 length of segment : 384 time for calcul the mask position with numpy : 0.0016179084777832031 nb_pixel_total : 40673 time to create 1 rle with old method : 0.04770159721374512 length of segment : 245 time for calcul the mask position with numpy : 0.0010242462158203125 nb_pixel_total : 23682 time to create 1 rle with old method : 0.028151750564575195 length of segment : 180 time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 12678 time to create 1 rle with old method : 0.014902353286743164 length of segment : 178 time for calcul the mask position with numpy : 0.0008814334869384766 nb_pixel_total : 41674 time to create 1 rle with old method : 0.048711538314819336 length of segment : 344 time for calcul the mask position with numpy : 0.0050296783447265625 nb_pixel_total : 123395 time to create 1 rle with old method : 0.1374061107635498 length of segment : 457 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 29517 time to create 1 rle with old method : 0.034528255462646484 length of segment : 224 time for calcul the mask position with numpy : 0.00016832351684570312 nb_pixel_total : 5974 time to create 1 rle with old method : 0.007172822952270508 length of segment : 106 time for calcul the mask position with numpy : 0.0007946491241455078 nb_pixel_total : 12786 time to create 1 rle with old method : 0.015055656433105469 length of segment : 163 time for calcul the mask position with numpy : 0.0029172897338867188 nb_pixel_total : 143443 time to create 1 rle with old method : 0.16174936294555664 length of segment : 430 time for calcul the mask position with numpy : 0.023913145065307617 nb_pixel_total : 435761 time to create 1 rle with new method : 0.07115697860717773 length of segment : 1842 time for calcul the mask position with numpy : 0.0013723373413085938 nb_pixel_total : 52268 time to create 1 rle with old method : 0.05729413032531738 length of segment : 295 time for calcul the mask position with numpy : 0.002296924591064453 nb_pixel_total : 90903 time to create 1 rle with old method : 0.10027503967285156 length of segment : 327 time for calcul the mask position with numpy : 0.00421905517578125 nb_pixel_total : 128519 time to create 1 rle with old method : 0.1656951904296875 length of segment : 386 time for calcul the mask position with numpy : 0.0006148815155029297 nb_pixel_total : 23329 time to create 1 rle with old method : 0.02648448944091797 length of segment : 196 time for calcul the mask position with numpy : 0.0013608932495117188 nb_pixel_total : 64880 time to create 1 rle with old method : 0.0738837718963623 length of segment : 225 time for calcul the mask position with numpy : 0.0008034706115722656 nb_pixel_total : 17313 time to create 1 rle with old method : 0.020496606826782227 length of segment : 224 time for calcul the mask position with numpy : 0.0020563602447509766 nb_pixel_total : 49654 time to create 1 rle with old method : 0.05668163299560547 length of segment : 417 time for calcul the mask position with numpy : 0.0039675235748291016 nb_pixel_total : 137433 time to create 1 rle with old method : 0.15076518058776855 length of segment : 671 time for calcul the mask position with numpy : 0.002139568328857422 nb_pixel_total : 93502 time to create 1 rle with old method : 0.10233497619628906 length of segment : 382 time for calcul the mask position with numpy : 0.0018630027770996094 nb_pixel_total : 58939 time to create 1 rle with old method : 0.06855273246765137 length of segment : 270 time for calcul the mask position with numpy : 0.007359981536865234 nb_pixel_total : 307749 time to create 1 rle with new method : 0.02160024642944336 length of segment : 663 time for calcul the mask position with numpy : 0.0010020732879638672 nb_pixel_total : 44934 time to create 1 rle with old method : 0.05231451988220215 length of segment : 193 time for calcul the mask position with numpy : 0.0020225048065185547 nb_pixel_total : 99239 time to create 1 rle with old method : 0.12534761428833008 length of segment : 361 time for calcul the mask position with numpy : 0.0007579326629638672 nb_pixel_total : 24480 time to create 1 rle with old method : 0.027923107147216797 length of segment : 247 time for calcul the mask position with numpy : 0.0033059120178222656 nb_pixel_total : 144755 time to create 1 rle with old method : 0.16421818733215332 length of segment : 682 time for calcul the mask position with numpy : 0.0014157295227050781 nb_pixel_total : 64928 time to create 1 rle with old method : 0.07249140739440918 length of segment : 274 time for calcul the mask position with numpy : 0.0009963512420654297 nb_pixel_total : 30865 time to create 1 rle with old method : 0.033861637115478516 length of segment : 256 time for calcul the mask position with numpy : 0.0035860538482666016 nb_pixel_total : 147093 time to create 1 rle with old method : 0.16070771217346191 length of segment : 650 time for calcul the mask position with numpy : 0.002401590347290039 nb_pixel_total : 102248 time to create 1 rle with old method : 0.11356568336486816 length of segment : 414 time for calcul the mask position with numpy : 0.008791208267211914 nb_pixel_total : 351559 time to create 1 rle with new method : 0.023156404495239258 length of segment : 941 time for calcul the mask position with numpy : 0.0003178119659423828 nb_pixel_total : 12735 time to create 1 rle with old method : 0.014659643173217773 length of segment : 116 time for calcul the mask position with numpy : 0.0076656341552734375 nb_pixel_total : 257587 time to create 1 rle with new method : 0.02431964874267578 length of segment : 1009 time for calcul the mask position with numpy : 0.0009109973907470703 nb_pixel_total : 35566 time to create 1 rle with old method : 0.040789127349853516 length of segment : 207 time for calcul the mask position with numpy : 0.0014395713806152344 nb_pixel_total : 56305 time to create 1 rle with old method : 0.06262779235839844 length of segment : 240 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 18867 time to create 1 rle with old method : 0.02085423469543457 length of segment : 189 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 36770 time to create 1 rle with old method : 0.04165816307067871 length of segment : 298 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 5596 time to create 1 rle with old method : 0.00644373893737793 length of segment : 114 time for calcul the mask position with numpy : 0.0012412071228027344 nb_pixel_total : 60483 time to create 1 rle with old method : 0.06749486923217773 length of segment : 575 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 8228 time to create 1 rle with old method : 0.009630441665649414 length of segment : 76 time for calcul the mask position with numpy : 0.001056671142578125 nb_pixel_total : 32964 time to create 1 rle with old method : 0.03877758979797363 length of segment : 179 time for calcul the mask position with numpy : 0.007830619812011719 nb_pixel_total : 274046 time to create 1 rle with new method : 0.024660587310791016 length of segment : 796 time for calcul the mask position with numpy : 0.0069544315338134766 nb_pixel_total : 190953 time to create 1 rle with new method : 0.024755239486694336 length of segment : 703 time for calcul the mask position with numpy : 0.001964092254638672 nb_pixel_total : 59739 time to create 1 rle with old method : 0.06828665733337402 length of segment : 359 time for calcul the mask position with numpy : 0.0018439292907714844 nb_pixel_total : 62307 time to create 1 rle with old method : 0.0764317512512207 length of segment : 270 time for calcul the mask position with numpy : 0.0017998218536376953 nb_pixel_total : 56587 time to create 1 rle with old method : 0.0630331039428711 length of segment : 340 time for calcul the mask position with numpy : 0.0011584758758544922 nb_pixel_total : 53611 time to create 1 rle with old method : 0.060353994369506836 length of segment : 240 time for calcul the mask position with numpy : 0.0010166168212890625 nb_pixel_total : 43955 time to create 1 rle with old method : 0.04986858367919922 length of segment : 164 time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 25630 time to create 1 rle with old method : 0.028734683990478516 length of segment : 135 time for calcul the mask position with numpy : 0.002665996551513672 nb_pixel_total : 120902 time to create 1 rle with old method : 0.13887619972229004 length of segment : 386 time for calcul the mask position with numpy : 0.0005726814270019531 nb_pixel_total : 21796 time to create 1 rle with old method : 0.0242307186126709 length of segment : 151 time for calcul the mask position with numpy : 0.006876945495605469 nb_pixel_total : 272617 time to create 1 rle with new method : 0.024753570556640625 length of segment : 988 time for calcul the mask position with numpy : 0.007370948791503906 nb_pixel_total : 266824 time to create 1 rle with new method : 0.023288249969482422 length of segment : 479 time for calcul the mask position with numpy : 0.000640869140625 nb_pixel_total : 26200 time to create 1 rle with old method : 0.029627084732055664 length of segment : 234 time for calcul the mask position with numpy : 0.001352071762084961 nb_pixel_total : 54370 time to create 1 rle with old method : 0.06024503707885742 length of segment : 242 time for calcul the mask position with numpy : 0.00139617919921875 nb_pixel_total : 69042 time to create 1 rle with old method : 0.07764482498168945 length of segment : 289 time for calcul the mask position with numpy : 0.0011968612670898438 nb_pixel_total : 64235 time to create 1 rle with old method : 0.07164168357849121 length of segment : 210 time for calcul the mask position with numpy : 0.0006644725799560547 nb_pixel_total : 34913 time to create 1 rle with old method : 0.038884639739990234 length of segment : 163 time for calcul the mask position with numpy : 0.0006031990051269531 nb_pixel_total : 21501 time to create 1 rle with old method : 0.02478623390197754 length of segment : 155 time for calcul the mask position with numpy : 0.001399993896484375 nb_pixel_total : 54408 time to create 1 rle with old method : 0.06161665916442871 length of segment : 229 time for calcul the mask position with numpy : 0.00371551513671875 nb_pixel_total : 162789 time to create 1 rle with new method : 0.011165380477905273 length of segment : 398 time for calcul the mask position with numpy : 0.0010294914245605469 nb_pixel_total : 6213 time to create 1 rle with old method : 0.007949113845825195 length of segment : 126 time for calcul the mask position with numpy : 0.0009088516235351562 nb_pixel_total : 30361 time to create 1 rle with old method : 0.03397560119628906 length of segment : 249 time for calcul the mask position with numpy : 0.0033524036407470703 nb_pixel_total : 144623 time to create 1 rle with old method : 0.16185426712036133 length of segment : 370 time for calcul the mask position with numpy : 0.004763126373291016 nb_pixel_total : 181164 time to create 1 rle with new method : 0.014684200286865234 length of segment : 398 time for calcul the mask position with numpy : 0.0019843578338623047 nb_pixel_total : 85598 time to create 1 rle with old method : 0.09473013877868652 length of segment : 363 time for calcul the mask position with numpy : 0.0019526481628417969 nb_pixel_total : 79443 time to create 1 rle with old method : 0.0892024040222168 length of segment : 550 time for calcul the mask position with numpy : 0.0006651878356933594 nb_pixel_total : 23036 time to create 1 rle with old method : 0.026204824447631836 length of segment : 145 time for calcul the mask position with numpy : 0.0017552375793457031 nb_pixel_total : 55185 time to create 1 rle with old method : 0.06387209892272949 length of segment : 221 time for calcul the mask position with numpy : 0.0015773773193359375 nb_pixel_total : 67503 time to create 1 rle with old method : 0.07517457008361816 length of segment : 269 time for calcul the mask position with numpy : 0.003867626190185547 nb_pixel_total : 174835 time to create 1 rle with new method : 0.012496232986450195 length of segment : 529 time for calcul the mask position with numpy : 0.0050792694091796875 nb_pixel_total : 253228 time to create 1 rle with new method : 0.014296770095825195 length of segment : 524 time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 17115 time to create 1 rle with old method : 0.01941061019897461 length of segment : 229 time for calcul the mask position with numpy : 0.005340099334716797 nb_pixel_total : 237559 time to create 1 rle with new method : 0.014938592910766602 length of segment : 558 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 14153 time to create 1 rle with old method : 0.015841960906982422 length of segment : 320 time for calcul the mask position with numpy : 0.0011146068572998047 nb_pixel_total : 49389 time to create 1 rle with old method : 0.05576682090759277 length of segment : 276 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 32430 time to create 1 rle with old method : 0.03743600845336914 length of segment : 211 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 18343 time to create 1 rle with old method : 0.021471023559570312 length of segment : 143 time for calcul the mask position with numpy : 0.0010106563568115234 nb_pixel_total : 37871 time to create 1 rle with old method : 0.04227805137634277 length of segment : 258 time for calcul the mask position with numpy : 0.004816532135009766 nb_pixel_total : 136063 time to create 1 rle with old method : 0.16837477684020996 length of segment : 372 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 23598 time to create 1 rle with old method : 0.02682018280029297 length of segment : 240 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 7859 time to create 1 rle with old method : 0.00871896743774414 length of segment : 141 time for calcul the mask position with numpy : 0.01506662368774414 nb_pixel_total : 718336 time to create 1 rle with new method : 0.03813791275024414 length of segment : 860 time for calcul the mask position with numpy : 0.0015904903411865234 nb_pixel_total : 49151 time to create 1 rle with old method : 0.05575966835021973 length of segment : 284 time for calcul the mask position with numpy : 0.002895355224609375 nb_pixel_total : 114101 time to create 1 rle with old method : 0.1275007724761963 length of segment : 377 time for calcul the mask position with numpy : 0.0016231536865234375 nb_pixel_total : 72983 time to create 1 rle with old method : 0.08072543144226074 length of segment : 359 time for calcul the mask position with numpy : 0.0013337135314941406 nb_pixel_total : 39165 time to create 1 rle with old method : 0.04384112358093262 length of segment : 248 time for calcul the mask position with numpy : 0.006928443908691406 nb_pixel_total : 195399 time to create 1 rle with new method : 0.024856090545654297 length of segment : 659 time for calcul the mask position with numpy : 0.0030202865600585938 nb_pixel_total : 102014 time to create 1 rle with old method : 0.1138603687286377 length of segment : 496 time for calcul the mask position with numpy : 0.005018711090087891 nb_pixel_total : 166352 time to create 1 rle with new method : 0.01544809341430664 length of segment : 797 time for calcul the mask position with numpy : 0.0024030208587646484 nb_pixel_total : 83007 time to create 1 rle with old method : 0.09188175201416016 length of segment : 480 time for calcul the mask position with numpy : 0.0026459693908691406 nb_pixel_total : 55935 time to create 1 rle with old method : 0.06421232223510742 length of segment : 305 time for calcul the mask position with numpy : 0.0017590522766113281 nb_pixel_total : 59934 time to create 1 rle with old method : 0.0688474178314209 length of segment : 337 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 23231 time to create 1 rle with old method : 0.026769638061523438 length of segment : 260 time for calcul the mask position with numpy : 0.004861354827880859 nb_pixel_total : 106874 time to create 1 rle with old method : 0.11894941329956055 length of segment : 408 time for calcul the mask position with numpy : 0.0029022693634033203 nb_pixel_total : 94285 time to create 1 rle with old method : 0.10437297821044922 length of segment : 340 time for calcul the mask position with numpy : 0.003267526626586914 nb_pixel_total : 128253 time to create 1 rle with old method : 0.14542222023010254 length of segment : 428 time for calcul the mask position with numpy : 0.0253293514251709 nb_pixel_total : 446209 time to create 1 rle with new method : 0.0581517219543457 length of segment : 1470 time for calcul the mask position with numpy : 0.0013651847839355469 nb_pixel_total : 70619 time to create 1 rle with old method : 0.0798954963684082 length of segment : 242 time for calcul the mask position with numpy : 0.007319927215576172 nb_pixel_total : 321661 time to create 1 rle with new method : 0.022493839263916016 length of segment : 741 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 21333 time to create 1 rle with old method : 0.03689384460449219 length of segment : 175 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 15485 time to create 1 rle with old method : 0.016845703125 length of segment : 193 time for calcul the mask position with numpy : 0.002064228057861328 nb_pixel_total : 78473 time to create 1 rle with old method : 0.08651399612426758 length of segment : 349 time for calcul the mask position with numpy : 0.00101470947265625 nb_pixel_total : 37668 time to create 1 rle with old method : 0.04227852821350098 length of segment : 166 time for calcul the mask position with numpy : 0.00426936149597168 nb_pixel_total : 176604 time to create 1 rle with new method : 0.01360630989074707 length of segment : 416 time for calcul the mask position with numpy : 0.0022430419921875 nb_pixel_total : 52061 time to create 1 rle with old method : 0.059464216232299805 length of segment : 375 time for calcul the mask position with numpy : 0.0025911331176757812 nb_pixel_total : 80106 time to create 1 rle with old method : 0.0991060733795166 length of segment : 334 time for calcul the mask position with numpy : 0.0002455711364746094 nb_pixel_total : 9187 time to create 1 rle with old method : 0.010529041290283203 length of segment : 82 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 45830 time to create 1 rle with old method : 0.0512392520904541 length of segment : 282 time for calcul the mask position with numpy : 0.0019876956939697266 nb_pixel_total : 71124 time to create 1 rle with old method : 0.07705163955688477 length of segment : 330 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 17793 time to create 1 rle with old method : 0.01986074447631836 length of segment : 145 time for calcul the mask position with numpy : 0.0035507678985595703 nb_pixel_total : 166827 time to create 1 rle with new method : 0.010320186614990234 length of segment : 400 time for calcul the mask position with numpy : 0.0011589527130126953 nb_pixel_total : 50613 time to create 1 rle with old method : 0.0553281307220459 length of segment : 204 time for calcul the mask position with numpy : 0.00125885009765625 nb_pixel_total : 38521 time to create 1 rle with old method : 0.04269242286682129 length of segment : 320 time for calcul the mask position with numpy : 0.0034530162811279297 nb_pixel_total : 149098 time to create 1 rle with old method : 0.16377949714660645 length of segment : 431 time for calcul the mask position with numpy : 0.001306295394897461 nb_pixel_total : 1771 time to create 1 rle with old method : 0.0035567283630371094 length of segment : 77 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 36009 time to create 1 rle with old method : 0.04177594184875488 length of segment : 169 time for calcul the mask position with numpy : 0.002157449722290039 nb_pixel_total : 61729 time to create 1 rle with old method : 0.0681157112121582 length of segment : 362 time for calcul the mask position with numpy : 0.0012767314910888672 nb_pixel_total : 47555 time to create 1 rle with old method : 0.052655935287475586 length of segment : 291 time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 19294 time to create 1 rle with old method : 0.021289587020874023 length of segment : 203 time for calcul the mask position with numpy : 0.0015718936920166016 nb_pixel_total : 69929 time to create 1 rle with old method : 0.0771183967590332 length of segment : 427 time for calcul the mask position with numpy : 0.0008208751678466797 nb_pixel_total : 26581 time to create 1 rle with old method : 0.030030488967895508 length of segment : 311 time for calcul the mask position with numpy : 0.00047898292541503906 nb_pixel_total : 15404 time to create 1 rle with old method : 0.017559051513671875 length of segment : 177 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 9286 time to create 1 rle with old method : 0.010498285293579102 length of segment : 94 time for calcul the mask position with numpy : 0.004521846771240234 nb_pixel_total : 173179 time to create 1 rle with new method : 0.01361703872680664 length of segment : 592 time for calcul the mask position with numpy : 0.003910541534423828 nb_pixel_total : 148087 time to create 1 rle with old method : 0.16437673568725586 length of segment : 825 time for calcul the mask position with numpy : 0.007250547409057617 nb_pixel_total : 259298 time to create 1 rle with new method : 0.02679300308227539 length of segment : 476 time for calcul the mask position with numpy : 0.001621246337890625 nb_pixel_total : 58610 time to create 1 rle with old method : 0.06560730934143066 length of segment : 585 time for calcul the mask position with numpy : 0.0012629032135009766 nb_pixel_total : 47675 time to create 1 rle with old method : 0.05463910102844238 length of segment : 212 time for calcul the mask position with numpy : 0.00034546852111816406 nb_pixel_total : 11703 time to create 1 rle with old method : 0.013569831848144531 length of segment : 123 time for calcul the mask position with numpy : 0.0033698081970214844 nb_pixel_total : 110930 time to create 1 rle with old method : 0.12073898315429688 length of segment : 387 time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 30667 time to create 1 rle with old method : 0.03732657432556152 length of segment : 217 time for calcul the mask position with numpy : 0.005548000335693359 nb_pixel_total : 113323 time to create 1 rle with old method : 0.12915301322937012 length of segment : 467 time for calcul the mask position with numpy : 0.0013508796691894531 nb_pixel_total : 66988 time to create 1 rle with old method : 0.0849447250366211 length of segment : 224 time for calcul the mask position with numpy : 0.0007562637329101562 nb_pixel_total : 28455 time to create 1 rle with old method : 0.03243112564086914 length of segment : 138 time for calcul the mask position with numpy : 0.0005896091461181641 nb_pixel_total : 22800 time to create 1 rle with old method : 0.025269746780395508 length of segment : 233 time for calcul the mask position with numpy : 0.0018463134765625 nb_pixel_total : 76179 time to create 1 rle with old method : 0.08479762077331543 length of segment : 370 time for calcul the mask position with numpy : 0.0008752346038818359 nb_pixel_total : 28770 time to create 1 rle with old method : 0.03267407417297363 length of segment : 161 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 7583 time to create 1 rle with old method : 0.008901834487915039 length of segment : 124 time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 9759 time to create 1 rle with old method : 0.011159420013427734 length of segment : 146 time for calcul the mask position with numpy : 0.007964611053466797 nb_pixel_total : 272003 time to create 1 rle with new method : 0.02554917335510254 length of segment : 819 time for calcul the mask position with numpy : 0.0004932880401611328 nb_pixel_total : 20783 time to create 1 rle with old method : 0.023961305618286133 length of segment : 160 time for calcul the mask position with numpy : 0.001501321792602539 nb_pixel_total : 36387 time to create 1 rle with old method : 0.04087018966674805 length of segment : 279 time for calcul the mask position with numpy : 0.0015888214111328125 nb_pixel_total : 59906 time to create 1 rle with old method : 0.06746077537536621 length of segment : 309 time for calcul the mask position with numpy : 0.0016760826110839844 nb_pixel_total : 54835 time to create 1 rle with old method : 0.061174869537353516 length of segment : 257 time for calcul the mask position with numpy : 0.0018761157989501953 nb_pixel_total : 79185 time to create 1 rle with old method : 0.08823060989379883 length of segment : 505 time for calcul the mask position with numpy : 0.0009105205535888672 nb_pixel_total : 43028 time to create 1 rle with old method : 0.04824519157409668 length of segment : 276 time for calcul the mask position with numpy : 0.006907463073730469 nb_pixel_total : 242599 time to create 1 rle with new method : 0.02206110954284668 length of segment : 614 time for calcul the mask position with numpy : 0.0006728172302246094 nb_pixel_total : 24736 time to create 1 rle with old method : 0.028740406036376953 length of segment : 124 time for calcul the mask position with numpy : 0.0033812522888183594 nb_pixel_total : 105921 time to create 1 rle with old method : 0.11789131164550781 length of segment : 467 time for calcul the mask position with numpy : 0.0007157325744628906 nb_pixel_total : 32324 time to create 1 rle with old method : 0.03717923164367676 length of segment : 180 time for calcul the mask position with numpy : 0.0011434555053710938 nb_pixel_total : 28856 time to create 1 rle with old method : 0.03293943405151367 length of segment : 360 time for calcul the mask position with numpy : 0.0010657310485839844 nb_pixel_total : 42678 time to create 1 rle with old method : 0.04875040054321289 length of segment : 163 time for calcul the mask position with numpy : 0.0010693073272705078 nb_pixel_total : 48467 time to create 1 rle with old method : 0.05455207824707031 length of segment : 215 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 40084 time to create 1 rle with old method : 0.04611372947692871 length of segment : 177 time for calcul the mask position with numpy : 0.0027010440826416016 nb_pixel_total : 66508 time to create 1 rle with old method : 0.07837724685668945 length of segment : 388 time for calcul the mask position with numpy : 0.0024433135986328125 nb_pixel_total : 86250 time to create 1 rle with old method : 0.0968775749206543 length of segment : 787 time for calcul the mask position with numpy : 0.0005576610565185547 nb_pixel_total : 27238 time to create 1 rle with old method : 0.030874252319335938 length of segment : 154 time for calcul the mask position with numpy : 0.0007293224334716797 nb_pixel_total : 22796 time to create 1 rle with old method : 0.02617812156677246 length of segment : 169 time for calcul the mask position with numpy : 0.006361246109008789 nb_pixel_total : 329412 time to create 1 rle with new method : 0.01962137222290039 length of segment : 1229 time for calcul the mask position with numpy : 0.0016331672668457031 nb_pixel_total : 69216 time to create 1 rle with old method : 0.07614469528198242 length of segment : 459 time for calcul the mask position with numpy : 0.0024929046630859375 nb_pixel_total : 82771 time to create 1 rle with old method : 0.09546637535095215 length of segment : 494 time for calcul the mask position with numpy : 0.0014984607696533203 nb_pixel_total : 53634 time to create 1 rle with old method : 0.061429500579833984 length of segment : 280 time for calcul the mask position with numpy : 0.0028526782989501953 nb_pixel_total : 70453 time to create 1 rle with old method : 0.08019852638244629 length of segment : 437 time for calcul the mask position with numpy : 0.0024793148040771484 nb_pixel_total : 104256 time to create 1 rle with old method : 0.11615157127380371 length of segment : 403 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 38376 time to create 1 rle with old method : 0.04490470886230469 length of segment : 314 time for calcul the mask position with numpy : 0.0010755062103271484 nb_pixel_total : 40654 time to create 1 rle with old method : 0.0459747314453125 length of segment : 242 time for calcul the mask position with numpy : 0.4885063171386719 nb_pixel_total : 3673723 time to create 1 rle with new method : 1.494267225265503 length of segment : 4092 time for calcul the mask position with numpy : 0.002137899398803711 nb_pixel_total : 125282 time to create 1 rle with old method : 0.13882660865783691 length of segment : 779 time for calcul the mask position with numpy : 0.0016531944274902344 nb_pixel_total : 104487 time to create 1 rle with old method : 0.12274813652038574 length of segment : 420 time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 21594 time to create 1 rle with old method : 0.031049251556396484 length of segment : 191 time for calcul the mask position with numpy : 0.0008518695831298828 nb_pixel_total : 61680 time to create 1 rle with old method : 0.0749971866607666 length of segment : 365 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 68145 time to create 1 rle with old method : 0.07856535911560059 length of segment : 188 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 65377 time to create 1 rle with old method : 0.07299566268920898 length of segment : 368 time spent for convertir_results : 37.594141721725464 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 332 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 109.31063079833984 time spend to save output : 0.19220328330993652 total time spend for step 2 : 109.50283408164978 step3:blur_detection Mon Jul 21 22:44:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 3120) 7007.905668378033 (3120, 3120) 856.7259944935361 (3120, 3120) 3149.626469018654 (3120, 3120) 527.2194357726864 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.017287731170654297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.017101049423217773 save missing photos in datou_result : time spend for datou_step_exec : 1.8061485290527344 time spend to save output : 0.03898000717163086 total time spend for step 3 : 1.8451285362243652 step4:brightness Mon Jul 21 22:44:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753130489_3445111_1373038573_eceb1081575aaea334b4254cd02cbc1a.jpg treat image : temp/1753130489_3445111_1373038569_7ef33562ec48b5a569ddf7e4935ea22a.jpg treat image : temp/1753130489_3445111_1373038568_a399b8de91965e855618959d73fab456.jpg treat image : temp/1753130489_3445111_1373038566_a4c60e01da75b4e423e2198a53115fb4.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.013529539108276367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01198124885559082 save missing photos in datou_result : time spend for datou_step_exec : 4.370667934417725 time spend to save output : 0.029820919036865234 total time spend for step 4 : 4.40048885345459 step5:rle_unique_nms_with_priority Mon Jul 21 22:44:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 332 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 98 nb_hashtags : 9 time to prepare the origin masks : 43.73737692832947 time for calcul the mask position with numpy : 0.752899169921875 nb_pixel_total : 5323285 time to create 1 rle with new method : 1.2111871242523193 time for calcul the mask position with numpy : 0.037515878677368164 nb_pixel_total : 13579 time to create 1 rle with old method : 0.014380216598510742 time for calcul the mask position with numpy : 0.03775477409362793 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.03800511360168457 nb_pixel_total : 88974 time to create 1 rle with old method : 0.09511637687683105 time for calcul the mask position with numpy : 0.0408780574798584 nb_pixel_total : 11163 time to create 1 rle with old method : 0.012743234634399414 time for calcul the mask position with numpy : 0.03883838653564453 nb_pixel_total : 6712 time to create 1 rle with old method : 0.00731968879699707 time for calcul the mask position with numpy : 0.03797483444213867 nb_pixel_total : 10969 time to create 1 rle with old method : 0.011292219161987305 time for calcul the mask position with numpy : 0.03765535354614258 nb_pixel_total : 85964 time to create 1 rle with old method : 0.08948540687561035 time for calcul the mask position with numpy : 0.038732051849365234 nb_pixel_total : 378301 time to create 1 rle with new method : 1.0086016654968262 time for calcul the mask position with numpy : 0.03883957862854004 nb_pixel_total : 124059 time to create 1 rle with old method : 0.1320664882659912 time for calcul the mask position with numpy : 0.03752923011779785 nb_pixel_total : 21769 time to create 1 rle with old method : 0.02258920669555664 time for calcul the mask position with numpy : 0.03792142868041992 nb_pixel_total : 18194 time to create 1 rle with old method : 0.01946234703063965 time for calcul the mask position with numpy : 0.03796100616455078 nb_pixel_total : 26106 time to create 1 rle with old method : 0.027530908584594727 time for calcul the mask position with numpy : 0.03824758529663086 nb_pixel_total : 15353 time to create 1 rle with old method : 0.01690053939819336 time for calcul the mask position with numpy : 0.03987860679626465 nb_pixel_total : 11023 time to create 1 rle with old method : 0.017676353454589844 time for calcul the mask position with numpy : 0.04538226127624512 nb_pixel_total : 46644 time to create 1 rle with old method : 0.05615830421447754 time for calcul the mask position with numpy : 0.04002022743225098 nb_pixel_total : 11361 time to create 1 rle with old method : 0.013299703598022461 time for calcul the mask position with numpy : 0.03924202919006348 nb_pixel_total : 191868 time to create 1 rle with new method : 0.9954814910888672 time for calcul the mask position with numpy : 0.03981900215148926 nb_pixel_total : 236042 time to create 1 rle with new method : 0.9529032707214355 time for calcul the mask position with numpy : 0.03925752639770508 nb_pixel_total : 5790 time to create 1 rle with old method : 0.006383657455444336 time for calcul the mask position with numpy : 0.03889322280883789 nb_pixel_total : 90262 time to create 1 rle with old method : 0.09550690650939941 time for calcul the mask position with numpy : 0.03860640525817871 nb_pixel_total : 51875 time to create 1 rle with old method : 0.05520486831665039 time for calcul the mask position with numpy : 0.03913545608520508 nb_pixel_total : 11166 time to create 1 rle with old method : 0.01176595687866211 time for calcul the mask position with numpy : 0.03912162780761719 nb_pixel_total : 65573 time to create 1 rle with old method : 0.072021484375 time for calcul the mask position with numpy : 0.03807806968688965 nb_pixel_total : 1635 time to create 1 rle with old method : 0.001953125 time for calcul the mask position with numpy : 0.03901195526123047 nb_pixel_total : 30117 time to create 1 rle with old method : 0.031291961669921875 time for calcul the mask position with numpy : 0.03860306739807129 nb_pixel_total : 7402 time to create 1 rle with old method : 0.008039474487304688 time for calcul the mask position with numpy : 0.037904977798461914 nb_pixel_total : 27340 time to create 1 rle with old method : 0.029184579849243164 time for calcul the mask position with numpy : 0.03964066505432129 nb_pixel_total : 101111 time to create 1 rle with old method : 0.11099982261657715 time for calcul the mask position with numpy : 0.03970932960510254 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.039797067642211914 nb_pixel_total : 28723 time to create 1 rle with old method : 0.03174638748168945 time for calcul the mask position with numpy : 0.03974771499633789 nb_pixel_total : 38007 time to create 1 rle with old method : 0.04158473014831543 time for calcul the mask position with numpy : 0.03966116905212402 nb_pixel_total : 61783 time to create 1 rle with old method : 0.0665590763092041 time for calcul the mask position with numpy : 0.03983926773071289 nb_pixel_total : 60308 time to create 1 rle with old method : 0.06475472450256348 time for calcul the mask position with numpy : 0.0404973030090332 nb_pixel_total : 51774 time to create 1 rle with old method : 0.05798172950744629 time for calcul the mask position with numpy : 0.04067111015319824 nb_pixel_total : 13457 time to create 1 rle with old method : 0.015234708786010742 time for calcul the mask position with numpy : 0.04033398628234863 nb_pixel_total : 8761 time to create 1 rle with old method : 0.009812593460083008 time for calcul the mask position with numpy : 0.0436396598815918 nb_pixel_total : 3977 time to create 1 rle with old method : 0.006746053695678711 time for calcul the mask position with numpy : 0.04528093338012695 nb_pixel_total : 66743 time to create 1 rle with old method : 0.07404351234436035 time for calcul the mask position with numpy : 0.04024982452392578 nb_pixel_total : 106995 time to create 1 rle with old method : 0.1162254810333252 time for calcul the mask position with numpy : 0.03862762451171875 nb_pixel_total : 1925 time to create 1 rle with old method : 0.0023572444915771484 time for calcul the mask position with numpy : 0.039357662200927734 nb_pixel_total : 45997 time to create 1 rle with old method : 0.050035953521728516 time for calcul the mask position with numpy : 0.03905487060546875 nb_pixel_total : 1425 time to create 1 rle with old method : 0.0018732547760009766 time for calcul the mask position with numpy : 0.039051055908203125 nb_pixel_total : 34223 time to create 1 rle with old method : 0.036707162857055664 time for calcul the mask position with numpy : 0.03894376754760742 nb_pixel_total : 25413 time to create 1 rle with old method : 0.027550220489501953 time for calcul the mask position with numpy : 0.03860950469970703 nb_pixel_total : 18327 time to create 1 rle with old method : 0.019495248794555664 time for calcul the mask position with numpy : 0.044419050216674805 nb_pixel_total : 110923 time to create 1 rle with old method : 0.13170576095581055 time for calcul the mask position with numpy : 0.03885340690612793 nb_pixel_total : 22081 time to create 1 rle with old method : 0.02376580238342285 time for calcul the mask position with numpy : 0.037769317626953125 nb_pixel_total : 280 time to create 1 rle with old method : 0.000392913818359375 time for calcul the mask position with numpy : 0.03775811195373535 nb_pixel_total : 40043 time to create 1 rle with old method : 0.043169498443603516 time for calcul the mask position with numpy : 0.03925466537475586 nb_pixel_total : 4756 time to create 1 rle with old method : 0.005326509475708008 time for calcul the mask position with numpy : 0.038832664489746094 nb_pixel_total : 107171 time to create 1 rle with old method : 0.11521768569946289 time for calcul the mask position with numpy : 0.03912782669067383 nb_pixel_total : 27748 time to create 1 rle with old method : 0.030295133590698242 time for calcul the mask position with numpy : 0.03845548629760742 nb_pixel_total : 8787 time to create 1 rle with old method : 0.009576082229614258 time for calcul the mask position with numpy : 0.03873920440673828 nb_pixel_total : 12904 time to create 1 rle with old method : 0.013516902923583984 time for calcul the mask position with numpy : 0.03819441795349121 nb_pixel_total : 56863 time to create 1 rle with old method : 0.06078004837036133 time for calcul the mask position with numpy : 0.038887977600097656 nb_pixel_total : 7235 time to create 1 rle with old method : 0.008027076721191406 time for calcul the mask position with numpy : 0.0384213924407959 nb_pixel_total : 16790 time to create 1 rle with old method : 0.017405271530151367 time for calcul the mask position with numpy : 0.03749823570251465 nb_pixel_total : 156 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.03776288032531738 nb_pixel_total : 14499 time to create 1 rle with old method : 0.017299413681030273 time for calcul the mask position with numpy : 0.03874349594116211 nb_pixel_total : 27872 time to create 1 rle with old method : 0.02911972999572754 time for calcul the mask position with numpy : 0.03813338279724121 nb_pixel_total : 46364 time to create 1 rle with old method : 0.04944252967834473 time for calcul the mask position with numpy : 0.03897356986999512 nb_pixel_total : 27810 time to create 1 rle with old method : 0.029683828353881836 time for calcul the mask position with numpy : 0.038815975189208984 nb_pixel_total : 15613 time to create 1 rle with old method : 0.01669478416442871 time for calcul the mask position with numpy : 0.03854966163635254 nb_pixel_total : 31411 time to create 1 rle with old method : 0.03370237350463867 time for calcul the mask position with numpy : 0.03896760940551758 nb_pixel_total : 19303 time to create 1 rle with old method : 0.020834684371948242 time for calcul the mask position with numpy : 0.039353370666503906 nb_pixel_total : 354 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.039437055587768555 nb_pixel_total : 28642 time to create 1 rle with old method : 0.031809091567993164 time for calcul the mask position with numpy : 0.0487065315246582 nb_pixel_total : 24174 time to create 1 rle with old method : 0.027630329132080078 time for calcul the mask position with numpy : 0.04081153869628906 nb_pixel_total : 27506 time to create 1 rle with old method : 0.030551910400390625 time for calcul the mask position with numpy : 0.04289531707763672 nb_pixel_total : 61994 time to create 1 rle with old method : 0.06586837768554688 time for calcul the mask position with numpy : 0.03897380828857422 nb_pixel_total : 23112 time to create 1 rle with old method : 0.025028228759765625 time for calcul the mask position with numpy : 0.03870439529418945 nb_pixel_total : 27578 time to create 1 rle with old method : 0.0299379825592041 time for calcul the mask position with numpy : 0.03893685340881348 nb_pixel_total : 4367 time to create 1 rle with old method : 0.004816293716430664 time for calcul the mask position with numpy : 0.03866410255432129 nb_pixel_total : 49991 time to create 1 rle with old method : 0.05241203308105469 time for calcul the mask position with numpy : 0.037697792053222656 nb_pixel_total : 63891 time to create 1 rle with old method : 0.06487917900085449 time for calcul the mask position with numpy : 0.03903627395629883 nb_pixel_total : 356294 time to create 1 rle with new method : 1.0925331115722656 time for calcul the mask position with numpy : 0.03937125205993652 nb_pixel_total : 103478 time to create 1 rle with old method : 0.10879063606262207 time for calcul the mask position with numpy : 0.03804135322570801 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005116462707519531 time for calcul the mask position with numpy : 0.037799835205078125 nb_pixel_total : 10093 time to create 1 rle with old method : 0.010891199111938477 time for calcul the mask position with numpy : 0.03779101371765137 nb_pixel_total : 12884 time to create 1 rle with old method : 0.013574600219726562 time for calcul the mask position with numpy : 0.03780174255371094 nb_pixel_total : 26194 time to create 1 rle with old method : 0.027309894561767578 time for calcul the mask position with numpy : 0.04479575157165527 nb_pixel_total : 28034 time to create 1 rle with old method : 0.04426980018615723 time for calcul the mask position with numpy : 0.04023313522338867 nb_pixel_total : 27791 time to create 1 rle with old method : 0.031193256378173828 time for calcul the mask position with numpy : 0.044304609298706055 nb_pixel_total : 28565 time to create 1 rle with old method : 0.04567670822143555 time for calcul the mask position with numpy : 0.04045557975769043 nb_pixel_total : 32587 time to create 1 rle with old method : 0.03655123710632324 time for calcul the mask position with numpy : 0.03873896598815918 nb_pixel_total : 10134 time to create 1 rle with old method : 0.01085972785949707 time for calcul the mask position with numpy : 0.03925204277038574 nb_pixel_total : 29695 time to create 1 rle with old method : 0.03238701820373535 time for calcul the mask position with numpy : 0.03983926773071289 nb_pixel_total : 221014 time to create 1 rle with new method : 0.9939608573913574 time for calcul the mask position with numpy : 0.03911924362182617 nb_pixel_total : 63185 time to create 1 rle with old method : 0.07032299041748047 time for calcul the mask position with numpy : 0.038564205169677734 nb_pixel_total : 108405 time to create 1 rle with old method : 0.11253786087036133 time for calcul the mask position with numpy : 0.037723541259765625 nb_pixel_total : 19313 time to create 1 rle with old method : 0.020485639572143555 time for calcul the mask position with numpy : 0.038188934326171875 nb_pixel_total : 55583 time to create 1 rle with old method : 0.05849337577819824 time for calcul the mask position with numpy : 0.03922271728515625 nb_pixel_total : 53775 time to create 1 rle with old method : 0.05834627151489258 time for calcul the mask position with numpy : 0.038970947265625 nb_pixel_total : 21294 time to create 1 rle with old method : 0.022506237030029297 time for calcul the mask position with numpy : 0.03863215446472168 nb_pixel_total : 17794 time to create 1 rle with old method : 0.019019365310668945 time for calcul the mask position with numpy : 0.03966188430786133 nb_pixel_total : 11870 time to create 1 rle with old method : 0.015408515930175781 time for calcul the mask position with numpy : 0.04187607765197754 nb_pixel_total : 1767 time to create 1 rle with old method : 0.003041505813598633 time for calcul the mask position with numpy : 0.047621965408325195 nb_pixel_total : 2332 time to create 1 rle with old method : 0.0041484832763671875 create new chi : 14.381814956665039 time to delete rle : 0.0249786376953125 batch 1 Loaded 99 chid ids of type : 4855 Number RLEs to save : 48746 TO DO : save crop sub photo not yet done ! save time : 2.7631027698516846 nb_obj : 101 nb_hashtags : 12 time to prepare the origin masks : 42.006556034088135 time for calcul the mask position with numpy : 0.06353330612182617 nb_pixel_total : 2748443 time to create 1 rle with new method : 1.098372220993042 time for calcul the mask position with numpy : 0.04011797904968262 nb_pixel_total : 2692 time to create 1 rle with old method : 0.003183126449584961 time for calcul the mask position with numpy : 0.039975881576538086 nb_pixel_total : 38745 time to create 1 rle with old method : 0.04252886772155762 time for calcul the mask position with numpy : 0.04214358329772949 nb_pixel_total : 189817 time to create 1 rle with new method : 1.0431981086730957 time for calcul the mask position with numpy : 0.04094099998474121 nb_pixel_total : 2971 time to create 1 rle with old method : 0.003474712371826172 time for calcul the mask position with numpy : 0.04487442970275879 nb_pixel_total : 128123 time to create 1 rle with old method : 0.14100050926208496 time for calcul the mask position with numpy : 0.040395498275756836 nb_pixel_total : 113354 time to create 1 rle with old method : 0.12440752983093262 time for calcul the mask position with numpy : 0.039947509765625 nb_pixel_total : 3575 time to create 1 rle with old method : 0.0041615962982177734 time for calcul the mask position with numpy : 0.039455413818359375 nb_pixel_total : 12668 time to create 1 rle with old method : 0.013701915740966797 time for calcul the mask position with numpy : 0.03863644599914551 nb_pixel_total : 23341 time to create 1 rle with old method : 0.025470733642578125 time for calcul the mask position with numpy : 0.04127931594848633 nb_pixel_total : 385170 time to create 1 rle with new method : 1.072584629058838 time for calcul the mask position with numpy : 0.04055356979370117 nb_pixel_total : 19521 time to create 1 rle with old method : 0.02200627326965332 time for calcul the mask position with numpy : 0.04234004020690918 nb_pixel_total : 322336 time to create 1 rle with new method : 1.109715461730957 time for calcul the mask position with numpy : 0.038886308670043945 nb_pixel_total : 11522 time to create 1 rle with old method : 0.012798309326171875 time for calcul the mask position with numpy : 0.038832902908325195 nb_pixel_total : 11306 time to create 1 rle with old method : 0.012087821960449219 time for calcul the mask position with numpy : 0.038347721099853516 nb_pixel_total : 7867 time to create 1 rle with old method : 0.008626699447631836 time for calcul the mask position with numpy : 0.03827309608459473 nb_pixel_total : 60941 time to create 1 rle with old method : 0.06381964683532715 time for calcul the mask position with numpy : 0.04395556449890137 nb_pixel_total : 717293 time to create 1 rle with new method : 0.9908015727996826 time for calcul the mask position with numpy : 0.04125046730041504 nb_pixel_total : 58762 time to create 1 rle with old method : 0.06652021408081055 time for calcul the mask position with numpy : 0.04004859924316406 nb_pixel_total : 44800 time to create 1 rle with old method : 0.051798105239868164 time for calcul the mask position with numpy : 0.044509172439575195 nb_pixel_total : 69216 time to create 1 rle with old method : 0.07820248603820801 time for calcul the mask position with numpy : 0.04244852066040039 nb_pixel_total : 45708 time to create 1 rle with old method : 0.05162525177001953 time for calcul the mask position with numpy : 0.04204893112182617 nb_pixel_total : 37493 time to create 1 rle with old method : 0.04300355911254883 time for calcul the mask position with numpy : 0.04095268249511719 nb_pixel_total : 6238 time to create 1 rle with old method : 0.006671905517578125 time for calcul the mask position with numpy : 0.041219234466552734 nb_pixel_total : 6671 time to create 1 rle with old method : 0.0074694156646728516 time for calcul the mask position with numpy : 0.03933119773864746 nb_pixel_total : 30775 time to create 1 rle with old method : 0.03351759910583496 time for calcul the mask position with numpy : 0.04014301300048828 nb_pixel_total : 1758 time to create 1 rle with old method : 0.0019524097442626953 time for calcul the mask position with numpy : 0.04115867614746094 nb_pixel_total : 7884 time to create 1 rle with old method : 0.00865936279296875 time for calcul the mask position with numpy : 0.04239821434020996 nb_pixel_total : 143084 time to create 1 rle with old method : 0.16298675537109375 time for calcul the mask position with numpy : 0.039778709411621094 nb_pixel_total : 90666 time to create 1 rle with old method : 0.10486888885498047 time for calcul the mask position with numpy : 0.04040813446044922 nb_pixel_total : 13995 time to create 1 rle with old method : 0.015145063400268555 time for calcul the mask position with numpy : 0.040947675704956055 nb_pixel_total : 173 time to create 1 rle with old method : 0.0004124641418457031 time for calcul the mask position with numpy : 0.041135549545288086 nb_pixel_total : 814 time to create 1 rle with old method : 0.0011005401611328125 time for calcul the mask position with numpy : 0.039220571517944336 nb_pixel_total : 40565 time to create 1 rle with old method : 0.046311378479003906 time for calcul the mask position with numpy : 0.04010272026062012 nb_pixel_total : 197929 time to create 1 rle with new method : 0.9061777591705322 time for calcul the mask position with numpy : 0.038872718811035156 nb_pixel_total : 5932 time to create 1 rle with old method : 0.006429433822631836 time for calcul the mask position with numpy : 0.03905153274536133 nb_pixel_total : 12307 time to create 1 rle with old method : 0.013620376586914062 time for calcul the mask position with numpy : 0.03937697410583496 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0014483928680419922 time for calcul the mask position with numpy : 0.039988040924072266 nb_pixel_total : 123062 time to create 1 rle with old method : 0.13597321510314941 time for calcul the mask position with numpy : 0.04079699516296387 nb_pixel_total : 93439 time to create 1 rle with old method : 0.10155129432678223 time for calcul the mask position with numpy : 0.039110422134399414 nb_pixel_total : 8004 time to create 1 rle with old method : 0.009086847305297852 time for calcul the mask position with numpy : 0.04085206985473633 nb_pixel_total : 136880 time to create 1 rle with old method : 0.15777277946472168 time for calcul the mask position with numpy : 0.03929853439331055 nb_pixel_total : 35196 time to create 1 rle with old method : 0.03807520866394043 time for calcul the mask position with numpy : 0.03978729248046875 nb_pixel_total : 22681 time to create 1 rle with old method : 0.024978160858154297 time for calcul the mask position with numpy : 0.040136098861694336 nb_pixel_total : 24288 time to create 1 rle with old method : 0.026224851608276367 time for calcul the mask position with numpy : 0.03897261619567871 nb_pixel_total : 31030 time to create 1 rle with old method : 0.03335428237915039 time for calcul the mask position with numpy : 0.039199113845825195 nb_pixel_total : 17139 time to create 1 rle with old method : 0.018866300582885742 time for calcul the mask position with numpy : 0.038667917251586914 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0014688968658447266 time for calcul the mask position with numpy : 0.039969444274902344 nb_pixel_total : 49333 time to create 1 rle with old method : 0.05220746994018555 time for calcul the mask position with numpy : 0.03993988037109375 nb_pixel_total : 17146 time to create 1 rle with old method : 0.019234418869018555 time for calcul the mask position with numpy : 0.03990674018859863 nb_pixel_total : 184147 time to create 1 rle with new method : 0.687082052230835 time for calcul the mask position with numpy : 0.039327144622802734 nb_pixel_total : 84186 time to create 1 rle with old method : 0.09101486206054688 time for calcul the mask position with numpy : 0.039084434509277344 nb_pixel_total : 24779 time to create 1 rle with old method : 0.027277708053588867 time for calcul the mask position with numpy : 0.039644479751586914 nb_pixel_total : 18808 time to create 1 rle with old method : 0.021506309509277344 time for calcul the mask position with numpy : 0.04211544990539551 nb_pixel_total : 307235 time to create 1 rle with new method : 0.7810800075531006 time for calcul the mask position with numpy : 0.04324913024902344 nb_pixel_total : 92585 time to create 1 rle with old method : 0.1017160415649414 time for calcul the mask position with numpy : 0.03954267501831055 nb_pixel_total : 20905 time to create 1 rle with old method : 0.023127079010009766 time for calcul the mask position with numpy : 0.039865970611572266 nb_pixel_total : 106619 time to create 1 rle with old method : 0.11843204498291016 time for calcul the mask position with numpy : 0.039977312088012695 nb_pixel_total : 151776 time to create 1 rle with new method : 0.7843379974365234 time for calcul the mask position with numpy : 0.04003715515136719 nb_pixel_total : 8193 time to create 1 rle with old method : 0.009165048599243164 time for calcul the mask position with numpy : 0.039713144302368164 nb_pixel_total : 25733 time to create 1 rle with old method : 0.029186010360717773 time for calcul the mask position with numpy : 0.039246559143066406 nb_pixel_total : 58712 time to create 1 rle with old method : 0.06450295448303223 time for calcul the mask position with numpy : 0.039237260818481445 nb_pixel_total : 23277 time to create 1 rle with old method : 0.02548384666442871 time for calcul the mask position with numpy : 0.03969001770019531 nb_pixel_total : 198128 time to create 1 rle with new method : 1.3555247783660889 time for calcul the mask position with numpy : 0.049433231353759766 nb_pixel_total : 41708 time to create 1 rle with old method : 0.07099390029907227 time for calcul the mask position with numpy : 0.040494441986083984 nb_pixel_total : 516 time to create 1 rle with old method : 0.0008494853973388672 time for calcul the mask position with numpy : 0.042973995208740234 nb_pixel_total : 22133 time to create 1 rle with old method : 0.028152942657470703 time for calcul the mask position with numpy : 0.04090547561645508 nb_pixel_total : 56475 time to create 1 rle with old method : 0.06263566017150879 time for calcul the mask position with numpy : 0.04068779945373535 nb_pixel_total : 56889 time to create 1 rle with old method : 0.06864023208618164 time for calcul the mask position with numpy : 0.040773868560791016 nb_pixel_total : 18817 time to create 1 rle with old method : 0.020955324172973633 time for calcul the mask position with numpy : 0.041346073150634766 nb_pixel_total : 41451 time to create 1 rle with old method : 0.0470430850982666 time for calcul the mask position with numpy : 0.041979074478149414 nb_pixel_total : 60238 time to create 1 rle with old method : 0.06719303131103516 time for calcul the mask position with numpy : 0.04123568534851074 nb_pixel_total : 13246 time to create 1 rle with old method : 0.021712064743041992 time for calcul the mask position with numpy : 0.045345306396484375 nb_pixel_total : 937 time to create 1 rle with old method : 0.0020515918731689453 time for calcul the mask position with numpy : 0.04090380668640137 nb_pixel_total : 41526 time to create 1 rle with old method : 0.04702639579772949 time for calcul the mask position with numpy : 0.040631771087646484 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002253293991088867 time for calcul the mask position with numpy : 0.04062461853027344 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0014312267303466797 time for calcul the mask position with numpy : 0.039978981018066406 nb_pixel_total : 41427 time to create 1 rle with old method : 0.04604005813598633 time for calcul the mask position with numpy : 0.03984522819519043 nb_pixel_total : 6061 time to create 1 rle with old method : 0.006928205490112305 time for calcul the mask position with numpy : 0.04458212852478027 nb_pixel_total : 636913 time to create 1 rle with new method : 1.1194350719451904 time for calcul the mask position with numpy : 0.04034852981567383 nb_pixel_total : 56109 time to create 1 rle with old method : 0.06253337860107422 time for calcul the mask position with numpy : 0.04062294960021973 nb_pixel_total : 4192 time to create 1 rle with old method : 0.005384683609008789 time for calcul the mask position with numpy : 0.04100227355957031 nb_pixel_total : 119083 time to create 1 rle with old method : 0.13163518905639648 time for calcul the mask position with numpy : 0.04203057289123535 nb_pixel_total : 266816 time to create 1 rle with new method : 0.8215615749359131 time for calcul the mask position with numpy : 0.039838314056396484 nb_pixel_total : 10331 time to create 1 rle with old method : 0.011787891387939453 time for calcul the mask position with numpy : 0.042014122009277344 nb_pixel_total : 238520 time to create 1 rle with new method : 0.9874804019927979 time for calcul the mask position with numpy : 0.04509282112121582 nb_pixel_total : 3333 time to create 1 rle with old method : 0.004033088684082031 time for calcul the mask position with numpy : 0.04172682762145996 nb_pixel_total : 37694 time to create 1 rle with old method : 0.06111431121826172 time for calcul the mask position with numpy : 0.04215574264526367 nb_pixel_total : 13659 time to create 1 rle with old method : 0.015383243560791016 time for calcul the mask position with numpy : 0.04084300994873047 nb_pixel_total : 21544 time to create 1 rle with old method : 0.0241239070892334 time for calcul the mask position with numpy : 0.040604591369628906 nb_pixel_total : 49433 time to create 1 rle with old method : 0.05419111251831055 time for calcul the mask position with numpy : 0.04107809066772461 nb_pixel_total : 89543 time to create 1 rle with old method : 0.09769916534423828 time for calcul the mask position with numpy : 0.04168248176574707 nb_pixel_total : 173919 time to create 1 rle with new method : 0.9791340827941895 time for calcul the mask position with numpy : 0.04042625427246094 nb_pixel_total : 12704 time to create 1 rle with old method : 0.014263391494750977 time for calcul the mask position with numpy : 0.04129171371459961 nb_pixel_total : 2092 time to create 1 rle with old method : 0.0026884078979492188 time for calcul the mask position with numpy : 0.04076838493347168 nb_pixel_total : 50291 time to create 1 rle with old method : 0.05522465705871582 time for calcul the mask position with numpy : 0.04071211814880371 nb_pixel_total : 24757 time to create 1 rle with old method : 0.027420520782470703 time for calcul the mask position with numpy : 0.03966164588928223 nb_pixel_total : 2528 time to create 1 rle with old method : 0.002950429916381836 time for calcul the mask position with numpy : 0.03950834274291992 nb_pixel_total : 11483 time to create 1 rle with old method : 0.012895584106445312 time for calcul the mask position with numpy : 0.039843082427978516 nb_pixel_total : 2664 time to create 1 rle with old method : 0.003131866455078125 time for calcul the mask position with numpy : 0.03992176055908203 nb_pixel_total : 16312 time to create 1 rle with old method : 0.018012046813964844 time for calcul the mask position with numpy : 0.039914846420288086 nb_pixel_total : 5965 time to create 1 rle with old method : 0.0066585540771484375 create new chi : 21.79188871383667 time to delete rle : 0.005418062210083008 batch 1 Loaded 102 chid ids of type : 4855 Number RLEs to save : 55730 TO DO : save crop sub photo not yet done ! save time : 3.1219890117645264 nb_obj : 112 nb_hashtags : 11 time to prepare the origin masks : 62.426552534103394 time for calcul the mask position with numpy : 0.22225117683410645 nb_pixel_total : 3135831 time to create 1 rle with new method : 0.7919526100158691 time for calcul the mask position with numpy : 0.03928494453430176 nb_pixel_total : 2205 time to create 1 rle with old method : 0.0025713443756103516 time for calcul the mask position with numpy : 0.039664268493652344 nb_pixel_total : 14692 time to create 1 rle with old method : 0.016292572021484375 time for calcul the mask position with numpy : 0.039972782135009766 nb_pixel_total : 4952 time to create 1 rle with old method : 0.005736589431762695 time for calcul the mask position with numpy : 0.03975200653076172 nb_pixel_total : 26816 time to create 1 rle with old method : 0.03414416313171387 time for calcul the mask position with numpy : 0.03954052925109863 nb_pixel_total : 696 time to create 1 rle with old method : 0.0010652542114257812 time for calcul the mask position with numpy : 0.03984832763671875 nb_pixel_total : 14072 time to create 1 rle with old method : 0.015807390213012695 time for calcul the mask position with numpy : 0.040724992752075195 nb_pixel_total : 106564 time to create 1 rle with old method : 0.11937546730041504 time for calcul the mask position with numpy : 0.045279741287231445 nb_pixel_total : 955 time to create 1 rle with old method : 0.0017619132995605469 time for calcul the mask position with numpy : 0.04112386703491211 nb_pixel_total : 50305 time to create 1 rle with old method : 0.05558180809020996 time for calcul the mask position with numpy : 0.03951239585876465 nb_pixel_total : 56295 time to create 1 rle with old method : 0.06212449073791504 time for calcul the mask position with numpy : 0.04069995880126953 nb_pixel_total : 162405 time to create 1 rle with new method : 0.6729974746704102 time for calcul the mask position with numpy : 0.039545536041259766 nb_pixel_total : 49603 time to create 1 rle with old method : 0.0550689697265625 time for calcul the mask position with numpy : 0.0391695499420166 nb_pixel_total : 11921 time to create 1 rle with old method : 0.013283252716064453 time for calcul the mask position with numpy : 0.039508819580078125 nb_pixel_total : 127585 time to create 1 rle with old method : 0.13831186294555664 time for calcul the mask position with numpy : 0.03959012031555176 nb_pixel_total : 48994 time to create 1 rle with old method : 0.052637338638305664 time for calcul the mask position with numpy : 0.044516563415527344 nb_pixel_total : 422423 time to create 1 rle with new method : 0.6165246963500977 time for calcul the mask position with numpy : 0.0394132137298584 nb_pixel_total : 51645 time to create 1 rle with old method : 0.056191205978393555 time for calcul the mask position with numpy : 0.03928399085998535 nb_pixel_total : 24037 time to create 1 rle with old method : 0.025389671325683594 time for calcul the mask position with numpy : 0.038571834564208984 nb_pixel_total : 12727 time to create 1 rle with old method : 0.014047622680664062 time for calcul the mask position with numpy : 0.03944206237792969 nb_pixel_total : 43552 time to create 1 rle with old method : 0.0454256534576416 time for calcul the mask position with numpy : 0.038482666015625 nb_pixel_total : 63498 time to create 1 rle with old method : 0.06746959686279297 time for calcul the mask position with numpy : 0.03943228721618652 nb_pixel_total : 109040 time to create 1 rle with old method : 0.12007284164428711 time for calcul the mask position with numpy : 0.03909611701965332 nb_pixel_total : 20684 time to create 1 rle with old method : 0.022131919860839844 time for calcul the mask position with numpy : 0.03811526298522949 nb_pixel_total : 67337 time to create 1 rle with old method : 0.07212376594543457 time for calcul the mask position with numpy : 0.03836846351623535 nb_pixel_total : 23528 time to create 1 rle with old method : 0.025024890899658203 time for calcul the mask position with numpy : 0.03858685493469238 nb_pixel_total : 7142 time to create 1 rle with old method : 0.007707118988037109 time for calcul the mask position with numpy : 0.03877592086791992 nb_pixel_total : 56082 time to create 1 rle with old method : 0.06002330780029297 time for calcul the mask position with numpy : 0.039487600326538086 nb_pixel_total : 146186 time to create 1 rle with old method : 0.15498852729797363 time for calcul the mask position with numpy : 0.043160200119018555 nb_pixel_total : 176025 time to create 1 rle with new method : 0.6843705177307129 time for calcul the mask position with numpy : 0.0393221378326416 nb_pixel_total : 1976 time to create 1 rle with old method : 0.002331972122192383 time for calcul the mask position with numpy : 0.03924250602722168 nb_pixel_total : 267 time to create 1 rle with old method : 0.00039386749267578125 time for calcul the mask position with numpy : 0.03936958312988281 nb_pixel_total : 16360 time to create 1 rle with old method : 0.01798415184020996 time for calcul the mask position with numpy : 0.039200782775878906 nb_pixel_total : 42880 time to create 1 rle with old method : 0.045937538146972656 time for calcul the mask position with numpy : 0.03875541687011719 nb_pixel_total : 4344 time to create 1 rle with old method : 0.004896879196166992 time for calcul the mask position with numpy : 0.04012894630432129 nb_pixel_total : 101759 time to create 1 rle with old method : 0.11382460594177246 time for calcul the mask position with numpy : 0.039771080017089844 nb_pixel_total : 5096 time to create 1 rle with old method : 0.005660533905029297 time for calcul the mask position with numpy : 0.039742231369018555 nb_pixel_total : 166375 time to create 1 rle with new method : 0.6271815299987793 time for calcul the mask position with numpy : 0.03836202621459961 nb_pixel_total : 10557 time to create 1 rle with old method : 0.011575698852539062 time for calcul the mask position with numpy : 0.03861212730407715 nb_pixel_total : 78202 time to create 1 rle with old method : 0.08368563652038574 time for calcul the mask position with numpy : 0.03891396522521973 nb_pixel_total : 59785 time to create 1 rle with old method : 0.06721210479736328 time for calcul the mask position with numpy : 0.038522958755493164 nb_pixel_total : 66540 time to create 1 rle with old method : 0.06997942924499512 time for calcul the mask position with numpy : 0.0384676456451416 nb_pixel_total : 12583 time to create 1 rle with old method : 0.01349782943725586 time for calcul the mask position with numpy : 0.03889584541320801 nb_pixel_total : 22831 time to create 1 rle with old method : 0.02382063865661621 time for calcul the mask position with numpy : 0.040457725524902344 nb_pixel_total : 39056 time to create 1 rle with old method : 0.041098594665527344 time for calcul the mask position with numpy : 0.03798818588256836 nb_pixel_total : 27926 time to create 1 rle with old method : 0.029479026794433594 time for calcul the mask position with numpy : 0.038619041442871094 nb_pixel_total : 37549 time to create 1 rle with old method : 0.03983473777770996 time for calcul the mask position with numpy : 0.03857779502868652 nb_pixel_total : 82890 time to create 1 rle with old method : 0.08767032623291016 time for calcul the mask position with numpy : 0.03894305229187012 nb_pixel_total : 4622 time to create 1 rle with old method : 0.005042076110839844 time for calcul the mask position with numpy : 0.03997492790222168 nb_pixel_total : 236694 time to create 1 rle with new method : 0.6624448299407959 time for calcul the mask position with numpy : 0.03911137580871582 nb_pixel_total : 37271 time to create 1 rle with old method : 0.03952455520629883 time for calcul the mask position with numpy : 0.04018092155456543 nb_pixel_total : 103067 time to create 1 rle with old method : 0.11069440841674805 time for calcul the mask position with numpy : 0.03857302665710449 nb_pixel_total : 7811 time to create 1 rle with old method : 0.00843501091003418 time for calcul the mask position with numpy : 0.0386354923248291 nb_pixel_total : 47230 time to create 1 rle with old method : 0.0496363639831543 time for calcul the mask position with numpy : 0.03840208053588867 nb_pixel_total : 37670 time to create 1 rle with old method : 0.12504315376281738 time for calcul the mask position with numpy : 0.03908038139343262 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.03906559944152832 nb_pixel_total : 15449 time to create 1 rle with old method : 0.01641058921813965 time for calcul the mask position with numpy : 0.03875279426574707 nb_pixel_total : 35887 time to create 1 rle with old method : 0.03811073303222656 time for calcul the mask position with numpy : 0.038675785064697266 nb_pixel_total : 18469 time to create 1 rle with old method : 0.019509315490722656 time for calcul the mask position with numpy : 0.03849315643310547 nb_pixel_total : 22738 time to create 1 rle with old method : 0.024080991744995117 time for calcul the mask position with numpy : 0.03867936134338379 nb_pixel_total : 42507 time to create 1 rle with old method : 0.045073509216308594 time for calcul the mask position with numpy : 0.03853178024291992 nb_pixel_total : 11853 time to create 1 rle with old method : 0.012532711029052734 time for calcul the mask position with numpy : 0.0380091667175293 nb_pixel_total : 76904 time to create 1 rle with old method : 0.08235383033752441 time for calcul the mask position with numpy : 0.03884315490722656 nb_pixel_total : 56170 time to create 1 rle with old method : 0.06038379669189453 time for calcul the mask position with numpy : 0.03948163986206055 nb_pixel_total : 135743 time to create 1 rle with old method : 0.1458570957183838 time for calcul the mask position with numpy : 0.03849506378173828 nb_pixel_total : 21329 time to create 1 rle with old method : 0.023066282272338867 time for calcul the mask position with numpy : 0.039276838302612305 nb_pixel_total : 195141 time to create 1 rle with new method : 0.6739509105682373 time for calcul the mask position with numpy : 0.038692474365234375 nb_pixel_total : 32099 time to create 1 rle with old method : 0.03504514694213867 time for calcul the mask position with numpy : 0.0392763614654541 nb_pixel_total : 5034 time to create 1 rle with old method : 0.0059070587158203125 time for calcul the mask position with numpy : 0.03980684280395508 nb_pixel_total : 174335 time to create 1 rle with new method : 0.7862021923065186 time for calcul the mask position with numpy : 0.03967452049255371 nb_pixel_total : 73644 time to create 1 rle with old method : 0.08066654205322266 time for calcul the mask position with numpy : 0.03934359550476074 nb_pixel_total : 38450 time to create 1 rle with old method : 0.042159080505371094 time for calcul the mask position with numpy : 0.03819441795349121 nb_pixel_total : 143817 time to create 1 rle with old method : 0.15267539024353027 time for calcul the mask position with numpy : 0.037674903869628906 nb_pixel_total : 9126 time to create 1 rle with old method : 0.009477853775024414 time for calcul the mask position with numpy : 0.04012489318847656 nb_pixel_total : 40524 time to create 1 rle with old method : 0.04361224174499512 time for calcul the mask position with numpy : 0.03919482231140137 nb_pixel_total : 2673 time to create 1 rle with old method : 0.003401517868041992 time for calcul the mask position with numpy : 0.03867697715759277 nb_pixel_total : 63972 time to create 1 rle with old method : 0.0695791244506836 time for calcul the mask position with numpy : 0.03907346725463867 nb_pixel_total : 17768 time to create 1 rle with old method : 0.019600629806518555 time for calcul the mask position with numpy : 0.03926205635070801 nb_pixel_total : 24964 time to create 1 rle with old method : 0.026949644088745117 time for calcul the mask position with numpy : 0.038808584213256836 nb_pixel_total : 116861 time to create 1 rle with old method : 0.12577033042907715 time for calcul the mask position with numpy : 0.039261579513549805 nb_pixel_total : 1768 time to create 1 rle with old method : 0.0021049976348876953 time for calcul the mask position with numpy : 0.039426565170288086 nb_pixel_total : 9225 time to create 1 rle with old method : 0.012818574905395508 time for calcul the mask position with numpy : 0.04005789756774902 nb_pixel_total : 27433 time to create 1 rle with old method : 0.029801368713378906 time for calcul the mask position with numpy : 0.03972744941711426 nb_pixel_total : 9236 time to create 1 rle with old method : 0.010196924209594727 time for calcul the mask position with numpy : 0.039296865463256836 nb_pixel_total : 1820 time to create 1 rle with old method : 0.0021507740020751953 time for calcul the mask position with numpy : 0.03929758071899414 nb_pixel_total : 71015 time to create 1 rle with old method : 0.07605934143066406 time for calcul the mask position with numpy : 0.03964877128601074 nb_pixel_total : 19250 time to create 1 rle with old method : 0.02091503143310547 time for calcul the mask position with numpy : 0.038713693618774414 nb_pixel_total : 3321 time to create 1 rle with old method : 0.0039331912994384766 time for calcul the mask position with numpy : 0.039029836654663086 nb_pixel_total : 81963 time to create 1 rle with old method : 0.08652687072753906 time for calcul the mask position with numpy : 0.03879380226135254 nb_pixel_total : 9099 time to create 1 rle with old method : 0.010074138641357422 time for calcul the mask position with numpy : 0.03813672065734863 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005979537963867188 time for calcul the mask position with numpy : 0.03795981407165527 nb_pixel_total : 72885 time to create 1 rle with old method : 0.07561039924621582 time for calcul the mask position with numpy : 0.039435386657714844 nb_pixel_total : 26275 time to create 1 rle with old method : 0.02831721305847168 time for calcul the mask position with numpy : 0.03798556327819824 nb_pixel_total : 7679 time to create 1 rle with old method : 0.008421897888183594 time for calcul the mask position with numpy : 0.03938174247741699 nb_pixel_total : 720 time to create 1 rle with old method : 0.000978231430053711 time for calcul the mask position with numpy : 0.038237571716308594 nb_pixel_total : 19221 time to create 1 rle with old method : 0.019932270050048828 time for calcul the mask position with numpy : 0.03741192817687988 nb_pixel_total : 13186 time to create 1 rle with old method : 0.014496326446533203 time for calcul the mask position with numpy : 0.03910517692565918 nb_pixel_total : 39860 time to create 1 rle with old method : 0.04186201095581055 time for calcul the mask position with numpy : 0.04352903366088867 nb_pixel_total : 690131 time to create 1 rle with new method : 1.153235912322998 time for calcul the mask position with numpy : 0.03836536407470703 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0014743804931640625 time for calcul the mask position with numpy : 0.03835654258728027 nb_pixel_total : 118546 time to create 1 rle with old method : 0.12447237968444824 time for calcul the mask position with numpy : 0.03906702995300293 nb_pixel_total : 79893 time to create 1 rle with old method : 0.08425545692443848 time for calcul the mask position with numpy : 0.03941178321838379 nb_pixel_total : 310669 time to create 1 rle with new method : 0.7691764831542969 time for calcul the mask position with numpy : 0.04030275344848633 nb_pixel_total : 15480 time to create 1 rle with old method : 0.01989150047302246 time for calcul the mask position with numpy : 0.03896355628967285 nb_pixel_total : 55032 time to create 1 rle with old method : 0.05902218818664551 time for calcul the mask position with numpy : 0.04172706604003906 nb_pixel_total : 252644 time to create 1 rle with new method : 0.6973333358764648 time for calcul the mask position with numpy : 0.03938651084899902 nb_pixel_total : 806 time to create 1 rle with old method : 0.0008807182312011719 time for calcul the mask position with numpy : 0.03801107406616211 nb_pixel_total : 10094 time to create 1 rle with old method : 0.011200428009033203 time for calcul the mask position with numpy : 0.03970980644226074 nb_pixel_total : 22882 time to create 1 rle with old method : 0.025102853775024414 time for calcul the mask position with numpy : 0.039588212966918945 nb_pixel_total : 32072 time to create 1 rle with old method : 0.03505373001098633 time for calcul the mask position with numpy : 0.04043984413146973 nb_pixel_total : 58577 time to create 1 rle with old method : 0.0631566047668457 time for calcul the mask position with numpy : 0.038449764251708984 nb_pixel_total : 1763 time to create 1 rle with old method : 0.002074003219604492 time for calcul the mask position with numpy : 0.038013458251953125 nb_pixel_total : 5417 time to create 1 rle with old method : 0.005793571472167969 create new chi : 17.33252716064453 time to delete rle : 0.023760318756103516 batch 1 Loaded 113 chid ids of type : 4855 Number RLEs to save : 58773 TO DO : save crop sub photo not yet done ! save time : 3.2352521419525146 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 12.745357990264893 time for calcul the mask position with numpy : 0.06077146530151367 nb_pixel_total : 2061935 time to create 1 rle with new method : 1.2362139225006104 time for calcul the mask position with numpy : 0.03032374382019043 nb_pixel_total : 765 time to create 1 rle with old method : 0.0008649826049804688 time for calcul the mask position with numpy : 0.030698776245117188 nb_pixel_total : 3971 time to create 1 rle with old method : 0.005887746810913086 time for calcul the mask position with numpy : 0.0387115478515625 nb_pixel_total : 170615 time to create 1 rle with new method : 0.8400156497955322 time for calcul the mask position with numpy : 0.05370306968688965 nb_pixel_total : 1964215 time to create 1 rle with new method : 0.9242935180664062 time for calcul the mask position with numpy : 0.04618072509765625 nb_pixel_total : 15131 time to create 1 rle with old method : 0.01654529571533203 time for calcul the mask position with numpy : 0.0456700325012207 nb_pixel_total : 32036 time to create 1 rle with old method : 0.0343022346496582 time for calcul the mask position with numpy : 0.04501461982727051 nb_pixel_total : 97652 time to create 1 rle with old method : 0.10416483879089355 time for calcul the mask position with numpy : 0.05772662162780762 nb_pixel_total : 1717449 time to create 1 rle with new method : 1.0528225898742676 time for calcul the mask position with numpy : 0.08482551574707031 nb_pixel_total : 3670631 time to create 1 rle with new method : 0.9462785720825195 create new chi : 5.818838596343994 time to delete rle : 0.002488374710083008 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 19907 TO DO : save crop sub photo not yet done ! save time : 1.0204977989196777 map_output_result : {1373038573: (0.6686460365840732, 'Should be the crop_list due to order', 0.5446158893308191), 1373038569: (0.6686460365840732, 'Should be the crop_list due to order', 0.6113001577329265), 1373038568: (0.6686460365840732, 'Should be the crop_list due to order', 0.5366696011058433), 1373038566: (0.6686460365840732, 'Should be the crop_list due to order', 0.9819984981667036)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 4 /1373038573.Didn't retrieve data . /1373038569.Didn't retrieve data . /1373038568.Didn't retrieve data . /1373038566.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.021109819412231445 save_final save missing photos in datou_result : time spend for datou_step_exec : 231.57759594917297 time spend to save output : 0.02227640151977539 total time spend for step 5 : 231.59987235069275 step6:crop_condition Mon Jul 21 22:48:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 324 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3015255 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130911_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 26 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.596152067184448 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130930_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.320226907730103 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3015255 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130950_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 47 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.038645505905151 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130970_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.501329660415649 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130977_3445111 This is a hack ! This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.873847246170044 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3015255 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130982_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 20 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.78514838218689 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130988_3445111 This is a hack ! This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7836759090423584 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753130990_3445111 This is a hack ! This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.9224259853363037 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 3015255 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753131028_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 45 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.680239915847778 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753131053_3445111 This is a hack ! we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6962454319000244 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753131056_3445111 This is a hack ! This is a hack ! we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8509023189544678 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3015255 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753131129_3445111 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 37 photos in the portfolio 3015255 time of upload the photos Elapsed time : 16.42675495147705 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 248 /1373073998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373073999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373074913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373075409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373076184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 748 time used for this insertion : 0.08353590965270996 save_final save missing photos in datou_result : time spend for datou_step_exec : 247.64222145080566 time spend to save output : 0.09022831916809082 total time spend for step 6 : 247.73244976997375 step7:ventilate_hashtags_in_portfolio Mon Jul 21 22:52:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25152624 get user id for portfolio 25152624 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25152624 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25152624 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25152624 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25152624 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/25153828,25153829,25153830,25153831,25153832,25153837,25153839,25153840,25153841,25153842,25153843,25153844,25153846,25153847,25153848,25153849,25153850,25153851,25153852,25153853?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=25152624 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 1 /25152624. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.016220808029174805 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.639667749404907 time spend to save output : 0.016565799713134766 total time spend for step 7 : 5.656233549118042 step8:final Mon Jul 21 22:52:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373038573: ('0.6105678027064919',), 1373038569: ('0.6105678027064919',), 1373038568: ('0.6105678027064919',), 1373038566: ('0.6105678027064919',)} new output for save of step final : {1373038573: ('0.6105678027064919',), 1373038569: ('0.6105678027064919',), 1373038568: ('0.6105678027064919',), 1373038566: ('0.6105678027064919',)} [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 4 /1373038573.Didn't retrieve data . /1373038569.Didn't retrieve data . /1373038568.Didn't retrieve data . /1373038566.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012567996978759766 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1250145435333252 time spend to save output : 0.012997150421142578 total time spend for step 8 : 0.13801169395446777 step9:velours_tree Mon Jul 21 22:52:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.7627627849578857 time spend to save output : 3.4809112548828125e-05 total time spend for step 9 : 0.7627975940704346 step10:send_mail_cod Mon Jul 21 22:52:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25152624_21-07-2025_22_52_33.pdf 25153802 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538021753131153 25153803 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538031753131155 25153804 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538041753131156 25153805 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538051753131158 25153806 change filename to text .change filename to text .imagette251538061753131159 25153807 imagette251538071753131160 25153808 imagette251538081753131160 25153809 imagette251538091753131160 25153810 imagette251538101753131160 25153811 imagette251538111753131160 25153812 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538121753131160 25153813 change filename to text .change filename to text .imagette251538131753131161 25153814 change filename to text .change filename to text .imagette251538141753131161 25153815 imagette251538151753131161 25153816 imagette251538161753131161 25153817 imagette251538171753131161 25153818 imagette251538181753131161 25153819 change filename to text .imagette251538191753131161 25153820 change filename to text .change filename to text .imagette251538201753131161 25153822 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette251538221753131161 25153823 imagette251538231753131163 25153824 imagette251538241753131163 25153825 imagette251538251753131163 25153826 imagette251538261753131163 25153827 imagette251538271753131163 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25152624 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25153828,25153829,25153830,25153831,25153832,25153837,25153839,25153840,25153841,25153842,25153843,25153844,25153846,25153847,25153848,25153849,25153850,25153851,25153852,25153853?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=25152624 your option no_mail is active, we will not send the real mail to your client args[1373038573] : ((1373038573, 7007.905668378033, 492609224), (1373038573, -0.28568525954301677, 496442774), '0.6105678027064919') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1373038569] : ((1373038569, 856.7259944935361, 2107751945), (1373038569, -0.1808306865625784, 496442774), '0.6105678027064919') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1373038568] : ((1373038568, 3149.626469018654, 492609224), (1373038568, -0.22079239683938698, 496442774), '0.6105678027064919') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1373038566] : ((1373038566, 527.2194357726864, 492688767), (1373038566, -0.7144583416060417, 501862349), '0.6105678027064919') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.6105678027064919 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25152624_21-07-2025_22_52_33.pdf results_Auto_P25152624_21-07-2025_22_52_33.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25152624_21-07-2025_22_52_33.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','25152624','results_Auto_P25152624_21-07-2025_22_52_33.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25152624_21-07-2025_22_52_33.pdf','pdf','','1.79','0.6105678027064919') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.014069318771362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.394414186477661 time spend to save output : 0.014313697814941406 total time spend for step 10 : 12.408727884292603 step11:split_time_score Mon Jul 21 22:52:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21072025 25152624 Nombre de photos uploadées : 4 / 23040 (0%) 21072025 25152624 Nombre de photos taguées (types de déchets): 0 / 4 (0%) 21072025 25152624 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0002677440643310547 elapsed_time : insert_dashboard_record_day_entry 0.03303861618041992 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25152623 order by id desc limit 1 Qualite : 0.6105678027064919 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25152624_21-07-2025_22_52_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25152624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25152624 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21072025': {'nb_upload': 4, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373038573, 1373038569, 1373038568, 1373038566] Looping around the photos to save general results len do output : 1 /25152624Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038573', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038569', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038568', None, None, None, None, None, '3316120') ('4741', None, None, None, None, None, None, None, '3316120') ('4741', '25152624', '1373038566', None, None, None, None, None, '3316120') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.015690088272094727 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2080638408660889 time spend to save output : 0.015893220901489258 total time spend for step 11 : 1.2239570617675781 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 414.82user 177.09system 11:21.66elapsed 86%CPU (0avgtext+0avgdata 7176480maxresident)k 1227360inputs+452448outputs (11990major+30561165minor)pagefaults 0swaps