python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 543215 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2807340'] with mtr_portfolio_ids : ['22798155'] and first list_photo_ids : [] new path : /proc/543215/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.3014230728149414 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu May 8 11:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-08 11:41:30.577044: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-08 11:41:30.603143: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-08 11:41:30.604983: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0e6c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-08 11:41:30.605041: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-08 11:41:30.607647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-08 11:41:30.830431: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3d22a140 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-08 11:41:30.830476: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-08 11:41:30.831212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:41:30.831556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:41:30.833643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:41:30.835761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:41:30.836128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:41:30.842634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:41:30.844010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:41:30.849929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:41:30.851750: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:41:30.851851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:41:30.852793: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 11:41:30.852813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 11:41:30.852824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 11:41:30.854787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-08 11:41:31.120828: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:41:31.120957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:41:31.120986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:41:31.121011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:41:31.121035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:41:31.121060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:41:31.121084: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:41:31.121110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:41:31.123261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:41:31.124770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:41:31.124802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:41:31.124817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:41:31.124831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:41:31.124859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:41:31.124874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:41:31.124887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:41:31.124901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:41:31.126120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:41:31.126155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 11:41:31.126164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 11:41:31.126171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 11:41:31.127477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-08 11:41:44.110186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:41:44.299809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.38750 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 543513 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10593 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.00528717041015625 nb_pixel_total : 116663 time to create 1 rle with old method : 0.307797908782959 length of segment : 389 time for calcul the mask position with numpy : 0.005242824554443359 nb_pixel_total : 188114 time to create 1 rle with new method : 0.01758432388305664 length of segment : 465 time for calcul the mask position with numpy : 0.19379544258117676 nb_pixel_total : 1046631 time to create 1 rle with new method : 1.1829042434692383 length of segment : 1126 time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 8681 time to create 1 rle with old method : 0.019145965576171875 length of segment : 134 time for calcul the mask position with numpy : 0.003026723861694336 nb_pixel_total : 90524 time to create 1 rle with old method : 0.1146848201751709 length of segment : 223 time for calcul the mask position with numpy : 0.005002498626708984 nb_pixel_total : 232216 time to create 1 rle with new method : 0.01393270492553711 length of segment : 620 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 10670 time to create 1 rle with old method : 0.012336254119873047 length of segment : 99 time for calcul the mask position with numpy : 0.015318632125854492 nb_pixel_total : 758006 time to create 1 rle with new method : 0.054666996002197266 length of segment : 1079 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 13346 time to create 1 rle with old method : 0.015091419219970703 length of segment : 69 time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 27093 time to create 1 rle with old method : 0.03146767616271973 length of segment : 193 time for calcul the mask position with numpy : 0.0014824867248535156 nb_pixel_total : 50810 time to create 1 rle with old method : 0.05873584747314453 length of segment : 257 time for calcul the mask position with numpy : 0.0011067390441894531 nb_pixel_total : 38436 time to create 1 rle with old method : 0.050031185150146484 length of segment : 560 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 11740 time to create 1 rle with old method : 0.013508081436157227 length of segment : 121 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 9552 time to create 1 rle with old method : 0.011742830276489258 length of segment : 100 time for calcul the mask position with numpy : 0.0011663436889648438 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0018718242645263672 length of segment : 65 time for calcul the mask position with numpy : 0.0012814998626708984 nb_pixel_total : 67043 time to create 1 rle with old method : 0.07609677314758301 length of segment : 318 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 2491 time to create 1 rle with old method : 0.003134012222290039 length of segment : 29 time for calcul the mask position with numpy : 0.0015223026275634766 nb_pixel_total : 69422 time to create 1 rle with old method : 0.07516288757324219 length of segment : 317 time for calcul the mask position with numpy : 0.00013875961303710938 nb_pixel_total : 3720 time to create 1 rle with old method : 0.004540920257568359 length of segment : 42 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 9561 time to create 1 rle with old method : 0.011466503143310547 length of segment : 128 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 2910 time to create 1 rle with old method : 0.003658294677734375 length of segment : 31 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 1821 time to create 1 rle with old method : 0.002499818801879883 length of segment : 46 time for calcul the mask position with numpy : 0.0003654956817626953 nb_pixel_total : 5558 time to create 1 rle with old method : 0.00659489631652832 length of segment : 117 time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 6604 time to create 1 rle with old method : 0.007926702499389648 length of segment : 119 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 8007 time to create 1 rle with old method : 0.009364604949951172 length of segment : 98 time for calcul the mask position with numpy : 0.0004286766052246094 nb_pixel_total : 16067 time to create 1 rle with old method : 0.0234220027923584 length of segment : 196 time for calcul the mask position with numpy : 0.0018305778503417969 nb_pixel_total : 43734 time to create 1 rle with old method : 0.048464298248291016 length of segment : 214 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 19710 time to create 1 rle with old method : 0.021667957305908203 length of segment : 241 time for calcul the mask position with numpy : 0.0034542083740234375 nb_pixel_total : 124011 time to create 1 rle with old method : 0.14351797103881836 length of segment : 388 time for calcul the mask position with numpy : 0.005259513854980469 nb_pixel_total : 154368 time to create 1 rle with new method : 0.0072896480560302734 length of segment : 549 time for calcul the mask position with numpy : 0.0053539276123046875 nb_pixel_total : 110006 time to create 1 rle with old method : 0.13921356201171875 length of segment : 390 time for calcul the mask position with numpy : 0.6879150867462158 nb_pixel_total : 3023434 time to create 1 rle with new method : 0.4054276943206787 length of segment : 1662 time for calcul the mask position with numpy : 0.0011563301086425781 nb_pixel_total : 70068 time to create 1 rle with old method : 0.07887864112854004 length of segment : 270 time for calcul the mask position with numpy : 0.0019540786743164062 nb_pixel_total : 62861 time to create 1 rle with old method : 0.06998324394226074 length of segment : 252 time for calcul the mask position with numpy : 0.003374338150024414 nb_pixel_total : 74660 time to create 1 rle with old method : 0.08411574363708496 length of segment : 526 time for calcul the mask position with numpy : 0.002267122268676758 nb_pixel_total : 78529 time to create 1 rle with old method : 0.09939336776733398 length of segment : 315 time for calcul the mask position with numpy : 0.00844573974609375 nb_pixel_total : 476399 time to create 1 rle with new method : 0.1737971305847168 length of segment : 825 time for calcul the mask position with numpy : 0.001598358154296875 nb_pixel_total : 54700 time to create 1 rle with old method : 0.06277751922607422 length of segment : 194 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 38081 time to create 1 rle with old method : 0.0471041202545166 length of segment : 213 time for calcul the mask position with numpy : 0.0010609626770019531 nb_pixel_total : 26237 time to create 1 rle with old method : 0.030257701873779297 length of segment : 262 time for calcul the mask position with numpy : 0.0028035640716552734 nb_pixel_total : 82323 time to create 1 rle with old method : 0.10179471969604492 length of segment : 427 time for calcul the mask position with numpy : 0.001146554946899414 nb_pixel_total : 42421 time to create 1 rle with old method : 0.04907846450805664 length of segment : 370 time for calcul the mask position with numpy : 0.0063364505767822266 nb_pixel_total : 182159 time to create 1 rle with new method : 0.01119375228881836 length of segment : 458 time for calcul the mask position with numpy : 0.029276132583618164 nb_pixel_total : 1271254 time to create 1 rle with new method : 0.0771176815032959 length of segment : 963 time for calcul the mask position with numpy : 0.0007636547088623047 nb_pixel_total : 8724 time to create 1 rle with old method : 0.009937524795532227 length of segment : 102 time for calcul the mask position with numpy : 0.006589412689208984 nb_pixel_total : 32580 time to create 1 rle with old method : 0.05575680732727051 length of segment : 287 time for calcul the mask position with numpy : 0.0014176368713378906 nb_pixel_total : 48759 time to create 1 rle with old method : 0.06635546684265137 length of segment : 201 time for calcul the mask position with numpy : 0.014127492904663086 nb_pixel_total : 459205 time to create 1 rle with new method : 0.16386008262634277 length of segment : 912 time for calcul the mask position with numpy : 0.0012810230255126953 nb_pixel_total : 42798 time to create 1 rle with old method : 0.05190610885620117 length of segment : 196 time for calcul the mask position with numpy : 0.0013675689697265625 nb_pixel_total : 54013 time to create 1 rle with old method : 0.06225466728210449 length of segment : 173 time for calcul the mask position with numpy : 0.0008697509765625 nb_pixel_total : 46994 time to create 1 rle with old method : 0.05199623107910156 length of segment : 217 time for calcul the mask position with numpy : 0.0003437995910644531 nb_pixel_total : 8424 time to create 1 rle with old method : 0.009693622589111328 length of segment : 92 time for calcul the mask position with numpy : 0.0015254020690917969 nb_pixel_total : 49960 time to create 1 rle with old method : 0.05745863914489746 length of segment : 263 time for calcul the mask position with numpy : 0.0010883808135986328 nb_pixel_total : 30457 time to create 1 rle with old method : 0.05082297325134277 length of segment : 197 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 6652 time to create 1 rle with old method : 0.008188724517822266 length of segment : 72 time for calcul the mask position with numpy : 0.0011556148529052734 nb_pixel_total : 54243 time to create 1 rle with old method : 0.06504273414611816 length of segment : 289 time for calcul the mask position with numpy : 0.00351715087890625 nb_pixel_total : 116917 time to create 1 rle with old method : 0.1410670280456543 length of segment : 370 time for calcul the mask position with numpy : 0.0021257400512695312 nb_pixel_total : 51688 time to create 1 rle with old method : 0.05774879455566406 length of segment : 383 time for calcul the mask position with numpy : 0.003894329071044922 nb_pixel_total : 155043 time to create 1 rle with new method : 0.005591392517089844 length of segment : 469 time for calcul the mask position with numpy : 0.009269237518310547 nb_pixel_total : 451672 time to create 1 rle with new method : 0.012012481689453125 length of segment : 649 time for calcul the mask position with numpy : 0.0017409324645996094 nb_pixel_total : 69153 time to create 1 rle with old method : 0.08188915252685547 length of segment : 276 time for calcul the mask position with numpy : 0.042650461196899414 nb_pixel_total : 1712123 time to create 1 rle with new method : 0.2667388916015625 length of segment : 1028 time for calcul the mask position with numpy : 0.0038607120513916016 nb_pixel_total : 109756 time to create 1 rle with old method : 0.11847901344299316 length of segment : 439 time for calcul the mask position with numpy : 0.0048863887786865234 nb_pixel_total : 216359 time to create 1 rle with new method : 0.007012367248535156 length of segment : 649 time for calcul the mask position with numpy : 0.009946823120117188 nb_pixel_total : 331389 time to create 1 rle with new method : 0.017467737197875977 length of segment : 828 time for calcul the mask position with numpy : 0.0005886554718017578 nb_pixel_total : 7631 time to create 1 rle with old method : 0.010035514831542969 length of segment : 121 time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 13726 time to create 1 rle with old method : 0.015443563461303711 length of segment : 168 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 21128 time to create 1 rle with old method : 0.0232851505279541 length of segment : 223 time for calcul the mask position with numpy : 0.0038003921508789062 nb_pixel_total : 30059 time to create 1 rle with old method : 0.03437471389770508 length of segment : 232 time for calcul the mask position with numpy : 0.00907135009765625 nb_pixel_total : 598194 time to create 1 rle with new method : 0.01968669891357422 length of segment : 689 time for calcul the mask position with numpy : 0.0006518363952636719 nb_pixel_total : 17867 time to create 1 rle with old method : 0.020031452178955078 length of segment : 252 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 21596 time to create 1 rle with old method : 0.024709701538085938 length of segment : 108 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 52485 time to create 1 rle with old method : 0.058834075927734375 length of segment : 217 time for calcul the mask position with numpy : 0.0007131099700927734 nb_pixel_total : 23446 time to create 1 rle with old method : 0.028506994247436523 length of segment : 184 time for calcul the mask position with numpy : 0.0008602142333984375 nb_pixel_total : 33353 time to create 1 rle with old method : 0.037767648696899414 length of segment : 192 time for calcul the mask position with numpy : 0.002646923065185547 nb_pixel_total : 69645 time to create 1 rle with old method : 0.07738661766052246 length of segment : 361 time for calcul the mask position with numpy : 0.007102251052856445 nb_pixel_total : 208170 time to create 1 rle with new method : 0.010164260864257812 length of segment : 647 time for calcul the mask position with numpy : 0.002112865447998047 nb_pixel_total : 60478 time to create 1 rle with old method : 0.06985330581665039 length of segment : 308 time for calcul the mask position with numpy : 0.006394386291503906 nb_pixel_total : 238210 time to create 1 rle with new method : 0.010233163833618164 length of segment : 656 time for calcul the mask position with numpy : 0.44345808029174805 nb_pixel_total : 3413485 time to create 1 rle with new method : 0.3524184226989746 length of segment : 1542 time for calcul the mask position with numpy : 0.0009341239929199219 nb_pixel_total : 32804 time to create 1 rle with old method : 0.042227745056152344 length of segment : 230 time for calcul the mask position with numpy : 0.02055525779724121 nb_pixel_total : 1011086 time to create 1 rle with new method : 0.05934023857116699 length of segment : 1104 time for calcul the mask position with numpy : 0.011445999145507812 nb_pixel_total : 558793 time to create 1 rle with new method : 0.05815291404724121 length of segment : 963 time for calcul the mask position with numpy : 0.002394437789916992 nb_pixel_total : 102821 time to create 1 rle with old method : 0.1199498176574707 length of segment : 400 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 12029 time to create 1 rle with old method : 0.01470804214477539 length of segment : 146 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 19789 time to create 1 rle with old method : 0.024365901947021484 length of segment : 179 time for calcul the mask position with numpy : 0.0006303787231445312 nb_pixel_total : 28927 time to create 1 rle with old method : 0.03528594970703125 length of segment : 180 time for calcul the mask position with numpy : 0.0011138916015625 nb_pixel_total : 27930 time to create 1 rle with old method : 0.034514665603637695 length of segment : 290 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 10836 time to create 1 rle with old method : 0.013341903686523438 length of segment : 88 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 10221 time to create 1 rle with old method : 0.012325763702392578 length of segment : 192 time for calcul the mask position with numpy : 0.0014336109161376953 nb_pixel_total : 41239 time to create 1 rle with old method : 0.04700636863708496 length of segment : 416 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 7311 time to create 1 rle with old method : 0.008719205856323242 length of segment : 177 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 11368 time to create 1 rle with old method : 0.013103485107421875 length of segment : 128 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 3822 time to create 1 rle with old method : 0.004672527313232422 length of segment : 66 time for calcul the mask position with numpy : 0.013756275177001953 nb_pixel_total : 399182 time to create 1 rle with new method : 0.022180557250976562 length of segment : 866 time for calcul the mask position with numpy : 0.0006651878356933594 nb_pixel_total : 20870 time to create 1 rle with old method : 0.02411198616027832 length of segment : 164 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 16805 time to create 1 rle with old method : 0.01917719841003418 length of segment : 155 time for calcul the mask position with numpy : 0.00191497802734375 nb_pixel_total : 58298 time to create 1 rle with old method : 0.07104325294494629 length of segment : 198 time for calcul the mask position with numpy : 0.0013806819915771484 nb_pixel_total : 64823 time to create 1 rle with old method : 0.07375955581665039 length of segment : 251 time for calcul the mask position with numpy : 0.00039887428283691406 nb_pixel_total : 8101 time to create 1 rle with old method : 0.009649991989135742 length of segment : 77 time for calcul the mask position with numpy : 0.0014994144439697266 nb_pixel_total : 54759 time to create 1 rle with old method : 0.06372976303100586 length of segment : 221 time for calcul the mask position with numpy : 0.001241922378540039 nb_pixel_total : 5140 time to create 1 rle with old method : 0.006726264953613281 length of segment : 74 time for calcul the mask position with numpy : 0.003895998001098633 nb_pixel_total : 148135 time to create 1 rle with old method : 0.16810846328735352 length of segment : 370 time for calcul the mask position with numpy : 0.002341032028198242 nb_pixel_total : 44112 time to create 1 rle with old method : 0.05078935623168945 length of segment : 227 time for calcul the mask position with numpy : 0.03404545783996582 nb_pixel_total : 1972099 time to create 1 rle with new method : 0.41074132919311523 length of segment : 3076 time for calcul the mask position with numpy : 0.0204312801361084 nb_pixel_total : 1473440 time to create 1 rle with new method : 0.15332579612731934 length of segment : 3437 time for calcul the mask position with numpy : 0.010816812515258789 nb_pixel_total : 793517 time to create 1 rle with new method : 0.04340982437133789 length of segment : 1242 time for calcul the mask position with numpy : 0.016873836517333984 nb_pixel_total : 1196938 time to create 1 rle with new method : 0.1986856460571289 length of segment : 1063 time for calcul the mask position with numpy : 0.3129754066467285 nb_pixel_total : 3965516 time to create 1 rle with new method : 0.5238683223724365 length of segment : 2972 time for calcul the mask position with numpy : 0.01728534698486328 nb_pixel_total : 669680 time to create 1 rle with new method : 0.10091710090637207 length of segment : 585 time for calcul the mask position with numpy : 0.29972290992736816 nb_pixel_total : 3577551 time to create 1 rle with new method : 0.48638224601745605 length of segment : 1413 time for calcul the mask position with numpy : 0.006696939468383789 nb_pixel_total : 142575 time to create 1 rle with old method : 0.16350483894348145 length of segment : 1620 time for calcul the mask position with numpy : 0.0010585784912109375 nb_pixel_total : 77776 time to create 1 rle with old method : 0.08620119094848633 length of segment : 378 time for calcul the mask position with numpy : 0.14712285995483398 nb_pixel_total : 2725335 time to create 1 rle with new method : 0.45333147048950195 length of segment : 2792 time for calcul the mask position with numpy : 0.001142740249633789 nb_pixel_total : 95401 time to create 1 rle with old method : 0.11544251441955566 length of segment : 336 time spent for convertir_results : 25.594011545181274 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 115 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 82.29992651939392 time spend to save output : 0.12287664413452148 total time spend for step 1 : 82.42280316352844 step2:mask_detect Thu May 8 11:42:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-08 11:42:52.895495: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-08 11:42:52.923057: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-08 11:42:52.925074: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0e6c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-08 11:42:52.925135: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-08 11:42:52.929249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-08 11:42:53.174971: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3dc049d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-08 11:42:53.175026: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-08 11:42:53.176490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:42:53.176959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:42:53.180227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:42:53.186237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:42:53.186656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:42:53.190543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:42:53.192324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:42:53.199183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:42:53.200867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:42:53.200963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:42:53.201709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 11:42:53.201724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 11:42:53.201734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 11:42:53.203060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-08 11:42:53.316646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:42:53.316784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:42:53.316810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:42:53.316834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:42:53.316858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:42:53.316898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:42:53.316922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:42:53.316946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:42:53.318733: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:42:53.320409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 11:42:53.320504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 11:42:53.320523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:42:53.320539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 11:42:53.320555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 11:42:53.320571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 11:42:53.320586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 11:42:53.320602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 11:42:53.321843: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 11:42:53.321880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 11:42:53.321888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 11:42:53.321895: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 11:42:53.323224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-08 11:43:05.177606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 11:43:05.357566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 61 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.38750 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 547085 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0029191970825195312 nb_pixel_total : 79551 time to create 1 rle with old method : 0.09416079521179199 length of segment : 293 time for calcul the mask position with numpy : 0.023978471755981445 nb_pixel_total : 990646 time to create 1 rle with new method : 0.11123228073120117 length of segment : 1127 time for calcul the mask position with numpy : 0.0022652149200439453 nb_pixel_total : 110869 time to create 1 rle with old method : 0.13819551467895508 length of segment : 393 time for calcul the mask position with numpy : 0.0011987686157226562 nb_pixel_total : 65854 time to create 1 rle with old method : 0.07571291923522949 length of segment : 245 time for calcul the mask position with numpy : 0.0052318572998046875 nb_pixel_total : 215042 time to create 1 rle with new method : 0.017697811126708984 length of segment : 415 time for calcul the mask position with numpy : 0.005067586898803711 nb_pixel_total : 215464 time to create 1 rle with new method : 0.013285160064697266 length of segment : 642 time for calcul the mask position with numpy : 0.0015850067138671875 nb_pixel_total : 80826 time to create 1 rle with old method : 0.12063217163085938 length of segment : 347 time for calcul the mask position with numpy : 0.002653837203979492 nb_pixel_total : 112826 time to create 1 rle with old method : 0.12389779090881348 length of segment : 418 time for calcul the mask position with numpy : 0.004767417907714844 nb_pixel_total : 268496 time to create 1 rle with new method : 0.011933088302612305 length of segment : 622 time for calcul the mask position with numpy : 0.005090236663818359 nb_pixel_total : 331340 time to create 1 rle with new method : 0.011615753173828125 length of segment : 579 time for calcul the mask position with numpy : 0.0036835670471191406 nb_pixel_total : 249938 time to create 1 rle with new method : 0.009014606475830078 length of segment : 448 time for calcul the mask position with numpy : 0.0046918392181396484 nb_pixel_total : 253982 time to create 1 rle with new method : 0.014154672622680664 length of segment : 512 time for calcul the mask position with numpy : 0.01886606216430664 nb_pixel_total : 1168972 time to create 1 rle with new method : 0.07900094985961914 length of segment : 1241 time for calcul the mask position with numpy : 0.0005993843078613281 nb_pixel_total : 25033 time to create 1 rle with old method : 0.029092073440551758 length of segment : 144 time for calcul the mask position with numpy : 0.0007371902465820312 nb_pixel_total : 31704 time to create 1 rle with old method : 0.036422014236450195 length of segment : 164 time for calcul the mask position with numpy : 0.0014927387237548828 nb_pixel_total : 92661 time to create 1 rle with old method : 0.1260983943939209 length of segment : 243 time for calcul the mask position with numpy : 0.0028760433197021484 nb_pixel_total : 138328 time to create 1 rle with old method : 0.16504573822021484 length of segment : 460 time for calcul the mask position with numpy : 0.0021181106567382812 nb_pixel_total : 71767 time to create 1 rle with old method : 0.08602380752563477 length of segment : 378 time for calcul the mask position with numpy : 0.0010573863983154297 nb_pixel_total : 44525 time to create 1 rle with old method : 0.05402946472167969 length of segment : 145 time for calcul the mask position with numpy : 0.0014872550964355469 nb_pixel_total : 87055 time to create 1 rle with old method : 0.09522175788879395 length of segment : 274 time for calcul the mask position with numpy : 0.004601478576660156 nb_pixel_total : 203719 time to create 1 rle with new method : 0.013412952423095703 length of segment : 1034 time for calcul the mask position with numpy : 0.0012552738189697266 nb_pixel_total : 83872 time to create 1 rle with old method : 0.09608602523803711 length of segment : 472 time for calcul the mask position with numpy : 0.0017299652099609375 nb_pixel_total : 74375 time to create 1 rle with old method : 0.08440208435058594 length of segment : 362 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 19773 time to create 1 rle with old method : 0.023542165756225586 length of segment : 166 time for calcul the mask position with numpy : 0.0016605854034423828 nb_pixel_total : 82293 time to create 1 rle with old method : 0.09193658828735352 length of segment : 280 time for calcul the mask position with numpy : 0.005392551422119141 nb_pixel_total : 310737 time to create 1 rle with new method : 0.01637864112854004 length of segment : 1650 time for calcul the mask position with numpy : 0.004337310791015625 nb_pixel_total : 299107 time to create 1 rle with new method : 0.010066986083984375 length of segment : 522 time for calcul the mask position with numpy : 0.00043010711669921875 nb_pixel_total : 15418 time to create 1 rle with old method : 0.017194032669067383 length of segment : 158 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 37822 time to create 1 rle with old method : 0.04083967208862305 length of segment : 121 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 57621 time to create 1 rle with old method : 0.07790279388427734 length of segment : 292 time for calcul the mask position with numpy : 0.0012352466583251953 nb_pixel_total : 88187 time to create 1 rle with old method : 0.09883356094360352 length of segment : 237 time for calcul the mask position with numpy : 0.0020551681518554688 nb_pixel_total : 104334 time to create 1 rle with old method : 0.11716818809509277 length of segment : 424 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 32982 time to create 1 rle with old method : 0.037312984466552734 length of segment : 222 time for calcul the mask position with numpy : 0.001611948013305664 nb_pixel_total : 97201 time to create 1 rle with old method : 0.11174321174621582 length of segment : 327 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 78367 time to create 1 rle with old method : 0.08621001243591309 length of segment : 376 time for calcul the mask position with numpy : 0.002184152603149414 nb_pixel_total : 64371 time to create 1 rle with old method : 0.07188868522644043 length of segment : 647 time for calcul the mask position with numpy : 0.0030846595764160156 nb_pixel_total : 211414 time to create 1 rle with new method : 0.0077092647552490234 length of segment : 462 time for calcul the mask position with numpy : 0.002212047576904297 nb_pixel_total : 101039 time to create 1 rle with old method : 0.13753247261047363 length of segment : 350 time for calcul the mask position with numpy : 0.0064699649810791016 nb_pixel_total : 356127 time to create 1 rle with new method : 0.02241230010986328 length of segment : 561 time for calcul the mask position with numpy : 0.003242969512939453 nb_pixel_total : 211887 time to create 1 rle with new method : 0.008917093276977539 length of segment : 520 time for calcul the mask position with numpy : 0.0027992725372314453 nb_pixel_total : 118672 time to create 1 rle with old method : 0.1282947063446045 length of segment : 495 time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 28079 time to create 1 rle with old method : 0.031530141830444336 length of segment : 299 time for calcul the mask position with numpy : 0.0008370876312255859 nb_pixel_total : 17870 time to create 1 rle with old method : 0.019855022430419922 length of segment : 238 time for calcul the mask position with numpy : 0.0024688243865966797 nb_pixel_total : 71146 time to create 1 rle with old method : 0.10845088958740234 length of segment : 311 time for calcul the mask position with numpy : 0.014456987380981445 nb_pixel_total : 645473 time to create 1 rle with new method : 0.09180212020874023 length of segment : 890 time for calcul the mask position with numpy : 0.004739284515380859 nb_pixel_total : 216170 time to create 1 rle with new method : 0.011566162109375 length of segment : 570 time for calcul the mask position with numpy : 0.0023238658905029297 nb_pixel_total : 115849 time to create 1 rle with old method : 0.13253068923950195 length of segment : 605 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 26486 time to create 1 rle with old method : 0.03197884559631348 length of segment : 182 time for calcul the mask position with numpy : 0.0024361610412597656 nb_pixel_total : 95124 time to create 1 rle with old method : 0.11203479766845703 length of segment : 410 time for calcul the mask position with numpy : 0.005971670150756836 nb_pixel_total : 293714 time to create 1 rle with new method : 0.015904903411865234 length of segment : 518 time for calcul the mask position with numpy : 0.012225866317749023 nb_pixel_total : 799831 time to create 1 rle with new method : 0.04154491424560547 length of segment : 1167 time for calcul the mask position with numpy : 0.0014603137969970703 nb_pixel_total : 87105 time to create 1 rle with old method : 0.09769582748413086 length of segment : 208 time for calcul the mask position with numpy : 0.0005915164947509766 nb_pixel_total : 24062 time to create 1 rle with old method : 0.026319503784179688 length of segment : 166 time for calcul the mask position with numpy : 0.0020186901092529297 nb_pixel_total : 82813 time to create 1 rle with old method : 0.0928041934967041 length of segment : 271 time for calcul the mask position with numpy : 0.0007288455963134766 nb_pixel_total : 28552 time to create 1 rle with old method : 0.03168797492980957 length of segment : 211 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 36017 time to create 1 rle with old method : 0.0402984619140625 length of segment : 195 time for calcul the mask position with numpy : 0.0013158321380615234 nb_pixel_total : 86692 time to create 1 rle with old method : 0.09464812278747559 length of segment : 253 time for calcul the mask position with numpy : 0.001968860626220703 nb_pixel_total : 96849 time to create 1 rle with old method : 0.10726046562194824 length of segment : 283 time for calcul the mask position with numpy : 0.0006875991821289062 nb_pixel_total : 29455 time to create 1 rle with old method : 0.03380322456359863 length of segment : 202 time for calcul the mask position with numpy : 0.004796743392944336 nb_pixel_total : 202017 time to create 1 rle with new method : 0.012062788009643555 length of segment : 617 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 31594 time to create 1 rle with old method : 0.03613758087158203 length of segment : 301 time for calcul the mask position with numpy : 0.0008068084716796875 nb_pixel_total : 28151 time to create 1 rle with old method : 0.04831814765930176 length of segment : 125 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 43411 time to create 1 rle with old method : 0.049803972244262695 length of segment : 182 time for calcul the mask position with numpy : 0.003248453140258789 nb_pixel_total : 160394 time to create 1 rle with new method : 0.008733510971069336 length of segment : 376 time for calcul the mask position with numpy : 0.022263526916503906 nb_pixel_total : 833748 time to create 1 rle with new method : 0.2803966999053955 length of segment : 1421 time for calcul the mask position with numpy : 0.0014052391052246094 nb_pixel_total : 50287 time to create 1 rle with old method : 0.07436418533325195 length of segment : 326 time for calcul the mask position with numpy : 0.002622842788696289 nb_pixel_total : 102475 time to create 1 rle with old method : 0.11504673957824707 length of segment : 241 time for calcul the mask position with numpy : 0.010119199752807617 nb_pixel_total : 646459 time to create 1 rle with new method : 0.03512859344482422 length of segment : 598 time for calcul the mask position with numpy : 0.0011467933654785156 nb_pixel_total : 16910 time to create 1 rle with old method : 0.01999807357788086 length of segment : 238 time for calcul the mask position with numpy : 0.002762317657470703 nb_pixel_total : 124963 time to create 1 rle with old method : 0.17012858390808105 length of segment : 401 time for calcul the mask position with numpy : 0.0016543865203857422 nb_pixel_total : 62829 time to create 1 rle with old method : 0.07070207595825195 length of segment : 266 time for calcul the mask position with numpy : 0.008868217468261719 nb_pixel_total : 329001 time to create 1 rle with new method : 0.022759675979614258 length of segment : 917 time for calcul the mask position with numpy : 0.024085283279418945 nb_pixel_total : 604285 time to create 1 rle with new method : 0.3035612106323242 length of segment : 1226 time for calcul the mask position with numpy : 0.0011372566223144531 nb_pixel_total : 62622 time to create 1 rle with old method : 0.06872797012329102 length of segment : 245 time for calcul the mask position with numpy : 0.0014989376068115234 nb_pixel_total : 71146 time to create 1 rle with old method : 0.07724213600158691 length of segment : 295 time for calcul the mask position with numpy : 0.0005118846893310547 nb_pixel_total : 24756 time to create 1 rle with old method : 0.026856184005737305 length of segment : 196 time for calcul the mask position with numpy : 0.0016543865203857422 nb_pixel_total : 70260 time to create 1 rle with old method : 0.07530379295349121 length of segment : 385 time for calcul the mask position with numpy : 0.002560853958129883 nb_pixel_total : 115659 time to create 1 rle with old method : 0.12259912490844727 length of segment : 405 time for calcul the mask position with numpy : 0.009289979934692383 nb_pixel_total : 439838 time to create 1 rle with new method : 0.1777949333190918 length of segment : 549 time for calcul the mask position with numpy : 0.0014138221740722656 nb_pixel_total : 71346 time to create 1 rle with old method : 0.0793304443359375 length of segment : 373 time for calcul the mask position with numpy : 0.0012905597686767578 nb_pixel_total : 58014 time to create 1 rle with old method : 0.06424951553344727 length of segment : 195 time for calcul the mask position with numpy : 0.0009586811065673828 nb_pixel_total : 59906 time to create 1 rle with old method : 0.06611776351928711 length of segment : 224 time for calcul the mask position with numpy : 0.0037207603454589844 nb_pixel_total : 171654 time to create 1 rle with new method : 0.011354207992553711 length of segment : 664 time for calcul the mask position with numpy : 0.0006382465362548828 nb_pixel_total : 23226 time to create 1 rle with old method : 0.026166915893554688 length of segment : 161 time for calcul the mask position with numpy : 0.0020105838775634766 nb_pixel_total : 66644 time to create 1 rle with old method : 0.07887387275695801 length of segment : 359 time for calcul the mask position with numpy : 0.002607107162475586 nb_pixel_total : 128501 time to create 1 rle with old method : 0.14995074272155762 length of segment : 401 time for calcul the mask position with numpy : 0.0034875869750976562 nb_pixel_total : 244923 time to create 1 rle with new method : 0.008198261260986328 length of segment : 260 time for calcul the mask position with numpy : 0.0033910274505615234 nb_pixel_total : 113693 time to create 1 rle with old method : 0.1281871795654297 length of segment : 466 time for calcul the mask position with numpy : 0.005013704299926758 nb_pixel_total : 198237 time to create 1 rle with new method : 0.012245655059814453 length of segment : 752 time for calcul the mask position with numpy : 0.002377748489379883 nb_pixel_total : 94622 time to create 1 rle with old method : 0.10625243186950684 length of segment : 463 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 7632 time to create 1 rle with old method : 0.013453006744384766 length of segment : 275 time for calcul the mask position with numpy : 0.0009369850158691406 nb_pixel_total : 58693 time to create 1 rle with old method : 0.06889772415161133 length of segment : 224 time for calcul the mask position with numpy : 0.0013337135314941406 nb_pixel_total : 9846 time to create 1 rle with old method : 0.013242006301879883 length of segment : 142 time for calcul the mask position with numpy : 0.0064754486083984375 nb_pixel_total : 64412 time to create 1 rle with old method : 0.07597064971923828 length of segment : 566 time for calcul the mask position with numpy : 0.0027556419372558594 nb_pixel_total : 126338 time to create 1 rle with old method : 0.1454787254333496 length of segment : 409 time for calcul the mask position with numpy : 0.0015630722045898438 nb_pixel_total : 69699 time to create 1 rle with old method : 0.07702279090881348 length of segment : 387 time for calcul the mask position with numpy : 0.0046901702880859375 nb_pixel_total : 290763 time to create 1 rle with new method : 0.01204371452331543 length of segment : 516 time for calcul the mask position with numpy : 0.0024614334106445312 nb_pixel_total : 137346 time to create 1 rle with old method : 0.14694476127624512 length of segment : 505 time for calcul the mask position with numpy : 0.0014362335205078125 nb_pixel_total : 58398 time to create 1 rle with old method : 0.06470775604248047 length of segment : 201 time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 51298 time to create 1 rle with old method : 0.05820822715759277 length of segment : 200 time for calcul the mask position with numpy : 0.022823095321655273 nb_pixel_total : 771844 time to create 1 rle with new method : 0.2624092102050781 length of segment : 1664 time for calcul the mask position with numpy : 0.0008814334869384766 nb_pixel_total : 32138 time to create 1 rle with old method : 0.03970694541931152 length of segment : 167 time for calcul the mask position with numpy : 0.013539791107177734 nb_pixel_total : 642888 time to create 1 rle with new method : 0.06383538246154785 length of segment : 1051 time for calcul the mask position with numpy : 0.0012421607971191406 nb_pixel_total : 73215 time to create 1 rle with old method : 0.08029890060424805 length of segment : 250 time for calcul the mask position with numpy : 0.0008287429809570312 nb_pixel_total : 31171 time to create 1 rle with old method : 0.03405880928039551 length of segment : 158 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 53878 time to create 1 rle with old method : 0.08200979232788086 length of segment : 320 time for calcul the mask position with numpy : 0.003156900405883789 nb_pixel_total : 176796 time to create 1 rle with new method : 0.008141279220581055 length of segment : 374 time for calcul the mask position with numpy : 0.001499176025390625 nb_pixel_total : 62538 time to create 1 rle with old method : 0.08273053169250488 length of segment : 412 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 26199 time to create 1 rle with old method : 0.0303802490234375 length of segment : 135 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 37353 time to create 1 rle with old method : 0.04390597343444824 length of segment : 214 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 28683 time to create 1 rle with old method : 0.0338442325592041 length of segment : 175 time for calcul the mask position with numpy : 0.0025680065155029297 nb_pixel_total : 90616 time to create 1 rle with old method : 0.10425782203674316 length of segment : 540 time for calcul the mask position with numpy : 0.002731800079345703 nb_pixel_total : 120414 time to create 1 rle with old method : 0.13625311851501465 length of segment : 397 time for calcul the mask position with numpy : 0.004889011383056641 nb_pixel_total : 227385 time to create 1 rle with new method : 0.014870166778564453 length of segment : 534 time for calcul the mask position with numpy : 0.012912511825561523 nb_pixel_total : 584263 time to create 1 rle with new method : 0.02811598777770996 length of segment : 599 time for calcul the mask position with numpy : 0.004408597946166992 nb_pixel_total : 150668 time to create 1 rle with new method : 0.016337156295776367 length of segment : 481 time for calcul the mask position with numpy : 0.0033292770385742188 nb_pixel_total : 164462 time to create 1 rle with new method : 0.009497880935668945 length of segment : 340 time for calcul the mask position with numpy : 0.000553131103515625 nb_pixel_total : 8832 time to create 1 rle with old method : 0.010629415512084961 length of segment : 209 time for calcul the mask position with numpy : 0.012388467788696289 nb_pixel_total : 532724 time to create 1 rle with new method : 0.033919334411621094 length of segment : 991 time for calcul the mask position with numpy : 0.007330179214477539 nb_pixel_total : 261473 time to create 1 rle with new method : 0.01725602149963379 length of segment : 710 time for calcul the mask position with numpy : 0.016915321350097656 nb_pixel_total : 309851 time to create 1 rle with new method : 0.04250669479370117 length of segment : 659 time for calcul the mask position with numpy : 0.0008025169372558594 nb_pixel_total : 28603 time to create 1 rle with old method : 0.03344869613647461 length of segment : 201 time for calcul the mask position with numpy : 0.0013709068298339844 nb_pixel_total : 58259 time to create 1 rle with old method : 0.0672752857208252 length of segment : 299 time for calcul the mask position with numpy : 0.001583099365234375 nb_pixel_total : 66456 time to create 1 rle with old method : 0.07570719718933105 length of segment : 396 time for calcul the mask position with numpy : 0.009961843490600586 nb_pixel_total : 517406 time to create 1 rle with new method : 0.024028539657592773 length of segment : 705 time for calcul the mask position with numpy : 0.007305145263671875 nb_pixel_total : 255889 time to create 1 rle with new method : 0.02341461181640625 length of segment : 586 time for calcul the mask position with numpy : 0.011545658111572266 nb_pixel_total : 555451 time to create 1 rle with new method : 0.02386307716369629 length of segment : 714 time for calcul the mask position with numpy : 0.004351615905761719 nb_pixel_total : 168185 time to create 1 rle with new method : 0.013409137725830078 length of segment : 660 time for calcul the mask position with numpy : 0.0006844997406005859 nb_pixel_total : 28149 time to create 1 rle with old method : 0.03148651123046875 length of segment : 210 time for calcul the mask position with numpy : 0.0014491081237792969 nb_pixel_total : 49945 time to create 1 rle with old method : 0.0577089786529541 length of segment : 342 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 24414 time to create 1 rle with old method : 0.029189109802246094 length of segment : 282 time for calcul the mask position with numpy : 0.0013616085052490234 nb_pixel_total : 55010 time to create 1 rle with old method : 0.06320452690124512 length of segment : 263 time for calcul the mask position with numpy : 0.0037779808044433594 nb_pixel_total : 170497 time to create 1 rle with new method : 0.010326623916625977 length of segment : 425 time for calcul the mask position with numpy : 0.001390218734741211 nb_pixel_total : 70503 time to create 1 rle with old method : 0.08708572387695312 length of segment : 260 time for calcul the mask position with numpy : 0.0008530616760253906 nb_pixel_total : 27986 time to create 1 rle with old method : 0.033386945724487305 length of segment : 132 time for calcul the mask position with numpy : 0.0007741451263427734 nb_pixel_total : 28783 time to create 1 rle with old method : 0.03409266471862793 length of segment : 160 time for calcul the mask position with numpy : 0.0007615089416503906 nb_pixel_total : 31392 time to create 1 rle with old method : 0.03582596778869629 length of segment : 172 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 21833 time to create 1 rle with old method : 0.02534794807434082 length of segment : 159 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 12328 time to create 1 rle with old method : 0.014585733413696289 length of segment : 116 time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 31622 time to create 1 rle with old method : 0.036620378494262695 length of segment : 149 time for calcul the mask position with numpy : 0.0017130374908447266 nb_pixel_total : 46801 time to create 1 rle with old method : 0.056075096130371094 length of segment : 189 time for calcul the mask position with numpy : 0.0017595291137695312 nb_pixel_total : 78364 time to create 1 rle with old method : 0.1075754165649414 length of segment : 310 time for calcul the mask position with numpy : 0.02554154396057129 nb_pixel_total : 1409239 time to create 1 rle with new method : 0.26310062408447266 length of segment : 1323 time for calcul the mask position with numpy : 0.0010988712310791016 nb_pixel_total : 52593 time to create 1 rle with old method : 0.06456232070922852 length of segment : 149 time for calcul the mask position with numpy : 0.005293130874633789 nb_pixel_total : 165624 time to create 1 rle with new method : 0.017792224884033203 length of segment : 571 time for calcul the mask position with numpy : 0.0031278133392333984 nb_pixel_total : 196180 time to create 1 rle with new method : 0.007992982864379883 length of segment : 506 time for calcul the mask position with numpy : 0.012349128723144531 nb_pixel_total : 465022 time to create 1 rle with new method : 0.07171916961669922 length of segment : 1439 time for calcul the mask position with numpy : 0.002984762191772461 nb_pixel_total : 146655 time to create 1 rle with old method : 0.16008543968200684 length of segment : 632 time for calcul the mask position with numpy : 0.0006692409515380859 nb_pixel_total : 29843 time to create 1 rle with old method : 0.03387713432312012 length of segment : 125 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 51649 time to create 1 rle with old method : 0.05870795249938965 length of segment : 230 time for calcul the mask position with numpy : 0.00479435920715332 nb_pixel_total : 297528 time to create 1 rle with new method : 0.013045310974121094 length of segment : 559 time for calcul the mask position with numpy : 0.0029675960540771484 nb_pixel_total : 143465 time to create 1 rle with old method : 0.15742063522338867 length of segment : 395 time for calcul the mask position with numpy : 0.0037674903869628906 nb_pixel_total : 207580 time to create 1 rle with new method : 0.009739160537719727 length of segment : 521 time for calcul the mask position with numpy : 0.0012402534484863281 nb_pixel_total : 60319 time to create 1 rle with old method : 0.06711912155151367 length of segment : 260 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 27060 time to create 1 rle with old method : 0.030346393585205078 length of segment : 189 time for calcul the mask position with numpy : 0.0013332366943359375 nb_pixel_total : 58330 time to create 1 rle with old method : 0.07554292678833008 length of segment : 245 time for calcul the mask position with numpy : 0.0009138584136962891 nb_pixel_total : 28574 time to create 1 rle with old method : 0.03144669532775879 length of segment : 291 time for calcul the mask position with numpy : 0.005127668380737305 nb_pixel_total : 169362 time to create 1 rle with new method : 0.02109527587890625 length of segment : 862 time for calcul the mask position with numpy : 0.0011837482452392578 nb_pixel_total : 41219 time to create 1 rle with old method : 0.04648423194885254 length of segment : 272 time for calcul the mask position with numpy : 0.0011298656463623047 nb_pixel_total : 60269 time to create 1 rle with old method : 0.06714057922363281 length of segment : 112 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 137646 time to create 1 rle with old method : 0.1494436264038086 length of segment : 379 time for calcul the mask position with numpy : 0.0022094249725341797 nb_pixel_total : 79339 time to create 1 rle with old method : 0.08808565139770508 length of segment : 359 time for calcul the mask position with numpy : 0.0014345645904541016 nb_pixel_total : 84809 time to create 1 rle with old method : 0.09367942810058594 length of segment : 244 time for calcul the mask position with numpy : 0.0017476081848144531 nb_pixel_total : 88667 time to create 1 rle with old method : 0.10222196578979492 length of segment : 265 time for calcul the mask position with numpy : 0.0006012916564941406 nb_pixel_total : 28103 time to create 1 rle with old method : 0.03244328498840332 length of segment : 150 time for calcul the mask position with numpy : 0.0009999275207519531 nb_pixel_total : 50969 time to create 1 rle with old method : 0.05991506576538086 length of segment : 224 time for calcul the mask position with numpy : 0.0008437633514404297 nb_pixel_total : 39478 time to create 1 rle with old method : 0.04347968101501465 length of segment : 247 time for calcul the mask position with numpy : 0.007009983062744141 nb_pixel_total : 458801 time to create 1 rle with new method : 0.01874232292175293 length of segment : 619 time for calcul the mask position with numpy : 0.0005037784576416016 nb_pixel_total : 27686 time to create 1 rle with old method : 0.030311107635498047 length of segment : 182 time for calcul the mask position with numpy : 0.006464719772338867 nb_pixel_total : 292194 time to create 1 rle with new method : 0.01842641830444336 length of segment : 470 time for calcul the mask position with numpy : 0.015737295150756836 nb_pixel_total : 593416 time to create 1 rle with new method : 0.418759822845459 length of segment : 899 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 46766 time to create 1 rle with old method : 0.050817251205444336 length of segment : 258 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 17166 time to create 1 rle with old method : 0.019521474838256836 length of segment : 106 time for calcul the mask position with numpy : 0.0005514621734619141 nb_pixel_total : 27693 time to create 1 rle with old method : 0.03063678741455078 length of segment : 150 time for calcul the mask position with numpy : 0.015468120574951172 nb_pixel_total : 1012595 time to create 1 rle with new method : 0.0623774528503418 length of segment : 690 time for calcul the mask position with numpy : 0.0018994808197021484 nb_pixel_total : 120938 time to create 1 rle with old method : 0.13036060333251953 length of segment : 377 time for calcul the mask position with numpy : 0.00889134407043457 nb_pixel_total : 95693 time to create 1 rle with old method : 0.10372686386108398 length of segment : 1125 time for calcul the mask position with numpy : 0.0006821155548095703 nb_pixel_total : 10634 time to create 1 rle with old method : 0.012741327285766602 length of segment : 225 time for calcul the mask position with numpy : 0.0016372203826904297 nb_pixel_total : 53738 time to create 1 rle with old method : 0.06302642822265625 length of segment : 409 time for calcul the mask position with numpy : 0.00507044792175293 nb_pixel_total : 257057 time to create 1 rle with new method : 0.015117645263671875 length of segment : 667 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 4488 time to create 1 rle with old method : 0.005037546157836914 length of segment : 97 time for calcul the mask position with numpy : 0.0011997222900390625 nb_pixel_total : 51434 time to create 1 rle with old method : 0.05748748779296875 length of segment : 320 time for calcul the mask position with numpy : 0.0021462440490722656 nb_pixel_total : 145221 time to create 1 rle with old method : 0.15468406677246094 length of segment : 363 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 32558 time to create 1 rle with old method : 0.03727245330810547 length of segment : 210 time for calcul the mask position with numpy : 0.002012968063354492 nb_pixel_total : 108704 time to create 1 rle with old method : 0.11744570732116699 length of segment : 287 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 30161 time to create 1 rle with old method : 0.03838992118835449 length of segment : 139 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 15421 time to create 1 rle with old method : 0.01795029640197754 length of segment : 157 time for calcul the mask position with numpy : 0.001947641372680664 nb_pixel_total : 108625 time to create 1 rle with old method : 0.11991763114929199 length of segment : 378 time for calcul the mask position with numpy : 0.002312183380126953 nb_pixel_total : 119409 time to create 1 rle with old method : 0.13546466827392578 length of segment : 406 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 51888 time to create 1 rle with old method : 0.058263540267944336 length of segment : 191 time for calcul the mask position with numpy : 0.0021708011627197266 nb_pixel_total : 114548 time to create 1 rle with old method : 0.12252330780029297 length of segment : 430 time for calcul the mask position with numpy : 0.0025911331176757812 nb_pixel_total : 131795 time to create 1 rle with old method : 0.14267873764038086 length of segment : 414 time for calcul the mask position with numpy : 0.0005242824554443359 nb_pixel_total : 20129 time to create 1 rle with old method : 0.02297043800354004 length of segment : 222 time for calcul the mask position with numpy : 0.002257108688354492 nb_pixel_total : 109141 time to create 1 rle with old method : 0.12070369720458984 length of segment : 385 time for calcul the mask position with numpy : 0.004839658737182617 nb_pixel_total : 303887 time to create 1 rle with new method : 0.011823415756225586 length of segment : 534 time for calcul the mask position with numpy : 0.0020067691802978516 nb_pixel_total : 95680 time to create 1 rle with old method : 0.10545229911804199 length of segment : 373 time for calcul the mask position with numpy : 0.005156517028808594 nb_pixel_total : 303575 time to create 1 rle with new method : 0.012980222702026367 length of segment : 544 time for calcul the mask position with numpy : 0.0019068717956542969 nb_pixel_total : 70065 time to create 1 rle with old method : 0.076568603515625 length of segment : 322 time for calcul the mask position with numpy : 0.002141237258911133 nb_pixel_total : 110035 time to create 1 rle with old method : 0.14670467376708984 length of segment : 329 time for calcul the mask position with numpy : 0.006158113479614258 nb_pixel_total : 172845 time to create 1 rle with new method : 0.020847797393798828 length of segment : 634 time for calcul the mask position with numpy : 0.012253046035766602 nb_pixel_total : 191936 time to create 1 rle with new method : 0.19906258583068848 length of segment : 964 time for calcul the mask position with numpy : 0.0039823055267333984 nb_pixel_total : 208052 time to create 1 rle with new method : 0.011053323745727539 length of segment : 540 time for calcul the mask position with numpy : 0.0031964778900146484 nb_pixel_total : 121675 time to create 1 rle with old method : 0.1318366527557373 length of segment : 369 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 30185 time to create 1 rle with old method : 0.03369736671447754 length of segment : 122 time for calcul the mask position with numpy : 0.0028350353240966797 nb_pixel_total : 160555 time to create 1 rle with new method : 0.008185386657714844 length of segment : 925 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 52196 time to create 1 rle with old method : 0.0746912956237793 length of segment : 211 time for calcul the mask position with numpy : 0.0012171268463134766 nb_pixel_total : 49336 time to create 1 rle with old method : 0.05569624900817871 length of segment : 283 time for calcul the mask position with numpy : 0.017565250396728516 nb_pixel_total : 776137 time to create 1 rle with new method : 0.17342090606689453 length of segment : 1186 time for calcul the mask position with numpy : 0.002537965774536133 nb_pixel_total : 209145 time to create 1 rle with new method : 0.006079912185668945 length of segment : 442 time for calcul the mask position with numpy : 0.001825094223022461 nb_pixel_total : 103942 time to create 1 rle with old method : 0.11052441596984863 length of segment : 332 time for calcul the mask position with numpy : 0.0011548995971679688 nb_pixel_total : 46583 time to create 1 rle with old method : 0.050341129302978516 length of segment : 246 time for calcul the mask position with numpy : 0.0017440319061279297 nb_pixel_total : 99438 time to create 1 rle with old method : 0.11042308807373047 length of segment : 326 time for calcul the mask position with numpy : 0.3149096965789795 nb_pixel_total : 4922797 time to create 1 rle with new method : 0.844045877456665 length of segment : 3990 time for calcul the mask position with numpy : 0.35245680809020996 nb_pixel_total : 3896559 time to create 1 rle with new method : 1.1307194232940674 length of segment : 7480 time for calcul the mask position with numpy : 0.002084970474243164 nb_pixel_total : 156758 time to create 1 rle with new method : 0.005147218704223633 length of segment : 1163 time for calcul the mask position with numpy : 0.0006508827209472656 nb_pixel_total : 46205 time to create 1 rle with old method : 0.05131983757019043 length of segment : 242 time for calcul the mask position with numpy : 0.002143383026123047 nb_pixel_total : 182608 time to create 1 rle with new method : 0.0043528079986572266 length of segment : 340 time for calcul the mask position with numpy : 0.617159366607666 nb_pixel_total : 6565630 time to create 1 rle with new method : 1.1296958923339844 length of segment : 3910 time for calcul the mask position with numpy : 0.010779142379760742 nb_pixel_total : 946391 time to create 1 rle with new method : 0.03948211669921875 length of segment : 789 time for calcul the mask position with numpy : 0.0004220008850097656 nb_pixel_total : 28696 time to create 1 rle with old method : 0.03242373466491699 length of segment : 215 time for calcul the mask position with numpy : 0.005293607711791992 nb_pixel_total : 425398 time to create 1 rle with new method : 0.010965824127197266 length of segment : 380 time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 42966 time to create 1 rle with old method : 0.048192739486694336 length of segment : 139 time for calcul the mask position with numpy : 0.005385637283325195 nb_pixel_total : 478780 time to create 1 rle with new method : 0.010806083679199219 length of segment : 668 time for calcul the mask position with numpy : 0.0019106864929199219 nb_pixel_total : 121407 time to create 1 rle with old method : 0.1367042064666748 length of segment : 341 time spent for convertir_results : 45.4587140083313 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 339 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 122.45809507369995 time spend to save output : 0.19134259223937988 total time spend for step 2 : 122.64943766593933 step3:blur_detection Thu May 8 11:44:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 4160) 1665.0297770114016 (3120, 4160) 2802.69856702639 (3120, 4160) 1629.9502212968766 (3120, 4160) 3074.920909309656 (4160, 3120) 502.2809286577179 (3120, 4160) 799.5705653043344 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.015911102294921875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.012333154678344727 save missing photos in datou_result : time spend for datou_step_exec : 2.8914029598236084 time spend to save output : 0.03319406509399414 total time spend for step 3 : 2.9245970249176025 step4:brightness Thu May 8 11:44:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746697286_543215_1356982997_1191ecb0a2bf05957ef206a19a0b4b27.jpg treat image : temp/1746697286_543215_1356982991_429f186f57306121f2fd388f5a460471.jpg treat image : temp/1746697286_543215_1356982983_86b4aa70cef22e1071fb4dda9159f450.jpg treat image : temp/1746697286_543215_1356982975_aa4696639eff607d5630508ee4d92edc.jpg treat image : temp/1746697286_543215_1356982971_c06f56fbfe7f0fad530ae1f47e12986c.jpg treat image : temp/1746697286_543215_1356982967_084a42cc2ec8a94920bc0285b57a88b1.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.012908458709716797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.012646198272705078 save missing photos in datou_result : time spend for datou_step_exec : 9.299530029296875 time spend to save output : 0.030642271041870117 total time spend for step 4 : 9.330172300338745 step5:rle_unique_nms_with_priority Thu May 8 11:45:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 339 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 66 nb_hashtags : 9 time to prepare the origin masks : 51.567586183547974 time for calcul the mask position with numpy : 1.2553632259368896 nb_pixel_total : 5138610 time to create 1 rle with new method : 1.0131053924560547 time for calcul the mask position with numpy : 0.0541229248046875 nb_pixel_total : 37750 time to create 1 rle with old method : 0.040563106536865234 time for calcul the mask position with numpy : 0.05342602729797363 nb_pixel_total : 206915 time to create 1 rle with new method : 0.9555470943450928 time for calcul the mask position with numpy : 0.054931640625 nb_pixel_total : 204486 time to create 1 rle with new method : 1.0322909355163574 time for calcul the mask position with numpy : 0.05273795127868652 nb_pixel_total : 3398 time to create 1 rle with old method : 0.003947019577026367 time for calcul the mask position with numpy : 0.07846760749816895 nb_pixel_total : 1045609 time to create 1 rle with new method : 0.9510135650634766 time for calcul the mask position with numpy : 0.056375741958618164 nb_pixel_total : 756711 time to create 1 rle with new method : 1.495250940322876 time for calcul the mask position with numpy : 0.054618120193481445 nb_pixel_total : 354765 time to create 1 rle with new method : 0.6539397239685059 time for calcul the mask position with numpy : 0.05432462692260742 nb_pixel_total : 249564 time to create 1 rle with new method : 1.20967435836792 time for calcul the mask position with numpy : 0.0541987419128418 nb_pixel_total : 24891 time to create 1 rle with old method : 0.028095006942749023 time for calcul the mask position with numpy : 0.054467201232910156 nb_pixel_total : 110642 time to create 1 rle with old method : 0.1240229606628418 time for calcul the mask position with numpy : 0.05547285079956055 nb_pixel_total : 268277 time to create 1 rle with new method : 0.9034626483917236 time for calcul the mask position with numpy : 0.053704261779785156 nb_pixel_total : 82039 time to create 1 rle with old method : 0.09593582153320312 time for calcul the mask position with numpy : 0.05425596237182617 nb_pixel_total : 116496 time to create 1 rle with old method : 0.13145971298217773 time for calcul the mask position with numpy : 0.054779767990112305 nb_pixel_total : 5177 time to create 1 rle with old method : 0.0065271854400634766 time for calcul the mask position with numpy : 0.053313255310058594 nb_pixel_total : 117717 time to create 1 rle with old method : 0.13130807876586914 time for calcul the mask position with numpy : 0.053544044494628906 nb_pixel_total : 10632 time to create 1 rle with old method : 0.012100934982299805 time for calcul the mask position with numpy : 0.05394577980041504 nb_pixel_total : 11654 time to create 1 rle with old method : 0.0133819580078125 time for calcul the mask position with numpy : 0.05414438247680664 nb_pixel_total : 65711 time to create 1 rle with old method : 0.07397055625915527 time for calcul the mask position with numpy : 0.054822683334350586 nb_pixel_total : 13160 time to create 1 rle with old method : 0.015621662139892578 time for calcul the mask position with numpy : 0.0539708137512207 nb_pixel_total : 200416 time to create 1 rle with new method : 0.9703493118286133 time for calcul the mask position with numpy : 0.05402255058288574 nb_pixel_total : 138449 time to create 1 rle with old method : 0.16463065147399902 time for calcul the mask position with numpy : 0.054225921630859375 nb_pixel_total : 13227 time to create 1 rle with old method : 0.015050888061523438 time for calcul the mask position with numpy : 0.05376315116882324 nb_pixel_total : 9406 time to create 1 rle with old method : 0.01082921028137207 time for calcul the mask position with numpy : 0.054140329360961914 nb_pixel_total : 111539 time to create 1 rle with old method : 0.12367963790893555 time for calcul the mask position with numpy : 0.05207681655883789 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006804466247558594 time for calcul the mask position with numpy : 0.05319952964782715 nb_pixel_total : 31502 time to create 1 rle with old method : 0.03441047668457031 time for calcul the mask position with numpy : 0.0551912784576416 nb_pixel_total : 187921 time to create 1 rle with new method : 1.7105536460876465 time for calcul the mask position with numpy : 0.05439424514770508 nb_pixel_total : 298672 time to create 1 rle with new method : 0.8822526931762695 time for calcul the mask position with numpy : 0.05440235137939453 nb_pixel_total : 32381 time to create 1 rle with old method : 0.0431828498840332 time for calcul the mask position with numpy : 0.054830074310302734 nb_pixel_total : 1264 time to create 1 rle with old method : 0.0015454292297363281 time for calcul the mask position with numpy : 0.05425620079040527 nb_pixel_total : 215009 time to create 1 rle with new method : 0.9518814086914062 time for calcul the mask position with numpy : 0.05958962440490723 nb_pixel_total : 78042 time to create 1 rle with old method : 0.08829975128173828 time for calcul the mask position with numpy : 0.05371236801147461 nb_pixel_total : 16 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.05391693115234375 nb_pixel_total : 150232 time to create 1 rle with new method : 0.7971551418304443 time for calcul the mask position with numpy : 0.06003904342651367 nb_pixel_total : 820 time to create 1 rle with old method : 0.0022394657135009766 time for calcul the mask position with numpy : 0.05478239059448242 nb_pixel_total : 3696 time to create 1 rle with old method : 0.0043773651123046875 time for calcul the mask position with numpy : 0.05637669563293457 nb_pixel_total : 231738 time to create 1 rle with new method : 1.5247342586517334 time for calcul the mask position with numpy : 0.05284404754638672 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0021886825561523438 time for calcul the mask position with numpy : 0.052172183990478516 nb_pixel_total : 74162 time to create 1 rle with old method : 0.0897834300994873 time for calcul the mask position with numpy : 0.05933690071105957 nb_pixel_total : 989714 time to create 1 rle with new method : 0.9950950145721436 time for calcul the mask position with numpy : 0.05309891700744629 nb_pixel_total : 9522 time to create 1 rle with old method : 0.010834217071533203 time for calcul the mask position with numpy : 0.05375051498413086 nb_pixel_total : 51933 time to create 1 rle with old method : 0.05664539337158203 time for calcul the mask position with numpy : 0.05272674560546875 nb_pixel_total : 11927 time to create 1 rle with old method : 0.013378381729125977 time for calcul the mask position with numpy : 0.05223846435546875 nb_pixel_total : 86769 time to create 1 rle with old method : 0.09815192222595215 time for calcul the mask position with numpy : 0.05381155014038086 nb_pixel_total : 2477 time to create 1 rle with old method : 0.0029151439666748047 time for calcul the mask position with numpy : 0.05272555351257324 nb_pixel_total : 80712 time to create 1 rle with old method : 0.08832907676696777 time for calcul the mask position with numpy : 0.0537724494934082 nb_pixel_total : 98 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.05405735969543457 nb_pixel_total : 43333 time to create 1 rle with old method : 0.04862403869628906 time for calcul the mask position with numpy : 0.05355358123779297 nb_pixel_total : 7851 time to create 1 rle with old method : 0.009241580963134766 time for calcul the mask position with numpy : 0.0563502311706543 nb_pixel_total : 102978 time to create 1 rle with old method : 0.11728715896606445 time for calcul the mask position with numpy : 0.05362820625305176 nb_pixel_total : 8651 time to create 1 rle with old method : 0.009911775588989258 time for calcul the mask position with numpy : 0.05544567108154297 nb_pixel_total : 253347 time to create 1 rle with new method : 0.796107292175293 time for calcul the mask position with numpy : 0.05839347839355469 nb_pixel_total : 45473 time to create 1 rle with old method : 0.051317453384399414 time for calcul the mask position with numpy : 0.05183911323547363 nb_pixel_total : 38375 time to create 1 rle with old method : 0.042432546615600586 time for calcul the mask position with numpy : 0.05516624450683594 nb_pixel_total : 71598 time to create 1 rle with old method : 0.09906983375549316 time for calcul the mask position with numpy : 0.05385994911193848 nb_pixel_total : 79359 time to create 1 rle with old method : 0.08935737609863281 time for calcul the mask position with numpy : 0.05352139472961426 nb_pixel_total : 62897 time to create 1 rle with old method : 0.07146239280700684 time for calcul the mask position with numpy : 0.054483652114868164 nb_pixel_total : 214419 time to create 1 rle with new method : 1.0827057361602783 time for calcul the mask position with numpy : 0.05294656753540039 nb_pixel_total : 19740 time to create 1 rle with old method : 0.02151036262512207 time for calcul the mask position with numpy : 0.05168628692626953 nb_pixel_total : 4574 time to create 1 rle with old method : 0.0051572322845458984 time for calcul the mask position with numpy : 0.052809715270996094 nb_pixel_total : 15284 time to create 1 rle with old method : 0.017993450164794922 time for calcul the mask position with numpy : 0.052826642990112305 nb_pixel_total : 1930 time to create 1 rle with old method : 0.0026688575744628906 time for calcul the mask position with numpy : 0.051680564880371094 nb_pixel_total : 9586 time to create 1 rle with old method : 0.01076197624206543 time for calcul the mask position with numpy : 0.051711320877075195 nb_pixel_total : 90288 time to create 1 rle with old method : 0.09709811210632324 time for calcul the mask position with numpy : 0.05312681198120117 nb_pixel_total : 26959 time to create 1 rle with old method : 0.03084707260131836 time for calcul the mask position with numpy : 0.055346012115478516 nb_pixel_total : 44364 time to create 1 rle with old method : 0.050745248794555664 create new chi : 25.868404865264893 time to delete rle : 0.03462529182434082 batch 1 Loaded 67 chid ids of type : 4855 Number RLEs to save : 44968 TO DO : save crop sub photo not yet done ! save time : 2.868875026702881 nb_obj : 84 nb_hashtags : 11 time to prepare the origin masks : 75.09155774116516 time for calcul the mask position with numpy : 0.36248326301574707 nb_pixel_total : 3936983 time to create 1 rle with new method : 1.601606845855713 time for calcul the mask position with numpy : 0.05092906951904297 nb_pixel_total : 22458 time to create 1 rle with old method : 0.024495840072631836 time for calcul the mask position with numpy : 0.05186915397644043 nb_pixel_total : 40935 time to create 1 rle with old method : 0.042955875396728516 time for calcul the mask position with numpy : 0.04935264587402344 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005044937133789062 time for calcul the mask position with numpy : 0.050183773040771484 nb_pixel_total : 12206 time to create 1 rle with old method : 0.01332855224609375 time for calcul the mask position with numpy : 0.04963994026184082 nb_pixel_total : 31897 time to create 1 rle with old method : 0.038053274154663086 time for calcul the mask position with numpy : 0.0544590950012207 nb_pixel_total : 243948 time to create 1 rle with new method : 1.3475990295410156 time for calcul the mask position with numpy : 0.05434679985046387 nb_pixel_total : 173291 time to create 1 rle with new method : 1.702467441558838 time for calcul the mask position with numpy : 0.05214095115661621 nb_pixel_total : 1471 time to create 1 rle with old method : 0.003183126449584961 time for calcul the mask position with numpy : 0.225020170211792 nb_pixel_total : 3023928 time to create 1 rle with new method : 1.2191343307495117 time for calcul the mask position with numpy : 0.051342010498046875 nb_pixel_total : 16530 time to create 1 rle with old method : 0.01763749122619629 time for calcul the mask position with numpy : 0.051229238510131836 nb_pixel_total : 110856 time to create 1 rle with old method : 0.1223299503326416 time for calcul the mask position with numpy : 0.051520347595214844 nb_pixel_total : 1248 time to create 1 rle with old method : 0.0014400482177734375 time for calcul the mask position with numpy : 0.0520472526550293 nb_pixel_total : 76263 time to create 1 rle with old method : 0.08489513397216797 time for calcul the mask position with numpy : 0.1071629524230957 nb_pixel_total : 597324 time to create 1 rle with new method : 1.5612783432006836 time for calcul the mask position with numpy : 0.05041217803955078 nb_pixel_total : 69905 time to create 1 rle with old method : 0.07674384117126465 time for calcul the mask position with numpy : 0.05367636680603027 nb_pixel_total : 181546 time to create 1 rle with new method : 1.2217371463775635 time for calcul the mask position with numpy : 0.052077531814575195 nb_pixel_total : 4873 time to create 1 rle with old method : 0.006257534027099609 time for calcul the mask position with numpy : 0.0513002872467041 nb_pixel_total : 16780 time to create 1 rle with old method : 0.018566370010375977 time for calcul the mask position with numpy : 0.052069902420043945 nb_pixel_total : 2094 time to create 1 rle with old method : 0.0026845932006835938 time for calcul the mask position with numpy : 0.05105733871459961 nb_pixel_total : 49909 time to create 1 rle with old method : 0.05536079406738281 time for calcul the mask position with numpy : 0.05138397216796875 nb_pixel_total : 69546 time to create 1 rle with old method : 0.07441902160644531 time for calcul the mask position with numpy : 0.05314350128173828 nb_pixel_total : 154114 time to create 1 rle with new method : 1.1151130199432373 time for calcul the mask position with numpy : 0.05225086212158203 nb_pixel_total : 82111 time to create 1 rle with old method : 0.08894705772399902 time for calcul the mask position with numpy : 0.05129075050354004 nb_pixel_total : 2336 time to create 1 rle with old method : 0.0028464794158935547 time for calcul the mask position with numpy : 0.0653831958770752 nb_pixel_total : 48443 time to create 1 rle with old method : 0.052449703216552734 time for calcul the mask position with numpy : 0.0519108772277832 nb_pixel_total : 53 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.05273270606994629 nb_pixel_total : 101529 time to create 1 rle with old method : 0.11108040809631348 time for calcul the mask position with numpy : 0.060688018798828125 nb_pixel_total : 15183 time to create 1 rle with old method : 0.02427053451538086 time for calcul the mask position with numpy : 0.05173802375793457 nb_pixel_total : 26411 time to create 1 rle with old method : 0.0280301570892334 time for calcul the mask position with numpy : 0.05101180076599121 nb_pixel_total : 66751 time to create 1 rle with old method : 0.07098245620727539 time for calcul the mask position with numpy : 0.05226588249206543 nb_pixel_total : 86360 time to create 1 rle with old method : 0.09606432914733887 time for calcul the mask position with numpy : 0.054639339447021484 nb_pixel_total : 42747 time to create 1 rle with old method : 0.0488278865814209 time for calcul the mask position with numpy : 0.059891700744628906 nb_pixel_total : 31559 time to create 1 rle with old method : 0.035109519958496094 time for calcul the mask position with numpy : 0.05451512336730957 nb_pixel_total : 293308 time to create 1 rle with new method : 1.1362104415893555 time for calcul the mask position with numpy : 0.051256656646728516 nb_pixel_total : 3408 time to create 1 rle with old method : 0.004619121551513672 time for calcul the mask position with numpy : 0.05172133445739746 nb_pixel_total : 59084 time to create 1 rle with old method : 0.06418681144714355 time for calcul the mask position with numpy : 0.05122685432434082 nb_pixel_total : 67876 time to create 1 rle with old method : 0.07324886322021484 time for calcul the mask position with numpy : 0.05287504196166992 nb_pixel_total : 197565 time to create 1 rle with new method : 1.1339704990386963 time for calcul the mask position with numpy : 0.05508089065551758 nb_pixel_total : 17440 time to create 1 rle with old method : 0.019753456115722656 time for calcul the mask position with numpy : 0.052826881408691406 nb_pixel_total : 24686 time to create 1 rle with old method : 0.02681756019592285 time for calcul the mask position with numpy : 0.059712886810302734 nb_pixel_total : 40438 time to create 1 rle with old method : 0.04653596878051758 time for calcul the mask position with numpy : 0.05391359329223633 nb_pixel_total : 4865 time to create 1 rle with old method : 0.005821704864501953 time for calcul the mask position with numpy : 0.052295684814453125 nb_pixel_total : 49573 time to create 1 rle with old method : 0.05475449562072754 time for calcul the mask position with numpy : 0.051868438720703125 nb_pixel_total : 35898 time to create 1 rle with old method : 0.03897881507873535 time for calcul the mask position with numpy : 0.05236339569091797 nb_pixel_total : 37972 time to create 1 rle with old method : 0.04269123077392578 time for calcul the mask position with numpy : 0.0528872013092041 nb_pixel_total : 5385 time to create 1 rle with old method : 0.006338596343994141 time for calcul the mask position with numpy : 0.05262136459350586 nb_pixel_total : 4741 time to create 1 rle with old method : 0.005899667739868164 time for calcul the mask position with numpy : 0.05266451835632324 nb_pixel_total : 70940 time to create 1 rle with old method : 0.0783989429473877 time for calcul the mask position with numpy : 0.052048683166503906 nb_pixel_total : 2377 time to create 1 rle with old method : 0.0029649734497070312 time for calcul the mask position with numpy : 0.052486419677734375 nb_pixel_total : 109714 time to create 1 rle with old method : 0.12042641639709473 time for calcul the mask position with numpy : 0.0527036190032959 nb_pixel_total : 8395 time to create 1 rle with old method : 0.009171009063720703 time for calcul the mask position with numpy : 0.05212879180908203 nb_pixel_total : 43322 time to create 1 rle with old method : 0.04595804214477539 time for calcul the mask position with numpy : 0.05091404914855957 nb_pixel_total : 1 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.050459861755371094 nb_pixel_total : 23157 time to create 1 rle with old method : 0.024718523025512695 time for calcul the mask position with numpy : 0.05242276191711426 nb_pixel_total : 62730 time to create 1 rle with old method : 0.06924629211425781 time for calcul the mask position with numpy : 0.05293750762939453 nb_pixel_total : 244 time to create 1 rle with old method : 0.0005271434783935547 time for calcul the mask position with numpy : 0.052800893783569336 nb_pixel_total : 3730 time to create 1 rle with old method : 0.004629611968994141 time for calcul the mask position with numpy : 0.055623769760131836 nb_pixel_total : 123944 time to create 1 rle with old method : 0.1396620273590088 time for calcul the mask position with numpy : 0.053327322006225586 nb_pixel_total : 3798 time to create 1 rle with old method : 0.00470423698425293 time for calcul the mask position with numpy : 0.052373647689819336 nb_pixel_total : 28487 time to create 1 rle with old method : 0.03260540962219238 time for calcul the mask position with numpy : 0.053359031677246094 nb_pixel_total : 1964 time to create 1 rle with old method : 0.0025429725646972656 time for calcul the mask position with numpy : 0.060265541076660156 nb_pixel_total : 718349 time to create 1 rle with new method : 1.5218145847320557 time for calcul the mask position with numpy : 0.05316925048828125 nb_pixel_total : 82557 time to create 1 rle with old method : 0.09107089042663574 time for calcul the mask position with numpy : 0.05294990539550781 nb_pixel_total : 294 time to create 1 rle with old method : 0.0005753040313720703 time for calcul the mask position with numpy : 0.05409669876098633 nb_pixel_total : 58172 time to create 1 rle with old method : 0.0679163932800293 time for calcul the mask position with numpy : 0.05245828628540039 nb_pixel_total : 5004 time to create 1 rle with old method : 0.005952596664428711 time for calcul the mask position with numpy : 0.05467653274536133 nb_pixel_total : 310908 time to create 1 rle with new method : 1.0980224609375 time for calcul the mask position with numpy : 0.05219125747680664 nb_pixel_total : 78185 time to create 1 rle with old method : 0.08524036407470703 time for calcul the mask position with numpy : 0.05329155921936035 nb_pixel_total : 10267 time to create 1 rle with old method : 0.012880086898803711 time for calcul the mask position with numpy : 0.05565166473388672 nb_pixel_total : 26209 time to create 1 rle with old method : 0.02941441535949707 time for calcul the mask position with numpy : 0.055068016052246094 nb_pixel_total : 217383 time to create 1 rle with new method : 1.1402440071105957 time for calcul the mask position with numpy : 0.053235530853271484 nb_pixel_total : 62575 time to create 1 rle with old method : 0.06992626190185547 time for calcul the mask position with numpy : 0.05379295349121094 nb_pixel_total : 133685 time to create 1 rle with old method : 0.14975595474243164 time for calcul the mask position with numpy : 0.05269145965576172 nb_pixel_total : 2303 time to create 1 rle with old method : 0.002899169921875 time for calcul the mask position with numpy : 0.05328965187072754 nb_pixel_total : 70177 time to create 1 rle with old method : 0.07866024971008301 time for calcul the mask position with numpy : 0.05515313148498535 nb_pixel_total : 822 time to create 1 rle with old method : 0.0012323856353759766 time for calcul the mask position with numpy : 0.055299997329711914 nb_pixel_total : 29367 time to create 1 rle with old method : 0.03268313407897949 time for calcul the mask position with numpy : 0.054680824279785156 nb_pixel_total : 102081 time to create 1 rle with old method : 0.12097597122192383 time for calcul the mask position with numpy : 0.062282562255859375 nb_pixel_total : 160052 time to create 1 rle with new method : 1.1461989879608154 time for calcul the mask position with numpy : 0.05561518669128418 nb_pixel_total : 96563 time to create 1 rle with old method : 0.10808849334716797 time for calcul the mask position with numpy : 0.052834510803222656 nb_pixel_total : 5627 time to create 1 rle with old method : 0.006699800491333008 time for calcul the mask position with numpy : 0.05310511589050293 nb_pixel_total : 58 time to create 1 rle with old method : 0.0003724098205566406 time for calcul the mask position with numpy : 0.055043697357177734 nb_pixel_total : 86870 time to create 1 rle with old method : 0.0972592830657959 time for calcul the mask position with numpy : 0.05394482612609863 nb_pixel_total : 54642 time to create 1 rle with old method : 0.0646052360534668 create new chi : 25.937615871429443 time to delete rle : 0.005922794342041016 batch 1 Loaded 85 chid ids of type : 4855 Number RLEs to save : 48395 TO DO : save crop sub photo not yet done ! save time : 2.7028961181640625 nb_obj : 75 nb_hashtags : 9 time to prepare the origin masks : 63.37439227104187 time for calcul the mask position with numpy : 0.5004348754882812 nb_pixel_total : 3877830 time to create 1 rle with new method : 1.6250882148742676 time for calcul the mask position with numpy : 0.052707672119140625 nb_pixel_total : 12317 time to create 1 rle with old method : 0.014237165451049805 time for calcul the mask position with numpy : 0.051978349685668945 nb_pixel_total : 22276 time to create 1 rle with old method : 0.02507305145263672 time for calcul the mask position with numpy : 0.05256295204162598 nb_pixel_total : 10500 time to create 1 rle with old method : 0.011524200439453125 time for calcul the mask position with numpy : 0.0989990234375 nb_pixel_total : 1512574 time to create 1 rle with new method : 1.4402015209197998 time for calcul the mask position with numpy : 0.05187869071960449 nb_pixel_total : 231 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.05430912971496582 nb_pixel_total : 9903 time to create 1 rle with old method : 0.01158285140991211 time for calcul the mask position with numpy : 0.05260777473449707 nb_pixel_total : 17394 time to create 1 rle with old method : 0.0197603702545166 time for calcul the mask position with numpy : 0.05112290382385254 nb_pixel_total : 18035 time to create 1 rle with old method : 0.02088451385498047 time for calcul the mask position with numpy : 0.05296039581298828 nb_pixel_total : 451481 time to create 1 rle with new method : 1.2326712608337402 time for calcul the mask position with numpy : 0.056284427642822266 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.055045366287231445 nb_pixel_total : 9247 time to create 1 rle with old method : 0.011295795440673828 time for calcul the mask position with numpy : 0.05714988708496094 nb_pixel_total : 73670 time to create 1 rle with old method : 0.08014488220214844 time for calcul the mask position with numpy : 0.05231332778930664 nb_pixel_total : 24558 time to create 1 rle with old method : 0.027784109115600586 time for calcul the mask position with numpy : 0.05438995361328125 nb_pixel_total : 309126 time to create 1 rle with new method : 1.194150686264038 time for calcul the mask position with numpy : 0.053334712982177734 nb_pixel_total : 13618 time to create 1 rle with old method : 0.015776872634887695 time for calcul the mask position with numpy : 0.05314755439758301 nb_pixel_total : 6739 time to create 1 rle with old method : 0.008343935012817383 time for calcul the mask position with numpy : 0.05349135398864746 nb_pixel_total : 31475 time to create 1 rle with old method : 0.03545403480529785 time for calcul the mask position with numpy : 0.05261516571044922 nb_pixel_total : 12075 time to create 1 rle with old method : 0.013751983642578125 time for calcul the mask position with numpy : 0.055149078369140625 nb_pixel_total : 28578 time to create 1 rle with old method : 0.030977964401245117 time for calcul the mask position with numpy : 0.052577972412109375 nb_pixel_total : 127309 time to create 1 rle with old method : 0.13689494132995605 time for calcul the mask position with numpy : 0.052114248275756836 nb_pixel_total : 998 time to create 1 rle with old method : 0.001253366470336914 time for calcul the mask position with numpy : 0.053038835525512695 nb_pixel_total : 32690 time to create 1 rle with old method : 0.03660845756530762 time for calcul the mask position with numpy : 0.05184197425842285 nb_pixel_total : 29879 time to create 1 rle with old method : 0.03413796424865723 time for calcul the mask position with numpy : 0.052175283432006836 nb_pixel_total : 7019 time to create 1 rle with old method : 0.00803995132446289 time for calcul the mask position with numpy : 0.05224013328552246 nb_pixel_total : 23067 time to create 1 rle with old method : 0.026139259338378906 time for calcul the mask position with numpy : 0.05323290824890137 nb_pixel_total : 32058 time to create 1 rle with old method : 0.03589010238647461 time for calcul the mask position with numpy : 0.052973270416259766 nb_pixel_total : 23416 time to create 1 rle with old method : 0.026616811752319336 time for calcul the mask position with numpy : 0.05255722999572754 nb_pixel_total : 8866 time to create 1 rle with old method : 0.010236024856567383 time for calcul the mask position with numpy : 0.05333280563354492 nb_pixel_total : 69100 time to create 1 rle with old method : 0.07758927345275879 time for calcul the mask position with numpy : 0.05396556854248047 nb_pixel_total : 154786 time to create 1 rle with new method : 1.5781457424163818 time for calcul the mask position with numpy : 0.05318331718444824 nb_pixel_total : 26135 time to create 1 rle with old method : 0.029979944229125977 time for calcul the mask position with numpy : 0.05338406562805176 nb_pixel_total : 30347 time to create 1 rle with old method : 0.03418087959289551 time for calcul the mask position with numpy : 0.052935123443603516 nb_pixel_total : 12293 time to create 1 rle with old method : 0.013879776000976562 time for calcul the mask position with numpy : 0.053449392318725586 nb_pixel_total : 13697 time to create 1 rle with old method : 0.015360593795776367 time for calcul the mask position with numpy : 0.0537724494934082 nb_pixel_total : 70416 time to create 1 rle with old method : 0.07969546318054199 time for calcul the mask position with numpy : 0.054784297943115234 nb_pixel_total : 215555 time to create 1 rle with new method : 1.8752357959747314 time for calcul the mask position with numpy : 0.06349635124206543 nb_pixel_total : 150265 time to create 1 rle with new method : 1.03623628616333 time for calcul the mask position with numpy : 0.05348825454711914 nb_pixel_total : 29829 time to create 1 rle with old method : 0.033312320709228516 time for calcul the mask position with numpy : 0.054775238037109375 nb_pixel_total : 329739 time to create 1 rle with new method : 0.9945285320281982 time for calcul the mask position with numpy : 0.05382370948791504 nb_pixel_total : 120076 time to create 1 rle with old method : 0.13372063636779785 time for calcul the mask position with numpy : 0.0522613525390625 nb_pixel_total : 8703 time to create 1 rle with old method : 0.009833097457885742 time for calcul the mask position with numpy : 0.05205702781677246 nb_pixel_total : 53805 time to create 1 rle with old method : 0.061556100845336914 time for calcul the mask position with numpy : 0.054465293884277344 nb_pixel_total : 96052 time to create 1 rle with old method : 0.11129975318908691 time for calcul the mask position with numpy : 0.05391645431518555 nb_pixel_total : 51657 time to create 1 rle with old method : 0.05829334259033203 time for calcul the mask position with numpy : 0.05170178413391113 nb_pixel_total : 2329 time to create 1 rle with old method : 0.002824068069458008 time for calcul the mask position with numpy : 0.0523989200592041 nb_pixel_total : 58252 time to create 1 rle with old method : 0.06559872627258301 time for calcul the mask position with numpy : 0.05361199378967285 nb_pixel_total : 20888 time to create 1 rle with old method : 0.17603087425231934 time for calcul the mask position with numpy : 0.05533289909362793 nb_pixel_total : 90530 time to create 1 rle with old method : 0.10239362716674805 time for calcul the mask position with numpy : 0.05379676818847656 nb_pixel_total : 37143 time to create 1 rle with old method : 0.04236483573913574 time for calcul the mask position with numpy : 0.05350327491760254 nb_pixel_total : 39469 time to create 1 rle with old method : 0.04394936561584473 time for calcul the mask position with numpy : 0.05515766143798828 nb_pixel_total : 642113 time to create 1 rle with new method : 0.9753456115722656 time for calcul the mask position with numpy : 0.05610156059265137 nb_pixel_total : 516450 time to create 1 rle with new method : 1.0249345302581787 time for calcul the mask position with numpy : 0.05215573310852051 nb_pixel_total : 52310 time to create 1 rle with old method : 0.06543111801147461 time for calcul the mask position with numpy : 0.06085801124572754 nb_pixel_total : 17856 time to create 1 rle with old method : 0.019937992095947266 time for calcul the mask position with numpy : 0.05150437355041504 nb_pixel_total : 116499 time to create 1 rle with old method : 0.1261441707611084 time for calcul the mask position with numpy : 0.05406689643859863 nb_pixel_total : 51496 time to create 1 rle with old method : 0.05927705764770508 time for calcul the mask position with numpy : 0.053261756896972656 nb_pixel_total : 37221 time to create 1 rle with old method : 0.04587364196777344 time for calcul the mask position with numpy : 0.0574793815612793 nb_pixel_total : 532058 time to create 1 rle with new method : 1.110654354095459 time for calcul the mask position with numpy : 0.05237865447998047 nb_pixel_total : 62430 time to create 1 rle with old method : 0.07039999961853027 time for calcul the mask position with numpy : 0.0523228645324707 nb_pixel_total : 72991 time to create 1 rle with old method : 0.08084225654602051 time for calcul the mask position with numpy : 0.05187726020812988 nb_pixel_total : 63926 time to create 1 rle with old method : 0.07097077369689941 time for calcul the mask position with numpy : 0.05269932746887207 nb_pixel_total : 203502 time to create 1 rle with new method : 0.9152705669403076 time for calcul the mask position with numpy : 0.051085710525512695 nb_pixel_total : 2782 time to create 1 rle with old method : 0.0037560462951660156 time for calcul the mask position with numpy : 0.05084729194641113 nb_pixel_total : 25606 time to create 1 rle with old method : 0.027806758880615234 time for calcul the mask position with numpy : 0.05093884468078613 nb_pixel_total : 68897 time to create 1 rle with old method : 0.07626867294311523 time for calcul the mask position with numpy : 0.05255722999572754 nb_pixel_total : 109506 time to create 1 rle with old method : 0.12485551834106445 time for calcul the mask position with numpy : 0.056258440017700195 nb_pixel_total : 98836 time to create 1 rle with old method : 0.12184453010559082 time for calcul the mask position with numpy : 0.05408167839050293 nb_pixel_total : 226423 time to create 1 rle with new method : 1.149714708328247 time for calcul the mask position with numpy : 0.06930088996887207 nb_pixel_total : 1086989 time to create 1 rle with new method : 1.2012245655059814 time for calcul the mask position with numpy : 0.05356884002685547 nb_pixel_total : 107711 time to create 1 rle with old method : 0.12058305740356445 time for calcul the mask position with numpy : 0.053595542907714844 nb_pixel_total : 28112 time to create 1 rle with old method : 0.032131195068359375 time for calcul the mask position with numpy : 0.05350542068481445 nb_pixel_total : 28547 time to create 1 rle with old method : 0.031731367111206055 time for calcul the mask position with numpy : 0.05359387397766113 nb_pixel_total : 176380 time to create 1 rle with new method : 1.1241259574890137 time for calcul the mask position with numpy : 0.05441570281982422 nb_pixel_total : 164246 time to create 1 rle with new method : 1.248558521270752 time for calcul the mask position with numpy : 0.05216026306152344 nb_pixel_total : 78171 time to create 1 rle with old method : 0.10374808311462402 create new chi : 27.90869426727295 time to delete rle : 0.00618743896484375 batch 1 Loaded 76 chid ids of type : 4855 Number RLEs to save : 48380 TO DO : save crop sub photo not yet done ! save time : 2.6437573432922363 nb_obj : 74 nb_hashtags : 9 time to prepare the origin masks : 61.11040544509888 time for calcul the mask position with numpy : 0.7272453308105469 nb_pixel_total : 4669643 time to create 1 rle with new method : 2.398206949234009 time for calcul the mask position with numpy : 0.0684652328491211 nb_pixel_total : 86316 time to create 1 rle with old method : 0.11067605018615723 time for calcul the mask position with numpy : 0.05527901649475098 nb_pixel_total : 23754 time to create 1 rle with old method : 0.027079343795776367 time for calcul the mask position with numpy : 0.054497480392456055 nb_pixel_total : 51949 time to create 1 rle with old method : 0.05986166000366211 time for calcul the mask position with numpy : 0.628265380859375 nb_pixel_total : 3409884 time to create 1 rle with new method : 2.2074222564697266 time for calcul the mask position with numpy : 0.05883955955505371 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0020895004272460938 time for calcul the mask position with numpy : 0.054685354232788086 nb_pixel_total : 179112 time to create 1 rle with new method : 1.480623722076416 time for calcul the mask position with numpy : 0.0544431209564209 nb_pixel_total : 70325 time to create 1 rle with old method : 0.08166718482971191 time for calcul the mask position with numpy : 0.05496644973754883 nb_pixel_total : 3041 time to create 1 rle with old method : 0.003649473190307617 time for calcul the mask position with numpy : 0.061089515686035156 nb_pixel_total : 191028 time to create 1 rle with new method : 1.4122593402862549 time for calcul the mask position with numpy : 0.05362105369567871 nb_pixel_total : 5258 time to create 1 rle with old method : 0.006223440170288086 time for calcul the mask position with numpy : 0.05532693862915039 nb_pixel_total : 234253 time to create 1 rle with new method : 1.4186711311340332 time for calcul the mask position with numpy : 0.05409669876098633 nb_pixel_total : 114561 time to create 1 rle with old method : 0.13781094551086426 time for calcul the mask position with numpy : 0.053652286529541016 nb_pixel_total : 4549 time to create 1 rle with old method : 0.005204439163208008 time for calcul the mask position with numpy : 0.05361628532409668 nb_pixel_total : 4587 time to create 1 rle with old method : 0.0053560733795166016 time for calcul the mask position with numpy : 0.05365920066833496 nb_pixel_total : 717 time to create 1 rle with old method : 0.0008633136749267578 time for calcul the mask position with numpy : 0.05351448059082031 nb_pixel_total : 4226 time to create 1 rle with old method : 0.004912614822387695 time for calcul the mask position with numpy : 0.0557711124420166 nb_pixel_total : 2095 time to create 1 rle with old method : 0.0025124549865722656 time for calcul the mask position with numpy : 0.05338597297668457 nb_pixel_total : 1743 time to create 1 rle with old method : 0.0020782947540283203 time for calcul the mask position with numpy : 0.05378222465515137 nb_pixel_total : 11994 time to create 1 rle with old method : 0.013586759567260742 time for calcul the mask position with numpy : 0.061158180236816406 nb_pixel_total : 27621 time to create 1 rle with old method : 0.03510618209838867 time for calcul the mask position with numpy : 0.057913780212402344 nb_pixel_total : 31254 time to create 1 rle with old method : 0.051239013671875 time for calcul the mask position with numpy : 0.06307053565979004 nb_pixel_total : 102566 time to create 1 rle with old method : 0.12291765213012695 time for calcul the mask position with numpy : 0.056366920471191406 nb_pixel_total : 43854 time to create 1 rle with old method : 0.05415463447570801 time for calcul the mask position with numpy : 0.059107065200805664 nb_pixel_total : 108345 time to create 1 rle with old method : 0.12375116348266602 time for calcul the mask position with numpy : 0.07723402976989746 nb_pixel_total : 69349 time to create 1 rle with old method : 0.10278439521789551 time for calcul the mask position with numpy : 0.05367875099182129 nb_pixel_total : 11367 time to create 1 rle with old method : 0.013013362884521484 time for calcul the mask position with numpy : 0.05527853965759277 nb_pixel_total : 17077 time to create 1 rle with old method : 0.019269704818725586 time for calcul the mask position with numpy : 0.0535283088684082 nb_pixel_total : 10774 time to create 1 rle with old method : 0.015902996063232422 time for calcul the mask position with numpy : 0.058548927307128906 nb_pixel_total : 108774 time to create 1 rle with old method : 0.12592101097106934 time for calcul the mask position with numpy : 0.055295705795288086 nb_pixel_total : 121059 time to create 1 rle with old method : 0.13515400886535645 time for calcul the mask position with numpy : 0.05523824691772461 nb_pixel_total : 207864 time to create 1 rle with new method : 1.7791824340820312 time for calcul the mask position with numpy : 0.05735516548156738 nb_pixel_total : 50909 time to create 1 rle with old method : 0.08620047569274902 time for calcul the mask position with numpy : 0.05926060676574707 nb_pixel_total : 39414 time to create 1 rle with old method : 0.05281472206115723 time for calcul the mask position with numpy : 0.06870794296264648 nb_pixel_total : 43973 time to create 1 rle with old method : 0.0640718936920166 time for calcul the mask position with numpy : 0.05427074432373047 nb_pixel_total : 30629 time to create 1 rle with old method : 0.034707069396972656 time for calcul the mask position with numpy : 0.05381131172180176 nb_pixel_total : 27913 time to create 1 rle with old method : 0.03238272666931152 time for calcul the mask position with numpy : 0.053635597229003906 nb_pixel_total : 7069 time to create 1 rle with old method : 0.008107662200927734 time for calcul the mask position with numpy : 0.05436253547668457 nb_pixel_total : 53694 time to create 1 rle with old method : 0.06215524673461914 time for calcul the mask position with numpy : 0.0531156063079834 nb_pixel_total : 13915 time to create 1 rle with old method : 0.015947341918945312 time for calcul the mask position with numpy : 0.05524492263793945 nb_pixel_total : 15336 time to create 1 rle with old method : 0.02501058578491211 time for calcul the mask position with numpy : 0.05830836296081543 nb_pixel_total : 85972 time to create 1 rle with old method : 0.09519553184509277 time for calcul the mask position with numpy : 0.05844378471374512 nb_pixel_total : 303496 time to create 1 rle with new method : 1.2826972007751465 time for calcul the mask position with numpy : 0.05420732498168945 nb_pixel_total : 19742 time to create 1 rle with old method : 0.022391319274902344 time for calcul the mask position with numpy : 0.057288408279418945 nb_pixel_total : 38739 time to create 1 rle with old method : 0.044403791427612305 time for calcul the mask position with numpy : 0.131117582321167 nb_pixel_total : 592509 time to create 1 rle with new method : 1.4649555683135986 time for calcul the mask position with numpy : 0.05803728103637695 nb_pixel_total : 3241 time to create 1 rle with old method : 0.004615306854248047 time for calcul the mask position with numpy : 0.05416226387023926 nb_pixel_total : 28878 time to create 1 rle with old method : 0.034737348556518555 time for calcul the mask position with numpy : 0.054833412170410156 nb_pixel_total : 60407 time to create 1 rle with old method : 0.0675210952758789 time for calcul the mask position with numpy : 0.0546565055847168 nb_pixel_total : 40941 time to create 1 rle with old method : 0.046111345291137695 time for calcul the mask position with numpy : 0.056688547134399414 nb_pixel_total : 237744 time to create 1 rle with new method : 0.9005541801452637 time for calcul the mask position with numpy : 0.05457663536071777 nb_pixel_total : 22485 time to create 1 rle with old method : 0.026363134384155273 time for calcul the mask position with numpy : 0.05441904067993164 nb_pixel_total : 88216 time to create 1 rle with old method : 0.13596558570861816 time for calcul the mask position with numpy : 0.057009220123291016 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004911422729492188 time for calcul the mask position with numpy : 0.054137229919433594 nb_pixel_total : 51369 time to create 1 rle with old method : 0.05595707893371582 time for calcul the mask position with numpy : 0.05373525619506836 nb_pixel_total : 10188 time to create 1 rle with old method : 0.011078834533691406 time for calcul the mask position with numpy : 0.0532989501953125 nb_pixel_total : 51943 time to create 1 rle with old method : 0.05757546424865723 time for calcul the mask position with numpy : 0.05234336853027344 nb_pixel_total : 969 time to create 1 rle with old method : 0.0015726089477539062 time for calcul the mask position with numpy : 0.05130147933959961 nb_pixel_total : 14744 time to create 1 rle with old method : 0.016918420791625977 time for calcul the mask position with numpy : 0.05144643783569336 nb_pixel_total : 20854 time to create 1 rle with old method : 0.02208542823791504 time for calcul the mask position with numpy : 0.05128765106201172 nb_pixel_total : 49114 time to create 1 rle with old method : 0.05245661735534668 time for calcul the mask position with numpy : 0.051867008209228516 nb_pixel_total : 120896 time to create 1 rle with old method : 0.13015127182006836 time for calcul the mask position with numpy : 0.052028656005859375 nb_pixel_total : 109313 time to create 1 rle with old method : 0.11575436592102051 time for calcul the mask position with numpy : 0.052504539489746094 nb_pixel_total : 69918 time to create 1 rle with old method : 0.07487607002258301 time for calcul the mask position with numpy : 0.05527162551879883 nb_pixel_total : 103431 time to create 1 rle with old method : 0.11693835258483887 time for calcul the mask position with numpy : 0.05523943901062012 nb_pixel_total : 281 time to create 1 rle with old method : 0.00089263916015625 time for calcul the mask position with numpy : 0.05794072151184082 nb_pixel_total : 201678 time to create 1 rle with new method : 1.2830932140350342 time for calcul the mask position with numpy : 0.052304744720458984 nb_pixel_total : 20125 time to create 1 rle with old method : 0.021762847900390625 time for calcul the mask position with numpy : 0.05384325981140137 nb_pixel_total : 84609 time to create 1 rle with old method : 0.09070348739624023 time for calcul the mask position with numpy : 0.051375389099121094 nb_pixel_total : 10552 time to create 1 rle with old method : 0.011992216110229492 time for calcul the mask position with numpy : 0.05249357223510742 nb_pixel_total : 51591 time to create 1 rle with old method : 0.054412126541137695 time for calcul the mask position with numpy : 0.05132007598876953 nb_pixel_total : 2262 time to create 1 rle with old method : 0.0030379295349121094 time for calcul the mask position with numpy : 0.05582261085510254 nb_pixel_total : 119065 time to create 1 rle with old method : 0.12388491630554199 time for calcul the mask position with numpy : 0.05036354064941406 nb_pixel_total : 5357 time to create 1 rle with old method : 0.006335020065307617 time for calcul the mask position with numpy : 0.051532745361328125 nb_pixel_total : 144957 time to create 1 rle with old method : 0.14971280097961426 create new chi : 24.962079763412476 time to delete rle : 0.005435943603515625 batch 1 Loaded 75 chid ids of type : 4855 Number RLEs to save : 44437 TO DO : save crop sub photo not yet done ! save time : 2.477224349975586 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 14.89275312423706 time for calcul the mask position with numpy : 0.10905098915100098 nb_pixel_total : 1716271 time to create 1 rle with new method : 1.4996490478515625 time for calcul the mask position with numpy : 0.05930829048156738 nb_pixel_total : 182348 time to create 1 rle with new method : 1.1570065021514893 time for calcul the mask position with numpy : 0.07725834846496582 nb_pixel_total : 691175 time to create 1 rle with new method : 0.7566382884979248 time for calcul the mask position with numpy : 0.06655025482177734 nb_pixel_total : 23780 time to create 1 rle with old method : 0.03558850288391113 time for calcul the mask position with numpy : 0.07052874565124512 nb_pixel_total : 156616 time to create 1 rle with new method : 1.1614727973937988 time for calcul the mask position with numpy : 0.10477352142333984 nb_pixel_total : 1215920 time to create 1 rle with new method : 1.159118413925171 time for calcul the mask position with numpy : 0.07887625694274902 nb_pixel_total : 738375 time to create 1 rle with new method : 0.8914394378662109 time for calcul the mask position with numpy : 0.0776982307434082 nb_pixel_total : 783013 time to create 1 rle with new method : 0.8599352836608887 time for calcul the mask position with numpy : 0.09623265266418457 nb_pixel_total : 594736 time to create 1 rle with new method : 1.1001663208007812 time for calcul the mask position with numpy : 0.0963752269744873 nb_pixel_total : 1972283 time to create 1 rle with new method : 0.8444478511810303 time for calcul the mask position with numpy : 0.5204751491546631 nb_pixel_total : 4904683 time to create 1 rle with new method : 1.3527133464813232 create new chi : 12.703135967254639 time to delete rle : 0.005287647247314453 batch 1 Loaded 11 chid ids of type : 4855 Number RLEs to save : 34412 TO DO : save crop sub photo not yet done ! save time : 1.844963788986206 nb_obj : 11 nb_hashtags : 6 time to prepare the origin masks : 18.879957675933838 time for calcul the mask position with numpy : 0.15750646591186523 nb_pixel_total : 3225134 time to create 1 rle with new method : 2.194993734359741 time for calcul the mask position with numpy : 0.10015344619750977 nb_pixel_total : 5734 time to create 1 rle with old method : 0.0065119266510009766 time for calcul the mask position with numpy : 0.10086703300476074 nb_pixel_total : 162110 time to create 1 rle with new method : 1.121039867401123 time for calcul the mask position with numpy : 0.07644367218017578 nb_pixel_total : 61980 time to create 1 rle with old method : 0.06965446472167969 time for calcul the mask position with numpy : 0.07740998268127441 nb_pixel_total : 69922 time to create 1 rle with old method : 0.07856011390686035 time for calcul the mask position with numpy : 0.06695151329040527 nb_pixel_total : 41305 time to create 1 rle with old method : 0.04754018783569336 time for calcul the mask position with numpy : 0.09479618072509766 nb_pixel_total : 1213600 time to create 1 rle with new method : 1.324887752532959 time for calcul the mask position with numpy : 0.06947994232177734 nb_pixel_total : 17043 time to create 1 rle with old method : 0.01902008056640625 time for calcul the mask position with numpy : 0.08072233200073242 nb_pixel_total : 666555 time to create 1 rle with new method : 0.9740085601806641 time for calcul the mask position with numpy : 0.09276390075683594 nb_pixel_total : 28597 time to create 1 rle with old method : 0.030685901641845703 time for calcul the mask position with numpy : 0.10231471061706543 nb_pixel_total : 895706 time to create 1 rle with new method : 1.3829717636108398 time for calcul the mask position with numpy : 0.7056889533996582 nb_pixel_total : 6591514 time to create 1 rle with new method : 0.9117968082427979 create new chi : 10.26763653755188 time to delete rle : 0.002660512924194336 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 17477 TO DO : save crop sub photo not yet done ! save time : 1.027024745941162 map_output_result : {1356982997: (0.3760188468634072, 'Should be the crop_list due to order', 0.220764774893818), 1356982991: (0.3760188468634072, 'Should be the crop_list due to order', 0.36164922215612394), 1356982983: (0.3760188468634072, 'Should be the crop_list due to order', 0.5349027981519209), 1356982975: (0.3760188468634072, 'Should be the crop_list due to order', 0.33733759935464747), 1356982971: (0.3760188468634072, 'Should be the crop_list due to order', 0.2276761857850152), 1356982967: (0.3760188468634072, 'Should be the crop_list due to order', 0.573782500838918)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 6 /1356982997.Didn't retrieve data . /1356982991.Didn't retrieve data . /1356982983.Didn't retrieve data . /1356982975.Didn't retrieve data . /1356982971.Didn't retrieve data . /1356982967.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.012547969818115234 save_final save missing photos in datou_result : time spend for datou_step_exec : 428.5042064189911 time spend to save output : 0.12045788764953613 total time spend for step 5 : 428.6246643066406 step6:crop_condition Thu May 8 11:52:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 326 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3015255 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746697989_543215 we have uploaded 28 photos in the portfolio 3015255 time of upload the photos Elapsed time : 8.13357663154602 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3015255 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698023_543215 we have uploaded 47 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.565100193023682 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698047_543215 we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.930021524429321 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698059_543215 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.9417870044708252 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3015255 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698085_543215 we have uploaded 46 photos in the portfolio 3015255 time of upload the photos Elapsed time : 16.876248836517334 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698105_543215 we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.6004161834716797 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698127_543215 we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.039851427078247 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698137_543215 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5736908912658691 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3015255 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698144_543215 we have uploaded 6 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.6076812744140625 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 3015255 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746698316_543215 we have uploaded 49 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.057732105255127 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 236 /1356985117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356985747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 714 time used for this insertion : 0.07151007652282715 save_final save missing photos in datou_result : time spend for datou_step_exec : 399.84020805358887 time spend to save output : 0.21950936317443848 total time spend for step 6 : 400.0597174167633 step7:ventilate_hashtags_in_portfolio Thu May 8 11:58:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22798155 get user id for portfolio 22798155 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798155 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798155 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798155 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798155 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22798400,22798401,22798402,22798403,22798404,22798409,22798411,22798412,22798413,22798414,22798415,22798416,22798418,22798419,22798420,22798421,22798422,22798423,22798424,22798425?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22798155 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 1 /22798155. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014325857162475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.217041969299316 time spend to save output : 0.014644384384155273 total time spend for step 7 : 4.231686353683472 step8:final Thu May 8 11:58:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356982997: ('0.35900574468175384',), 1356982991: ('0.35900574468175384',), 1356982983: ('0.35900574468175384',), 1356982975: ('0.35900574468175384',), 1356982971: ('0.35900574468175384',), 1356982967: ('0.35900574468175384',)} new output for save of step final : {1356982997: ('0.35900574468175384',), 1356982991: ('0.35900574468175384',), 1356982983: ('0.35900574468175384',), 1356982975: ('0.35900574468175384',), 1356982971: ('0.35900574468175384',), 1356982967: ('0.35900574468175384',)} [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 6 /1356982997.Didn't retrieve data . /1356982991.Didn't retrieve data . /1356982983.Didn't retrieve data . /1356982975.Didn't retrieve data . /1356982971.Didn't retrieve data . /1356982967.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.01288294792175293 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10847043991088867 time spend to save output : 0.013213396072387695 total time spend for step 8 : 0.12168383598327637 step9:velours_tree Thu May 8 11:58:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20755481719970703 time spend to save output : 5.14984130859375e-05 total time spend for step 9 : 0.20760631561279297 step10:send_mail_cod Thu May 8 11:58:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22798155_08-05-2025_11_58_58.pdf 22798374 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983741746698338 22798375 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983751746698340 22798376 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983761746698342 22798377 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983771746698343 22798378 imagette227983781746698344 22798379 imagette227983791746698344 22798380 imagette227983801746698344 22798381 imagette227983811746698344 22798382 imagette227983821746698344 22798383 imagette227983831746698344 22798384 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983841746698344 22798385 change filename to text .change filename to text .change filename to text .imagette227983851746698345 22798386 imagette227983861746698345 22798387 imagette227983871746698345 22798388 imagette227983881746698345 22798389 imagette227983891746698345 22798390 imagette227983901746698345 22798391 change filename to text .imagette227983911746698345 22798392 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983921746698346 22798394 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227983941746698346 22798395 imagette227983951746698348 22798396 imagette227983961746698348 22798397 imagette227983971746698348 22798398 imagette227983981746698348 22798399 imagette227983991746698348 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22798155 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22798400,22798401,22798402,22798403,22798404,22798409,22798411,22798412,22798413,22798414,22798415,22798416,22798418,22798419,22798420,22798421,22798422,22798423,22798424,22798425?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22798155 your option no_mail is active, we will not send the real mail to your client args[1356982997] : ((1356982997, 1665.0297770114016, 2107751945), (1356982997, -0.26832009603996, 496442774), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356982991] : ((1356982991, 2802.69856702639, 492609224), (1356982991, -0.19198754546434013, 496442774), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356982983] : ((1356982983, 1629.9502212968766, 2107751945), (1356982983, -0.37223160237333935, 496442774), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356982975] : ((1356982975, 3074.920909309656, 492609224), (1356982975, -0.4724811301282399, 496442774), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356982971] : ((1356982971, 502.2809286577179, 492688767), (1356982971, -0.06213296744194769, 2107752395), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356982967] : ((1356982967, 799.5705653043344, 492688767), (1356982967, -0.5959914801168918, 501862349), '0.35900574468175384') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.35900574468175384 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798155_08-05-2025_11_58_58.pdf results_Auto_P22798155_08-05-2025_11_58_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798155_08-05-2025_11_58_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22798155','results_Auto_P22798155_08-05-2025_11_58_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798155_08-05-2025_11_58_58.pdf','pdf','','2.3','0.35900574468175384') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013724565505981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.453012228012085 time spend to save output : 0.013960599899291992 total time spend for step 10 : 13.466972827911377 step11:split_time_score Thu May 8 11:59:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('51', 2), ('52', 2), ('53', 2)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08052025 22798155 Nombre de photos uploadées : 6 / 23040 (0%) 08052025 22798155 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 08052025 22798155 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00041556358337402344 elapsed_time : insert_dashboard_record_day_entry 0.02491164207458496 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.35900574468175384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798155_08-05-2025_11_58_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798155 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798155 AND mptpi.`type`=4855 To do Qualite : 0.4019281388775789 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798156_08-05-2025_11_45_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798156 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798156 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08052025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356982997, 1356982991, 1356982983, 1356982975, 1356982971, 1356982967] Looping around the photos to save general results len do output : 1 /22798155Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982997', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982991', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982983', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982975', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982971', None, None, None, None, None, '2807340') ('4741', None, None, None, None, None, None, None, '2807340') ('4741', '22798155', '1356982967', None, None, None, None, None, '2807340') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.013847589492797852 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3571629524230957 time spend to save output : 0.014093160629272461 total time spend for step 11 : 0.37125611305236816 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 656.21user 350.03system 17:48.41elapsed 94%CPU (0avgtext+0avgdata 6814060maxresident)k 1458016inputs+696272outputs (17058major+53019731minor)pagefaults 0swaps