python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1866620 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2654377'] with mtr_portfolio_ids : ['21222497'] and first list_photo_ids : [] new path : /proc/1866620/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.8818767070770264 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Mar 11 01:01:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1348 wait 20 seconds l 3637 free memory gpu now : 1348 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-11 01:01:54.546352: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-11 01:01:54.579244: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-11 01:01:54.581583: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc754000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-11 01:01:54.581619: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-11 01:01:54.587979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-11 01:01:54.813132: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xa703b40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-11 01:01:54.813263: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-11 01:01:54.814588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:01:54.817333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:01:54.855218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:01:54.878513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:01:54.882971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:01:54.919242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:01:54.925325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:01:54.985827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:01:54.987417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:01:54.988116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:01:54.989401: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 01:01:54.989431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 01:01:54.989445: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 01:01:54.991222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 971 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-11 01:01:55.521189: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:01:55.521370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:01:55.521392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:01:55.521409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:01:55.521424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:01:55.521439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:01:55.521453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:01:55.521469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:01:55.522337: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:01:55.524012: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:01:55.524179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:01:55.524202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:01:55.524238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:01:55.524257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:01:55.524274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:01:55.524290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:01:55.524307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:01:55.525229: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:01:55.525298: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 01:01:55.525311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 01:01:55.525323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 01:01:55.526268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 971 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-11 01:02:01.367108: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-03-11 01:02:13.064065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:02:13.487581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:02:15.644661: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.645067: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.651624: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.651650: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.657664: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.657691: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.687871: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.687902: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.737110: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:02:15.737155: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1867592 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 886 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2541 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.007387876510620117 nb_pixel_total : 273020 time to create 1 rle with new method : 0.026607513427734375 length of segment : 560 time for calcul the mask position with numpy : 0.008256196975708008 nb_pixel_total : 339912 time to create 1 rle with new method : 0.3407313823699951 length of segment : 1010 time for calcul the mask position with numpy : 0.0015490055084228516 nb_pixel_total : 75687 time to create 1 rle with old method : 0.08772397041320801 length of segment : 421 time for calcul the mask position with numpy : 0.0008828639984130859 nb_pixel_total : 44182 time to create 1 rle with old method : 0.0503087043762207 length of segment : 385 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 17868 time to create 1 rle with old method : 0.02069234848022461 length of segment : 189 time for calcul the mask position with numpy : 0.009063720703125 nb_pixel_total : 464312 time to create 1 rle with new method : 0.1753387451171875 length of segment : 756 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 28847 time to create 1 rle with old method : 0.0336451530456543 length of segment : 220 time for calcul the mask position with numpy : 0.0005919933319091797 nb_pixel_total : 34505 time to create 1 rle with old method : 0.039716482162475586 length of segment : 216 time for calcul the mask position with numpy : 0.0010845661163330078 nb_pixel_total : 43384 time to create 1 rle with old method : 0.05353879928588867 length of segment : 422 time for calcul the mask position with numpy : 0.0012388229370117188 nb_pixel_total : 41031 time to create 1 rle with old method : 0.05051422119140625 length of segment : 344 time for calcul the mask position with numpy : 0.0024118423461914062 nb_pixel_total : 35425 time to create 1 rle with old method : 0.04021954536437988 length of segment : 430 time for calcul the mask position with numpy : 0.00027680397033691406 nb_pixel_total : 4503 time to create 1 rle with old method : 0.0065460205078125 length of segment : 63 time for calcul the mask position with numpy : 0.012108802795410156 nb_pixel_total : 164085 time to create 1 rle with new method : 0.030547618865966797 length of segment : 438 time for calcul the mask position with numpy : 0.0007128715515136719 nb_pixel_total : 23093 time to create 1 rle with old method : 0.02682662010192871 length of segment : 236 time for calcul the mask position with numpy : 0.01132059097290039 nb_pixel_total : 300440 time to create 1 rle with new method : 0.025838851928710938 length of segment : 758 time for calcul the mask position with numpy : 0.0007138252258300781 nb_pixel_total : 29606 time to create 1 rle with old method : 0.03396201133728027 length of segment : 264 time for calcul the mask position with numpy : 0.0024633407592773438 nb_pixel_total : 132346 time to create 1 rle with old method : 0.15138602256774902 length of segment : 480 time for calcul the mask position with numpy : 0.0011150836944580078 nb_pixel_total : 27141 time to create 1 rle with old method : 0.03197145462036133 length of segment : 121 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 9464 time to create 1 rle with old method : 0.011315107345581055 length of segment : 109 time for calcul the mask position with numpy : 0.00553584098815918 nb_pixel_total : 113583 time to create 1 rle with old method : 0.13722681999206543 length of segment : 366 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 24013 time to create 1 rle with old method : 0.029195070266723633 length of segment : 147 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 8412 time to create 1 rle with old method : 0.010524272918701172 length of segment : 70 time for calcul the mask position with numpy : 0.0016567707061767578 nb_pixel_total : 60047 time to create 1 rle with old method : 0.09024572372436523 length of segment : 615 time for calcul the mask position with numpy : 0.0013380050659179688 nb_pixel_total : 49172 time to create 1 rle with old method : 0.05798816680908203 length of segment : 536 time for calcul the mask position with numpy : 0.001737356185913086 nb_pixel_total : 31555 time to create 1 rle with old method : 0.036168813705444336 length of segment : 248 time for calcul the mask position with numpy : 0.008144378662109375 nb_pixel_total : 179674 time to create 1 rle with new method : 0.012608051300048828 length of segment : 467 time for calcul the mask position with numpy : 0.0045468807220458984 nb_pixel_total : 69947 time to create 1 rle with old method : 0.07952642440795898 length of segment : 327 time for calcul the mask position with numpy : 0.016200780868530273 nb_pixel_total : 187639 time to create 1 rle with new method : 0.046689748764038086 length of segment : 815 time for calcul the mask position with numpy : 0.0016989707946777344 nb_pixel_total : 35830 time to create 1 rle with old method : 0.04785037040710449 length of segment : 260 time for calcul the mask position with numpy : 0.0031125545501708984 nb_pixel_total : 84451 time to create 1 rle with old method : 0.09634709358215332 length of segment : 257 time for calcul the mask position with numpy : 0.0024785995483398438 nb_pixel_total : 37100 time to create 1 rle with old method : 0.048774003982543945 length of segment : 207 time for calcul the mask position with numpy : 0.005910634994506836 nb_pixel_total : 156160 time to create 1 rle with new method : 0.014269590377807617 length of segment : 642 time for calcul the mask position with numpy : 0.0010499954223632812 nb_pixel_total : 13155 time to create 1 rle with old method : 0.01882648468017578 length of segment : 209 time for calcul the mask position with numpy : 0.010522603988647461 nb_pixel_total : 273091 time to create 1 rle with new method : 0.013303279876708984 length of segment : 640 time for calcul the mask position with numpy : 0.0015854835510253906 nb_pixel_total : 27579 time to create 1 rle with old method : 0.03136563301086426 length of segment : 218 time for calcul the mask position with numpy : 0.0011296272277832031 nb_pixel_total : 24057 time to create 1 rle with old method : 0.032121896743774414 length of segment : 181 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 14607 time to create 1 rle with old method : 0.01963520050048828 length of segment : 155 time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 23687 time to create 1 rle with old method : 0.03109121322631836 length of segment : 263 time for calcul the mask position with numpy : 0.003432035446166992 nb_pixel_total : 73344 time to create 1 rle with old method : 0.09414386749267578 length of segment : 326 time for calcul the mask position with numpy : 0.0008907318115234375 nb_pixel_total : 13888 time to create 1 rle with old method : 0.01838517189025879 length of segment : 163 time for calcul the mask position with numpy : 0.001622915267944336 nb_pixel_total : 26184 time to create 1 rle with old method : 0.036789655685424805 length of segment : 188 time for calcul the mask position with numpy : 0.0027468204498291016 nb_pixel_total : 70759 time to create 1 rle with old method : 0.09241771697998047 length of segment : 221 time for calcul the mask position with numpy : 0.0008420944213867188 nb_pixel_total : 9375 time to create 1 rle with old method : 0.013170003890991211 length of segment : 150 time for calcul the mask position with numpy : 0.001341104507446289 nb_pixel_total : 25421 time to create 1 rle with old method : 0.033979177474975586 length of segment : 287 time for calcul the mask position with numpy : 0.0033626556396484375 nb_pixel_total : 91457 time to create 1 rle with old method : 0.14144492149353027 length of segment : 498 time for calcul the mask position with numpy : 0.04616880416870117 nb_pixel_total : 777821 time to create 1 rle with new method : 0.0736546516418457 length of segment : 1361 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 23491 time to create 1 rle with old method : 0.04231572151184082 length of segment : 212 time for calcul the mask position with numpy : 0.0039997100830078125 nb_pixel_total : 87583 time to create 1 rle with old method : 0.14616942405700684 length of segment : 439 time for calcul the mask position with numpy : 0.001024007797241211 nb_pixel_total : 22652 time to create 1 rle with old method : 0.027895689010620117 length of segment : 152 time for calcul the mask position with numpy : 0.002960205078125 nb_pixel_total : 68441 time to create 1 rle with old method : 0.07867002487182617 length of segment : 272 time for calcul the mask position with numpy : 0.001367807388305664 nb_pixel_total : 15755 time to create 1 rle with old method : 0.01861286163330078 length of segment : 184 time for calcul the mask position with numpy : 0.0010716915130615234 nb_pixel_total : 15831 time to create 1 rle with old method : 0.018957853317260742 length of segment : 138 time for calcul the mask position with numpy : 0.002969503402709961 nb_pixel_total : 63738 time to create 1 rle with old method : 0.07325553894042969 length of segment : 221 time for calcul the mask position with numpy : 0.005560636520385742 nb_pixel_total : 112604 time to create 1 rle with old method : 0.1257166862487793 length of segment : 378 time for calcul the mask position with numpy : 0.000989675521850586 nb_pixel_total : 22919 time to create 1 rle with old method : 0.027065038681030273 length of segment : 151 time for calcul the mask position with numpy : 0.0012164115905761719 nb_pixel_total : 26551 time to create 1 rle with old method : 0.030643224716186523 length of segment : 234 time for calcul the mask position with numpy : 0.0015218257904052734 nb_pixel_total : 24699 time to create 1 rle with old method : 0.028187990188598633 length of segment : 372 time for calcul the mask position with numpy : 0.0016942024230957031 nb_pixel_total : 29478 time to create 1 rle with old method : 0.033635616302490234 length of segment : 204 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 13031 time to create 1 rle with old method : 0.015129804611206055 length of segment : 180 time for calcul the mask position with numpy : 0.002398252487182617 nb_pixel_total : 74467 time to create 1 rle with old method : 0.08600401878356934 length of segment : 269 time for calcul the mask position with numpy : 0.7713437080383301 nb_pixel_total : 4787761 time to create 1 rle with new method : 0.7200751304626465 length of segment : 3022 time for calcul the mask position with numpy : 0.06139540672302246 nb_pixel_total : 1823535 time to create 1 rle with new method : 0.1930713653564453 length of segment : 1584 time for calcul the mask position with numpy : 0.40603017807006836 nb_pixel_total : 4078070 time to create 1 rle with new method : 0.5206711292266846 length of segment : 1505 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 5037 time to create 1 rle with old method : 0.008773088455200195 length of segment : 126 time for calcul the mask position with numpy : 0.42702579498291016 nb_pixel_total : 3415031 time to create 1 rle with new method : 0.4044070243835449 length of segment : 1348 time spent for convertir_results : 15.61656379699707 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 65 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 93.768057346344 time spend to save output : 0.1064612865447998 total time spend for step 1 : 93.8745186328888 step2:mask_detect Tue Mar 11 01:03:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2541 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-11 01:03:08.422240: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-11 01:03:08.463206: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-11 01:03:08.465582: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc74c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-11 01:03:08.465644: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-11 01:03:08.471316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-11 01:03:08.774798: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb72a450 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-11 01:03:08.774883: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-11 01:03:08.776028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:03:08.778710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:03:08.811085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:03:08.832079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:03:08.836799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:03:08.869462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:03:08.874965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:03:08.930600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:03:08.931933: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:03:08.932462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:03:08.933629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 01:03:08.933655: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 01:03:08.933667: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 01:03:08.935553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2089 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-11 01:03:09.138095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:03:09.138220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:03:09.138249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:03:09.138276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:03:09.138299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:03:09.138322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:03:09.138345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:03:09.138367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:03:09.139470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:03:09.140570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 01:03:09.140620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 01:03:09.140638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:03:09.140654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 01:03:09.140670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 01:03:09.140702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 01:03:09.140720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 01:03:09.140737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:03:09.141592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 01:03:09.141622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 01:03:09.141631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 01:03:09.141639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 01:03:09.142539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2089 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-11 01:03:23.391703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 01:03:23.680333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 01:03:25.821110: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.821200: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.827889: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.827937: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.880123: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.880184: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.922841: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.922917: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.974076: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.974128: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-11 01:03:25.975599: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 66 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 1873653 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1182 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3736 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.005738735198974609 nb_pixel_total : 28210 time to create 1 rle with old method : 0.0383763313293457 length of segment : 197 time for calcul the mask position with numpy : 0.0066301822662353516 nb_pixel_total : 278309 time to create 1 rle with new method : 0.02197718620300293 length of segment : 689 time for calcul the mask position with numpy : 0.00229644775390625 nb_pixel_total : 106894 time to create 1 rle with old method : 0.12099885940551758 length of segment : 352 time for calcul the mask position with numpy : 0.01016688346862793 nb_pixel_total : 561623 time to create 1 rle with new method : 0.03686189651489258 length of segment : 553 time for calcul the mask position with numpy : 0.00621795654296875 nb_pixel_total : 292124 time to create 1 rle with new method : 0.014687061309814453 length of segment : 651 time for calcul the mask position with numpy : 0.03387117385864258 nb_pixel_total : 1719242 time to create 1 rle with new method : 0.37017822265625 length of segment : 1392 time for calcul the mask position with numpy : 0.0009784698486328125 nb_pixel_total : 34132 time to create 1 rle with old method : 0.03750777244567871 length of segment : 294 time for calcul the mask position with numpy : 0.0037686824798583984 nb_pixel_total : 174970 time to create 1 rle with new method : 0.011324405670166016 length of segment : 489 time for calcul the mask position with numpy : 0.0012564659118652344 nb_pixel_total : 57513 time to create 1 rle with old method : 0.06465578079223633 length of segment : 228 time for calcul the mask position with numpy : 0.018486738204956055 nb_pixel_total : 814330 time to create 1 rle with new method : 0.3280327320098877 length of segment : 1191 time for calcul the mask position with numpy : 0.021664857864379883 nb_pixel_total : 752631 time to create 1 rle with new method : 0.06169581413269043 length of segment : 1164 time for calcul the mask position with numpy : 0.0033037662506103516 nb_pixel_total : 171405 time to create 1 rle with new method : 0.009315967559814453 length of segment : 479 time for calcul the mask position with numpy : 0.014330863952636719 nb_pixel_total : 266410 time to create 1 rle with new method : 0.012831449508666992 length of segment : 582 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 38844 time to create 1 rle with old method : 0.04323148727416992 length of segment : 300 time for calcul the mask position with numpy : 0.023839712142944336 nb_pixel_total : 660908 time to create 1 rle with new method : 0.06934428215026855 length of segment : 1075 time for calcul the mask position with numpy : 0.003573894500732422 nb_pixel_total : 75339 time to create 1 rle with old method : 0.08419203758239746 length of segment : 544 time for calcul the mask position with numpy : 0.003117084503173828 nb_pixel_total : 157265 time to create 1 rle with new method : 0.009368181228637695 length of segment : 524 time for calcul the mask position with numpy : 0.0039038658142089844 nb_pixel_total : 103397 time to create 1 rle with old method : 0.12346291542053223 length of segment : 411 time for calcul the mask position with numpy : 0.0006692409515380859 nb_pixel_total : 25935 time to create 1 rle with old method : 0.03123021125793457 length of segment : 214 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 34974 time to create 1 rle with old method : 0.04023551940917969 length of segment : 196 time for calcul the mask position with numpy : 0.0010023117065429688 nb_pixel_total : 43938 time to create 1 rle with old method : 0.05074310302734375 length of segment : 269 time for calcul the mask position with numpy : 0.0020465850830078125 nb_pixel_total : 80423 time to create 1 rle with old method : 0.10321402549743652 length of segment : 413 time for calcul the mask position with numpy : 0.0025529861450195312 nb_pixel_total : 126372 time to create 1 rle with old method : 0.14705801010131836 length of segment : 335 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 29090 time to create 1 rle with old method : 0.03414654731750488 length of segment : 174 time for calcul the mask position with numpy : 0.03510761260986328 nb_pixel_total : 598201 time to create 1 rle with new method : 0.18094897270202637 length of segment : 1901 time for calcul the mask position with numpy : 0.014255285263061523 nb_pixel_total : 270652 time to create 1 rle with new method : 0.021541357040405273 length of segment : 1235 time for calcul the mask position with numpy : 0.03998875617980957 nb_pixel_total : 389759 time to create 1 rle with new method : 0.05520915985107422 length of segment : 970 time for calcul the mask position with numpy : 0.0017900466918945312 nb_pixel_total : 86108 time to create 1 rle with old method : 0.09755825996398926 length of segment : 387 time for calcul the mask position with numpy : 0.001535177230834961 nb_pixel_total : 59736 time to create 1 rle with old method : 0.06539583206176758 length of segment : 406 time for calcul the mask position with numpy : 0.0009734630584716797 nb_pixel_total : 53215 time to create 1 rle with old method : 0.05814552307128906 length of segment : 309 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 16080 time to create 1 rle with old method : 0.017858266830444336 length of segment : 106 time for calcul the mask position with numpy : 0.004256248474121094 nb_pixel_total : 56151 time to create 1 rle with old method : 0.06168508529663086 length of segment : 343 time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 11442 time to create 1 rle with old method : 0.012964487075805664 length of segment : 129 time for calcul the mask position with numpy : 0.004342079162597656 nb_pixel_total : 137488 time to create 1 rle with old method : 0.14728426933288574 length of segment : 586 time for calcul the mask position with numpy : 0.006602764129638672 nb_pixel_total : 387701 time to create 1 rle with new method : 0.017879009246826172 length of segment : 647 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 23246 time to create 1 rle with old method : 0.027117252349853516 length of segment : 211 time for calcul the mask position with numpy : 0.02102351188659668 nb_pixel_total : 413169 time to create 1 rle with new method : 0.016815900802612305 length of segment : 694 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 8431 time to create 1 rle with old method : 0.009532928466796875 length of segment : 274 time for calcul the mask position with numpy : 0.0021326541900634766 nb_pixel_total : 109862 time to create 1 rle with old method : 0.12074756622314453 length of segment : 281 time for calcul the mask position with numpy : 0.004393577575683594 nb_pixel_total : 202785 time to create 1 rle with new method : 0.008001327514648438 length of segment : 466 time for calcul the mask position with numpy : 0.0013604164123535156 nb_pixel_total : 74154 time to create 1 rle with old method : 0.08260321617126465 length of segment : 396 time for calcul the mask position with numpy : 0.001135110855102539 nb_pixel_total : 58145 time to create 1 rle with old method : 0.06475687026977539 length of segment : 240 time for calcul the mask position with numpy : 0.0027666091918945312 nb_pixel_total : 142290 time to create 1 rle with old method : 0.1597881317138672 length of segment : 606 time for calcul the mask position with numpy : 0.0005426406860351562 nb_pixel_total : 17268 time to create 1 rle with old method : 0.02042675018310547 length of segment : 254 time for calcul the mask position with numpy : 0.001504659652709961 nb_pixel_total : 60858 time to create 1 rle with old method : 0.06817245483398438 length of segment : 318 time for calcul the mask position with numpy : 0.002422332763671875 nb_pixel_total : 105699 time to create 1 rle with old method : 0.13157033920288086 length of segment : 567 time for calcul the mask position with numpy : 0.01592850685119629 nb_pixel_total : 126283 time to create 1 rle with old method : 0.14354586601257324 length of segment : 482 time for calcul the mask position with numpy : 0.0012068748474121094 nb_pixel_total : 45560 time to create 1 rle with old method : 0.054505109786987305 length of segment : 361 time for calcul the mask position with numpy : 0.003969430923461914 nb_pixel_total : 161417 time to create 1 rle with new method : 0.00865936279296875 length of segment : 560 time for calcul the mask position with numpy : 0.010381460189819336 nb_pixel_total : 62084 time to create 1 rle with old method : 0.07170295715332031 length of segment : 621 time for calcul the mask position with numpy : 0.002575397491455078 nb_pixel_total : 66362 time to create 1 rle with old method : 0.07949161529541016 length of segment : 785 time for calcul the mask position with numpy : 0.003406524658203125 nb_pixel_total : 170341 time to create 1 rle with new method : 0.009955883026123047 length of segment : 667 time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 78920 time to create 1 rle with old method : 0.09863972663879395 length of segment : 394 time for calcul the mask position with numpy : 0.004445314407348633 nb_pixel_total : 111580 time to create 1 rle with old method : 0.13251471519470215 length of segment : 908 time for calcul the mask position with numpy : 0.0014367103576660156 nb_pixel_total : 77201 time to create 1 rle with old method : 0.10803723335266113 length of segment : 396 time for calcul the mask position with numpy : 0.001968860626220703 nb_pixel_total : 50865 time to create 1 rle with old method : 0.058531999588012695 length of segment : 314 time for calcul the mask position with numpy : 0.019896745681762695 nb_pixel_total : 351330 time to create 1 rle with new method : 0.019768238067626953 length of segment : 1046 time for calcul the mask position with numpy : 0.0068280696868896484 nb_pixel_total : 393293 time to create 1 rle with new method : 0.019453048706054688 length of segment : 1090 time for calcul the mask position with numpy : 0.0027115345001220703 nb_pixel_total : 111145 time to create 1 rle with old method : 0.12095332145690918 length of segment : 392 time for calcul the mask position with numpy : 0.0010960102081298828 nb_pixel_total : 46840 time to create 1 rle with old method : 0.06278848648071289 length of segment : 242 time for calcul the mask position with numpy : 0.0028226375579833984 nb_pixel_total : 48660 time to create 1 rle with old method : 0.05455446243286133 length of segment : 281 time for calcul the mask position with numpy : 0.013145685195922852 nb_pixel_total : 367427 time to create 1 rle with new method : 0.0178070068359375 length of segment : 992 time for calcul the mask position with numpy : 0.0029625892639160156 nb_pixel_total : 184687 time to create 1 rle with new method : 0.0077702999114990234 length of segment : 624 time for calcul the mask position with numpy : 0.0020270347595214844 nb_pixel_total : 63146 time to create 1 rle with old method : 0.07047748565673828 length of segment : 638 time for calcul the mask position with numpy : 0.011629343032836914 nb_pixel_total : 601625 time to create 1 rle with new method : 0.03489422798156738 length of segment : 1083 time for calcul the mask position with numpy : 0.002367734909057617 nb_pixel_total : 45396 time to create 1 rle with old method : 0.05665469169616699 length of segment : 258 time for calcul the mask position with numpy : 0.02401566505432129 nb_pixel_total : 1166843 time to create 1 rle with new method : 0.35060906410217285 length of segment : 1387 time for calcul the mask position with numpy : 0.004202365875244141 nb_pixel_total : 60568 time to create 1 rle with old method : 0.06706738471984863 length of segment : 300 time for calcul the mask position with numpy : 0.011706352233886719 nb_pixel_total : 221005 time to create 1 rle with new method : 0.014343023300170898 length of segment : 476 time for calcul the mask position with numpy : 0.0023984909057617188 nb_pixel_total : 27909 time to create 1 rle with old method : 0.03331923484802246 length of segment : 220 time for calcul the mask position with numpy : 0.0009005069732666016 nb_pixel_total : 35203 time to create 1 rle with old method : 0.04156064987182617 length of segment : 249 time for calcul the mask position with numpy : 0.0018074512481689453 nb_pixel_total : 63371 time to create 1 rle with old method : 0.0728459358215332 length of segment : 364 time for calcul the mask position with numpy : 0.00033164024353027344 nb_pixel_total : 15178 time to create 1 rle with old method : 0.017406225204467773 length of segment : 157 time for calcul the mask position with numpy : 0.004548072814941406 nb_pixel_total : 52494 time to create 1 rle with old method : 0.061029911041259766 length of segment : 339 time for calcul the mask position with numpy : 0.0011756420135498047 nb_pixel_total : 47835 time to create 1 rle with old method : 0.05474495887756348 length of segment : 202 time for calcul the mask position with numpy : 0.019094228744506836 nb_pixel_total : 816548 time to create 1 rle with new method : 0.13556170463562012 length of segment : 1164 time for calcul the mask position with numpy : 0.01127314567565918 nb_pixel_total : 157846 time to create 1 rle with new method : 0.010004043579101562 length of segment : 514 time for calcul the mask position with numpy : 0.005787849426269531 nb_pixel_total : 273561 time to create 1 rle with new method : 0.020807743072509766 length of segment : 582 time for calcul the mask position with numpy : 0.0013740062713623047 nb_pixel_total : 69559 time to create 1 rle with old method : 0.07923126220703125 length of segment : 254 time for calcul the mask position with numpy : 0.002707958221435547 nb_pixel_total : 120975 time to create 1 rle with old method : 0.15352487564086914 length of segment : 382 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 7998 time to create 1 rle with old method : 0.009353399276733398 length of segment : 146 time for calcul the mask position with numpy : 0.0054094791412353516 nb_pixel_total : 229926 time to create 1 rle with new method : 0.01548624038696289 length of segment : 879 time for calcul the mask position with numpy : 0.015708446502685547 nb_pixel_total : 234973 time to create 1 rle with new method : 0.014801263809204102 length of segment : 781 time for calcul the mask position with numpy : 0.007319927215576172 nb_pixel_total : 328288 time to create 1 rle with new method : 0.024143695831298828 length of segment : 775 time for calcul the mask position with numpy : 0.01111602783203125 nb_pixel_total : 656171 time to create 1 rle with new method : 0.06781125068664551 length of segment : 775 time for calcul the mask position with numpy : 0.0065708160400390625 nb_pixel_total : 317896 time to create 1 rle with new method : 0.01877570152282715 length of segment : 728 time for calcul the mask position with numpy : 0.009625434875488281 nb_pixel_total : 124197 time to create 1 rle with old method : 0.16006684303283691 length of segment : 344 time for calcul the mask position with numpy : 0.0015187263488769531 nb_pixel_total : 18605 time to create 1 rle with old method : 0.022884607315063477 length of segment : 138 time for calcul the mask position with numpy : 0.002645254135131836 nb_pixel_total : 126941 time to create 1 rle with old method : 0.14646458625793457 length of segment : 389 time for calcul the mask position with numpy : 0.0013353824615478516 nb_pixel_total : 65066 time to create 1 rle with old method : 0.0770721435546875 length of segment : 298 time for calcul the mask position with numpy : 0.0016818046569824219 nb_pixel_total : 64237 time to create 1 rle with old method : 0.07539129257202148 length of segment : 408 time for calcul the mask position with numpy : 0.0022966861724853516 nb_pixel_total : 71847 time to create 1 rle with old method : 0.0824286937713623 length of segment : 401 time for calcul the mask position with numpy : 0.005511045455932617 nb_pixel_total : 94422 time to create 1 rle with old method : 0.10695695877075195 length of segment : 356 time for calcul the mask position with numpy : 0.015199661254882812 nb_pixel_total : 737705 time to create 1 rle with new method : 0.05167698860168457 length of segment : 1207 time for calcul the mask position with numpy : 0.0011186599731445312 nb_pixel_total : 18958 time to create 1 rle with old method : 0.023581743240356445 length of segment : 132 time for calcul the mask position with numpy : 0.0017616748809814453 nb_pixel_total : 30939 time to create 1 rle with old method : 0.03609871864318848 length of segment : 246 time for calcul the mask position with numpy : 0.025563478469848633 nb_pixel_total : 458455 time to create 1 rle with new method : 0.02826547622680664 length of segment : 973 time for calcul the mask position with numpy : 0.004971027374267578 nb_pixel_total : 94968 time to create 1 rle with old method : 0.1111905574798584 length of segment : 391 time for calcul the mask position with numpy : 0.0033779144287109375 nb_pixel_total : 142085 time to create 1 rle with old method : 0.16040968894958496 length of segment : 550 time for calcul the mask position with numpy : 0.0035157203674316406 nb_pixel_total : 63408 time to create 1 rle with old method : 0.07642030715942383 length of segment : 298 time for calcul the mask position with numpy : 0.0038247108459472656 nb_pixel_total : 142427 time to create 1 rle with old method : 0.15856623649597168 length of segment : 475 time for calcul the mask position with numpy : 0.0018875598907470703 nb_pixel_total : 55267 time to create 1 rle with old method : 0.06314373016357422 length of segment : 328 time for calcul the mask position with numpy : 0.004873752593994141 nb_pixel_total : 87414 time to create 1 rle with old method : 0.10241127014160156 length of segment : 491 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 17721 time to create 1 rle with old method : 0.021055221557617188 length of segment : 167 time for calcul the mask position with numpy : 0.003758668899536133 nb_pixel_total : 112015 time to create 1 rle with old method : 0.1626124382019043 length of segment : 371 time for calcul the mask position with numpy : 0.008831262588500977 nb_pixel_total : 130774 time to create 1 rle with old method : 0.15096330642700195 length of segment : 590 time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 39500 time to create 1 rle with old method : 0.06924104690551758 length of segment : 372 time for calcul the mask position with numpy : 0.005879878997802734 nb_pixel_total : 163417 time to create 1 rle with new method : 0.015213489532470703 length of segment : 543 time for calcul the mask position with numpy : 0.002044200897216797 nb_pixel_total : 65680 time to create 1 rle with old method : 0.12499833106994629 length of segment : 397 time for calcul the mask position with numpy : 0.004099607467651367 nb_pixel_total : 113957 time to create 1 rle with old method : 0.20345449447631836 length of segment : 351 time for calcul the mask position with numpy : 0.012962818145751953 nb_pixel_total : 443646 time to create 1 rle with new method : 0.03127336502075195 length of segment : 594 time for calcul the mask position with numpy : 0.003662109375 nb_pixel_total : 94957 time to create 1 rle with old method : 0.12759971618652344 length of segment : 474 time for calcul the mask position with numpy : 0.009719371795654297 nb_pixel_total : 472657 time to create 1 rle with new method : 0.024103641510009766 length of segment : 1267 time for calcul the mask position with numpy : 0.004320859909057617 nb_pixel_total : 201871 time to create 1 rle with new method : 0.013489484786987305 length of segment : 548 time for calcul the mask position with numpy : 0.0105743408203125 nb_pixel_total : 437833 time to create 1 rle with new method : 0.023020505905151367 length of segment : 573 time for calcul the mask position with numpy : 0.0015079975128173828 nb_pixel_total : 54266 time to create 1 rle with old method : 0.06294822692871094 length of segment : 319 time for calcul the mask position with numpy : 0.0014729499816894531 nb_pixel_total : 60416 time to create 1 rle with old method : 0.07003068923950195 length of segment : 294 time for calcul the mask position with numpy : 0.0017805099487304688 nb_pixel_total : 55323 time to create 1 rle with old method : 0.06418323516845703 length of segment : 319 time for calcul the mask position with numpy : 0.005556583404541016 nb_pixel_total : 222913 time to create 1 rle with new method : 0.013524770736694336 length of segment : 875 time for calcul the mask position with numpy : 0.0024356842041015625 nb_pixel_total : 91702 time to create 1 rle with old method : 0.10523772239685059 length of segment : 466 time for calcul the mask position with numpy : 0.02478647232055664 nb_pixel_total : 874367 time to create 1 rle with new method : 0.24469709396362305 length of segment : 1762 time for calcul the mask position with numpy : 0.0009489059448242188 nb_pixel_total : 35766 time to create 1 rle with old method : 0.04635047912597656 length of segment : 194 time for calcul the mask position with numpy : 0.013279914855957031 nb_pixel_total : 640355 time to create 1 rle with new method : 0.13364362716674805 length of segment : 753 time for calcul the mask position with numpy : 0.0006892681121826172 nb_pixel_total : 28665 time to create 1 rle with old method : 0.033544301986694336 length of segment : 206 time for calcul the mask position with numpy : 0.002578258514404297 nb_pixel_total : 130086 time to create 1 rle with old method : 0.17234253883361816 length of segment : 417 time for calcul the mask position with numpy : 0.011074304580688477 nb_pixel_total : 211597 time to create 1 rle with new method : 0.016180992126464844 length of segment : 738 time for calcul the mask position with numpy : 0.0026726722717285156 nb_pixel_total : 115408 time to create 1 rle with old method : 0.1352400779724121 length of segment : 423 time for calcul the mask position with numpy : 0.002631664276123047 nb_pixel_total : 129865 time to create 1 rle with old method : 0.14679408073425293 length of segment : 423 time for calcul the mask position with numpy : 0.0011250972747802734 nb_pixel_total : 21801 time to create 1 rle with old method : 0.024994850158691406 length of segment : 191 time for calcul the mask position with numpy : 0.004487514495849609 nb_pixel_total : 83208 time to create 1 rle with old method : 0.09163784980773926 length of segment : 595 time for calcul the mask position with numpy : 0.0064089298248291016 nb_pixel_total : 80671 time to create 1 rle with old method : 0.08824348449707031 length of segment : 391 time for calcul the mask position with numpy : 0.018752336502075195 nb_pixel_total : 403685 time to create 1 rle with new method : 0.015488386154174805 length of segment : 603 time for calcul the mask position with numpy : 0.047304391860961914 nb_pixel_total : 1067592 time to create 1 rle with new method : 0.32313084602355957 length of segment : 1680 time for calcul the mask position with numpy : 0.008279561996459961 nb_pixel_total : 150712 time to create 1 rle with new method : 0.008781194686889648 length of segment : 436 time for calcul the mask position with numpy : 0.008090734481811523 nb_pixel_total : 146992 time to create 1 rle with old method : 0.16012048721313477 length of segment : 428 time for calcul the mask position with numpy : 0.002355337142944336 nb_pixel_total : 38977 time to create 1 rle with old method : 0.04526329040527344 length of segment : 208 time for calcul the mask position with numpy : 0.0037360191345214844 nb_pixel_total : 63877 time to create 1 rle with old method : 0.07123899459838867 length of segment : 267 time for calcul the mask position with numpy : 0.007180929183959961 nb_pixel_total : 120306 time to create 1 rle with old method : 0.13559889793395996 length of segment : 536 time for calcul the mask position with numpy : 0.0029282569885253906 nb_pixel_total : 45121 time to create 1 rle with old method : 0.0498964786529541 length of segment : 343 time for calcul the mask position with numpy : 0.0011301040649414062 nb_pixel_total : 19446 time to create 1 rle with old method : 0.02236795425415039 length of segment : 123 time for calcul the mask position with numpy : 0.010117530822753906 nb_pixel_total : 181134 time to create 1 rle with new method : 0.013487577438354492 length of segment : 758 time for calcul the mask position with numpy : 0.02592635154724121 nb_pixel_total : 400919 time to create 1 rle with new method : 0.05554342269897461 length of segment : 1186 time for calcul the mask position with numpy : 0.012699365615844727 nb_pixel_total : 207305 time to create 1 rle with new method : 0.012549638748168945 length of segment : 501 time for calcul the mask position with numpy : 0.0028214454650878906 nb_pixel_total : 55884 time to create 1 rle with old method : 0.06537389755249023 length of segment : 503 time for calcul the mask position with numpy : 0.003935575485229492 nb_pixel_total : 94312 time to create 1 rle with old method : 0.10917282104492188 length of segment : 294 time for calcul the mask position with numpy : 0.016704797744750977 nb_pixel_total : 179601 time to create 1 rle with new method : 0.021274328231811523 length of segment : 847 time for calcul the mask position with numpy : 0.004401445388793945 nb_pixel_total : 167501 time to create 1 rle with new method : 0.015212535858154297 length of segment : 992 time for calcul the mask position with numpy : 0.02665996551513672 nb_pixel_total : 975359 time to create 1 rle with new method : 0.09960484504699707 length of segment : 1297 time for calcul the mask position with numpy : 0.0015423297882080078 nb_pixel_total : 21284 time to create 1 rle with old method : 0.024701356887817383 length of segment : 148 time for calcul the mask position with numpy : 0.0015826225280761719 nb_pixel_total : 28457 time to create 1 rle with old method : 0.032946109771728516 length of segment : 223 time for calcul the mask position with numpy : 0.0028281211853027344 nb_pixel_total : 35791 time to create 1 rle with old method : 0.040920257568359375 length of segment : 227 time for calcul the mask position with numpy : 0.0032105445861816406 nb_pixel_total : 52661 time to create 1 rle with old method : 0.06168007850646973 length of segment : 476 time for calcul the mask position with numpy : 0.015965938568115234 nb_pixel_total : 144986 time to create 1 rle with old method : 0.1649153232574463 length of segment : 823 time for calcul the mask position with numpy : 0.001901388168334961 nb_pixel_total : 29274 time to create 1 rle with old method : 0.0355067253112793 length of segment : 412 time for calcul the mask position with numpy : 0.0022962093353271484 nb_pixel_total : 48021 time to create 1 rle with old method : 0.056035757064819336 length of segment : 314 time for calcul the mask position with numpy : 0.00940847396850586 nb_pixel_total : 194044 time to create 1 rle with new method : 0.009525775909423828 length of segment : 449 time for calcul the mask position with numpy : 0.0014066696166992188 nb_pixel_total : 52470 time to create 1 rle with old method : 0.07065987586975098 length of segment : 262 time for calcul the mask position with numpy : 0.0020678043365478516 nb_pixel_total : 23012 time to create 1 rle with old method : 0.028476953506469727 length of segment : 171 time for calcul the mask position with numpy : 0.0015192031860351562 nb_pixel_total : 29523 time to create 1 rle with old method : 0.034563541412353516 length of segment : 227 time for calcul the mask position with numpy : 0.042318105697631836 nb_pixel_total : 506719 time to create 1 rle with new method : 0.4316549301147461 length of segment : 1345 time for calcul the mask position with numpy : 0.003099679946899414 nb_pixel_total : 58426 time to create 1 rle with old method : 0.06705284118652344 length of segment : 259 time for calcul the mask position with numpy : 0.0017626285552978516 nb_pixel_total : 19092 time to create 1 rle with old method : 0.028363943099975586 length of segment : 207 time for calcul the mask position with numpy : 0.003263711929321289 nb_pixel_total : 65885 time to create 1 rle with old method : 0.0762777328491211 length of segment : 356 time for calcul the mask position with numpy : 0.0006737709045410156 nb_pixel_total : 22843 time to create 1 rle with old method : 0.026735782623291016 length of segment : 272 time for calcul the mask position with numpy : 0.01304936408996582 nb_pixel_total : 210533 time to create 1 rle with new method : 0.014535903930664062 length of segment : 567 time for calcul the mask position with numpy : 0.008965492248535156 nb_pixel_total : 202040 time to create 1 rle with new method : 0.011816978454589844 length of segment : 656 time for calcul the mask position with numpy : 0.020720243453979492 nb_pixel_total : 252495 time to create 1 rle with new method : 0.02318120002746582 length of segment : 662 time for calcul the mask position with numpy : 0.011650323867797852 nb_pixel_total : 166413 time to create 1 rle with new method : 0.018494844436645508 length of segment : 758 time for calcul the mask position with numpy : 0.013415336608886719 nb_pixel_total : 219158 time to create 1 rle with new method : 0.018199920654296875 length of segment : 1039 time for calcul the mask position with numpy : 0.017557621002197266 nb_pixel_total : 443261 time to create 1 rle with new method : 0.0240020751953125 length of segment : 1314 time for calcul the mask position with numpy : 0.0021517276763916016 nb_pixel_total : 45181 time to create 1 rle with old method : 0.051280975341796875 length of segment : 241 time for calcul the mask position with numpy : 0.017411470413208008 nb_pixel_total : 783613 time to create 1 rle with new method : 0.058409929275512695 length of segment : 1541 time for calcul the mask position with numpy : 0.002988100051879883 nb_pixel_total : 66366 time to create 1 rle with old method : 0.07781386375427246 length of segment : 270 time for calcul the mask position with numpy : 0.009048700332641602 nb_pixel_total : 162779 time to create 1 rle with new method : 0.01602792739868164 length of segment : 768 time for calcul the mask position with numpy : 0.0014066696166992188 nb_pixel_total : 33622 time to create 1 rle with old method : 0.039011240005493164 length of segment : 191 time for calcul the mask position with numpy : 0.012553930282592773 nb_pixel_total : 396449 time to create 1 rle with new method : 0.033657073974609375 length of segment : 1139 time for calcul the mask position with numpy : 0.004788875579833984 nb_pixel_total : 33816 time to create 1 rle with old method : 0.04047703742980957 length of segment : 496 time for calcul the mask position with numpy : 0.0018949508666992188 nb_pixel_total : 41987 time to create 1 rle with old method : 0.050412654876708984 length of segment : 311 time for calcul the mask position with numpy : 0.031316518783569336 nb_pixel_total : 610476 time to create 1 rle with new method : 0.03330588340759277 length of segment : 979 time for calcul the mask position with numpy : 0.0029892921447753906 nb_pixel_total : 124845 time to create 1 rle with old method : 0.17390751838684082 length of segment : 421 time for calcul the mask position with numpy : 0.008639812469482422 nb_pixel_total : 208272 time to create 1 rle with new method : 0.012749671936035156 length of segment : 557 time for calcul the mask position with numpy : 0.0732269287109375 nb_pixel_total : 968274 time to create 1 rle with new method : 0.5080749988555908 length of segment : 1287 time for calcul the mask position with numpy : 0.0013835430145263672 nb_pixel_total : 57629 time to create 1 rle with old method : 0.06671738624572754 length of segment : 272 time for calcul the mask position with numpy : 0.01023101806640625 nb_pixel_total : 149503 time to create 1 rle with old method : 0.1701982021331787 length of segment : 441 time for calcul the mask position with numpy : 0.0051195621490478516 nb_pixel_total : 219835 time to create 1 rle with new method : 0.013670921325683594 length of segment : 759 time for calcul the mask position with numpy : 0.010071754455566406 nb_pixel_total : 204642 time to create 1 rle with new method : 0.016739845275878906 length of segment : 546 time for calcul the mask position with numpy : 0.011318683624267578 nb_pixel_total : 222706 time to create 1 rle with new method : 0.016057252883911133 length of segment : 637 time for calcul the mask position with numpy : 0.002475261688232422 nb_pixel_total : 39262 time to create 1 rle with old method : 0.04623603820800781 length of segment : 337 time for calcul the mask position with numpy : 0.004636526107788086 nb_pixel_total : 108083 time to create 1 rle with old method : 0.1935269832611084 length of segment : 473 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 38258 time to create 1 rle with old method : 0.043580055236816406 length of segment : 217 time for calcul the mask position with numpy : 0.0027506351470947266 nb_pixel_total : 98942 time to create 1 rle with old method : 0.11422276496887207 length of segment : 501 time for calcul the mask position with numpy : 0.002681255340576172 nb_pixel_total : 65826 time to create 1 rle with old method : 0.07417702674865723 length of segment : 345 time for calcul the mask position with numpy : 0.004825592041015625 nb_pixel_total : 221208 time to create 1 rle with new method : 0.01364445686340332 length of segment : 601 time for calcul the mask position with numpy : 0.011636018753051758 nb_pixel_total : 646206 time to create 1 rle with new method : 0.029055118560791016 length of segment : 757 time for calcul the mask position with numpy : 0.00089263916015625 nb_pixel_total : 45478 time to create 1 rle with old method : 0.052040815353393555 length of segment : 504 time for calcul the mask position with numpy : 0.002834796905517578 nb_pixel_total : 83202 time to create 1 rle with old method : 0.1003580093383789 length of segment : 235 time for calcul the mask position with numpy : 0.007317066192626953 nb_pixel_total : 322169 time to create 1 rle with new method : 0.020183324813842773 length of segment : 1330 time for calcul the mask position with numpy : 0.0035462379455566406 nb_pixel_total : 177343 time to create 1 rle with new method : 0.009595394134521484 length of segment : 429 time for calcul the mask position with numpy : 0.002794027328491211 nb_pixel_total : 80634 time to create 1 rle with old method : 0.09079790115356445 length of segment : 411 time for calcul the mask position with numpy : 0.002936840057373047 nb_pixel_total : 135277 time to create 1 rle with old method : 0.15907549858093262 length of segment : 711 time for calcul the mask position with numpy : 0.004708766937255859 nb_pixel_total : 213785 time to create 1 rle with new method : 0.013146162033081055 length of segment : 648 time for calcul the mask position with numpy : 0.0010025501251220703 nb_pixel_total : 31670 time to create 1 rle with old method : 0.04042458534240723 length of segment : 279 time for calcul the mask position with numpy : 0.0022058486938476562 nb_pixel_total : 129071 time to create 1 rle with old method : 0.14862728118896484 length of segment : 577 time for calcul the mask position with numpy : 0.0007836818695068359 nb_pixel_total : 36806 time to create 1 rle with old method : 0.042633056640625 length of segment : 192 time for calcul the mask position with numpy : 0.0012311935424804688 nb_pixel_total : 50741 time to create 1 rle with old method : 0.07720804214477539 length of segment : 248 time for calcul the mask position with numpy : 0.019762754440307617 nb_pixel_total : 971069 time to create 1 rle with new method : 0.05875420570373535 length of segment : 1276 time for calcul the mask position with numpy : 0.0008366107940673828 nb_pixel_total : 32784 time to create 1 rle with old method : 0.0393679141998291 length of segment : 307 time for calcul the mask position with numpy : 0.001621246337890625 nb_pixel_total : 53946 time to create 1 rle with old method : 0.06152224540710449 length of segment : 278 time for calcul the mask position with numpy : 0.0193789005279541 nb_pixel_total : 964857 time to create 1 rle with new method : 0.0915517807006836 length of segment : 1258 time for calcul the mask position with numpy : 0.0027878284454345703 nb_pixel_total : 147211 time to create 1 rle with old method : 0.16585183143615723 length of segment : 590 time for calcul the mask position with numpy : 0.0028502941131591797 nb_pixel_total : 85258 time to create 1 rle with old method : 0.09906220436096191 length of segment : 546 time for calcul the mask position with numpy : 0.003877878189086914 nb_pixel_total : 156236 time to create 1 rle with new method : 0.010186433792114258 length of segment : 475 time for calcul the mask position with numpy : 0.01854419708251953 nb_pixel_total : 255811 time to create 1 rle with new method : 0.12780237197875977 length of segment : 1232 time for calcul the mask position with numpy : 0.011651754379272461 nb_pixel_total : 255868 time to create 1 rle with new method : 0.015614986419677734 length of segment : 473 time for calcul the mask position with numpy : 0.000982046127319336 nb_pixel_total : 30572 time to create 1 rle with old method : 0.03449058532714844 length of segment : 166 time for calcul the mask position with numpy : 0.005671262741088867 nb_pixel_total : 290641 time to create 1 rle with new method : 0.01689457893371582 length of segment : 1016 time for calcul the mask position with numpy : 0.00501704216003418 nb_pixel_total : 214155 time to create 1 rle with new method : 0.014303445816040039 length of segment : 540 time for calcul the mask position with numpy : 0.002955913543701172 nb_pixel_total : 145200 time to create 1 rle with old method : 0.16419506072998047 length of segment : 585 time for calcul the mask position with numpy : 0.0062634944915771484 nb_pixel_total : 306767 time to create 1 rle with new method : 0.018496036529541016 length of segment : 1109 time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 17899 time to create 1 rle with old method : 0.02103900909423828 length of segment : 169 time for calcul the mask position with numpy : 0.0017650127410888672 nb_pixel_total : 64993 time to create 1 rle with old method : 0.0757131576538086 length of segment : 484 time for calcul the mask position with numpy : 0.00110626220703125 nb_pixel_total : 26868 time to create 1 rle with old method : 0.031119585037231445 length of segment : 128 time for calcul the mask position with numpy : 0.0019676685333251953 nb_pixel_total : 86358 time to create 1 rle with old method : 0.09864425659179688 length of segment : 349 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 25681 time to create 1 rle with old method : 0.030419111251831055 length of segment : 178 time for calcul the mask position with numpy : 0.002860546112060547 nb_pixel_total : 112044 time to create 1 rle with old method : 0.12824487686157227 length of segment : 407 time for calcul the mask position with numpy : 0.003936052322387695 nb_pixel_total : 191743 time to create 1 rle with new method : 0.010419130325317383 length of segment : 460 time for calcul the mask position with numpy : 0.0024721622467041016 nb_pixel_total : 78536 time to create 1 rle with old method : 0.08985567092895508 length of segment : 485 time for calcul the mask position with numpy : 0.006307125091552734 nb_pixel_total : 213971 time to create 1 rle with new method : 0.014255523681640625 length of segment : 622 time for calcul the mask position with numpy : 0.003445148468017578 nb_pixel_total : 148943 time to create 1 rle with old method : 0.17146921157836914 length of segment : 524 time for calcul the mask position with numpy : 0.0006306171417236328 nb_pixel_total : 24007 time to create 1 rle with old method : 0.03481626510620117 length of segment : 219 time for calcul the mask position with numpy : 0.010242462158203125 nb_pixel_total : 419217 time to create 1 rle with new method : 0.5447492599487305 length of segment : 1018 time for calcul the mask position with numpy : 0.0006940364837646484 nb_pixel_total : 29433 time to create 1 rle with old method : 0.03314375877380371 length of segment : 258 time for calcul the mask position with numpy : 0.002946138381958008 nb_pixel_total : 97503 time to create 1 rle with old method : 0.11135339736938477 length of segment : 810 time for calcul the mask position with numpy : 0.0024542808532714844 nb_pixel_total : 88257 time to create 1 rle with old method : 0.10280466079711914 length of segment : 346 time for calcul the mask position with numpy : 0.009958267211914062 nb_pixel_total : 342716 time to create 1 rle with new method : 0.029067277908325195 length of segment : 1660 time for calcul the mask position with numpy : 0.002982616424560547 nb_pixel_total : 161498 time to create 1 rle with new method : 0.007141828536987305 length of segment : 919 time for calcul the mask position with numpy : 0.0013911724090576172 nb_pixel_total : 61619 time to create 1 rle with old method : 0.07107734680175781 length of segment : 258 time for calcul the mask position with numpy : 0.0030837059020996094 nb_pixel_total : 156182 time to create 1 rle with new method : 0.008648395538330078 length of segment : 417 time for calcul the mask position with numpy : 0.0030231475830078125 nb_pixel_total : 154241 time to create 1 rle with new method : 0.008110284805297852 length of segment : 403 time for calcul the mask position with numpy : 0.0022745132446289062 nb_pixel_total : 110146 time to create 1 rle with old method : 0.12605071067810059 length of segment : 265 time for calcul the mask position with numpy : 0.0007379055023193359 nb_pixel_total : 33947 time to create 1 rle with old method : 0.039613962173461914 length of segment : 285 time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 38106 time to create 1 rle with old method : 0.04438281059265137 length of segment : 292 time for calcul the mask position with numpy : 0.0034027099609375 nb_pixel_total : 136635 time to create 1 rle with old method : 0.16045689582824707 length of segment : 521 time for calcul the mask position with numpy : 0.021765708923339844 nb_pixel_total : 794483 time to create 1 rle with new method : 1.325087308883667 length of segment : 1150 time for calcul the mask position with numpy : 0.0026290416717529297 nb_pixel_total : 94455 time to create 1 rle with old method : 0.10898971557617188 length of segment : 394 time for calcul the mask position with numpy : 0.019695520401000977 nb_pixel_total : 951837 time to create 1 rle with new method : 0.5373599529266357 length of segment : 1306 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 40074 time to create 1 rle with old method : 0.04634380340576172 length of segment : 285 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 59954 time to create 1 rle with old method : 0.06716394424438477 length of segment : 262 time for calcul the mask position with numpy : 0.0051116943359375 nb_pixel_total : 247424 time to create 1 rle with new method : 0.013874530792236328 length of segment : 474 time for calcul the mask position with numpy : 0.0021119117736816406 nb_pixel_total : 112274 time to create 1 rle with old method : 0.13461637496948242 length of segment : 407 time for calcul the mask position with numpy : 0.014847040176391602 nb_pixel_total : 453769 time to create 1 rle with new method : 0.05176234245300293 length of segment : 902 time for calcul the mask position with numpy : 0.007696866989135742 nb_pixel_total : 317052 time to create 1 rle with new method : 0.02180647850036621 length of segment : 731 time for calcul the mask position with numpy : 0.007089138031005859 nb_pixel_total : 343777 time to create 1 rle with new method : 0.023290634155273438 length of segment : 767 time for calcul the mask position with numpy : 0.002662181854248047 nb_pixel_total : 109252 time to create 1 rle with old method : 0.1260051727294922 length of segment : 473 time for calcul the mask position with numpy : 0.0008814334869384766 nb_pixel_total : 30061 time to create 1 rle with old method : 0.03584694862365723 length of segment : 222 time for calcul the mask position with numpy : 0.006106853485107422 nb_pixel_total : 271799 time to create 1 rle with new method : 0.02126145362854004 length of segment : 782 time for calcul the mask position with numpy : 0.02354121208190918 nb_pixel_total : 837489 time to create 1 rle with new method : 0.16036677360534668 length of segment : 1861 time for calcul the mask position with numpy : 0.0035033226013183594 nb_pixel_total : 164416 time to create 1 rle with new method : 0.009064674377441406 length of segment : 409 time for calcul the mask position with numpy : 0.0016908645629882812 nb_pixel_total : 37085 time to create 1 rle with old method : 0.043212890625 length of segment : 182 time for calcul the mask position with numpy : 0.0009744167327880859 nb_pixel_total : 31049 time to create 1 rle with old method : 0.0355839729309082 length of segment : 218 time for calcul the mask position with numpy : 0.5104143619537354 nb_pixel_total : 2087434 time to create 1 rle with new method : 0.6589818000793457 length of segment : 1718 time for calcul the mask position with numpy : 0.004626750946044922 nb_pixel_total : 99398 time to create 1 rle with old method : 0.11201620101928711 length of segment : 425 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 23024 time to create 1 rle with old method : 0.03307676315307617 length of segment : 163 time for calcul the mask position with numpy : 0.0008852481842041016 nb_pixel_total : 24560 time to create 1 rle with old method : 0.028552532196044922 length of segment : 164 time for calcul the mask position with numpy : 0.0005970001220703125 nb_pixel_total : 13222 time to create 1 rle with old method : 0.017896175384521484 length of segment : 113 time for calcul the mask position with numpy : 0.007555723190307617 nb_pixel_total : 181372 time to create 1 rle with new method : 0.021639585494995117 length of segment : 658 time for calcul the mask position with numpy : 0.0010039806365966797 nb_pixel_total : 37982 time to create 1 rle with old method : 0.04345893859863281 length of segment : 256 time for calcul the mask position with numpy : 0.0015468597412109375 nb_pixel_total : 61770 time to create 1 rle with old method : 0.08901643753051758 length of segment : 368 time for calcul the mask position with numpy : 0.0009441375732421875 nb_pixel_total : 21600 time to create 1 rle with old method : 0.025004863739013672 length of segment : 227 time for calcul the mask position with numpy : 0.0027229785919189453 nb_pixel_total : 117470 time to create 1 rle with old method : 0.13327598571777344 length of segment : 548 time for calcul the mask position with numpy : 0.007872343063354492 nb_pixel_total : 179942 time to create 1 rle with new method : 0.04281139373779297 length of segment : 920 time for calcul the mask position with numpy : 0.0024569034576416016 nb_pixel_total : 60467 time to create 1 rle with old method : 0.06957244873046875 length of segment : 656 time for calcul the mask position with numpy : 0.0019497871398925781 nb_pixel_total : 36159 time to create 1 rle with old method : 0.04416513442993164 length of segment : 282 time for calcul the mask position with numpy : 0.0014376640319824219 nb_pixel_total : 36910 time to create 1 rle with old method : 0.04256272315979004 length of segment : 302 time for calcul the mask position with numpy : 0.0008053779602050781 nb_pixel_total : 15823 time to create 1 rle with old method : 0.01919412612915039 length of segment : 159 time for calcul the mask position with numpy : 0.004212379455566406 nb_pixel_total : 156351 time to create 1 rle with new method : 0.01314854621887207 length of segment : 545 time for calcul the mask position with numpy : 0.00825810432434082 nb_pixel_total : 200189 time to create 1 rle with new method : 0.04128718376159668 length of segment : 721 time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 38106 time to create 1 rle with old method : 0.0505826473236084 length of segment : 185 time for calcul the mask position with numpy : 0.0054166316986083984 nb_pixel_total : 222855 time to create 1 rle with new method : 0.01635265350341797 length of segment : 644 time for calcul the mask position with numpy : 0.0047838687896728516 nb_pixel_total : 171746 time to create 1 rle with new method : 0.013308048248291016 length of segment : 391 time for calcul the mask position with numpy : 0.023676633834838867 nb_pixel_total : 734675 time to create 1 rle with new method : 0.24960827827453613 length of segment : 1285 time for calcul the mask position with numpy : 0.0023643970489501953 nb_pixel_total : 10418 time to create 1 rle with old method : 0.013031244277954102 length of segment : 217 time for calcul the mask position with numpy : 0.002678394317626953 nb_pixel_total : 85047 time to create 1 rle with old method : 0.12606430053710938 length of segment : 325 time for calcul the mask position with numpy : 0.004677772521972656 nb_pixel_total : 131563 time to create 1 rle with old method : 0.17866253852844238 length of segment : 503 time for calcul the mask position with numpy : 0.0006844997406005859 nb_pixel_total : 8771 time to create 1 rle with old method : 0.011181831359863281 length of segment : 220 time for calcul the mask position with numpy : 0.0009119510650634766 nb_pixel_total : 39689 time to create 1 rle with old method : 0.04551553726196289 length of segment : 211 time for calcul the mask position with numpy : 0.002045869827270508 nb_pixel_total : 70662 time to create 1 rle with old method : 0.08122444152832031 length of segment : 389 time for calcul the mask position with numpy : 0.002794504165649414 nb_pixel_total : 96094 time to create 1 rle with old method : 0.11222171783447266 length of segment : 442 time for calcul the mask position with numpy : 0.0008556842803955078 nb_pixel_total : 32261 time to create 1 rle with old method : 0.03699302673339844 length of segment : 267 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 16473 time to create 1 rle with old method : 0.01923346519470215 length of segment : 270 time for calcul the mask position with numpy : 0.0030469894409179688 nb_pixel_total : 144828 time to create 1 rle with old method : 0.16710138320922852 length of segment : 481 time for calcul the mask position with numpy : 0.004000186920166016 nb_pixel_total : 148542 time to create 1 rle with old method : 0.17679786682128906 length of segment : 411 time for calcul the mask position with numpy : 0.0013921260833740234 nb_pixel_total : 42495 time to create 1 rle with old method : 0.049829959869384766 length of segment : 257 time for calcul the mask position with numpy : 0.0005774497985839844 nb_pixel_total : 12948 time to create 1 rle with old method : 0.01503133773803711 length of segment : 312 time for calcul the mask position with numpy : 0.002820730209350586 nb_pixel_total : 114246 time to create 1 rle with old method : 0.1300210952758789 length of segment : 354 time for calcul the mask position with numpy : 0.002884387969970703 nb_pixel_total : 109751 time to create 1 rle with old method : 0.12523889541625977 length of segment : 288 time for calcul the mask position with numpy : 0.010173559188842773 nb_pixel_total : 237505 time to create 1 rle with new method : 0.053201913833618164 length of segment : 870 time for calcul the mask position with numpy : 0.0015668869018554688 nb_pixel_total : 64214 time to create 1 rle with old method : 0.08401203155517578 length of segment : 238 time for calcul the mask position with numpy : 0.001392364501953125 nb_pixel_total : 62865 time to create 1 rle with old method : 0.0720968246459961 length of segment : 348 time for calcul the mask position with numpy : 0.0010340213775634766 nb_pixel_total : 21500 time to create 1 rle with old method : 0.026668548583984375 length of segment : 177 time for calcul the mask position with numpy : 0.003932952880859375 nb_pixel_total : 169898 time to create 1 rle with new method : 0.012801408767700195 length of segment : 362 time for calcul the mask position with numpy : 0.0011782646179199219 nb_pixel_total : 35140 time to create 1 rle with old method : 0.04173469543457031 length of segment : 248 time for calcul the mask position with numpy : 0.0027997493743896484 nb_pixel_total : 77799 time to create 1 rle with old method : 0.09052491188049316 length of segment : 334 time for calcul the mask position with numpy : 0.0020377635955810547 nb_pixel_total : 71657 time to create 1 rle with old method : 0.08420062065124512 length of segment : 404 time for calcul the mask position with numpy : 0.0018184185028076172 nb_pixel_total : 44980 time to create 1 rle with old method : 0.05704379081726074 length of segment : 378 time for calcul the mask position with numpy : 0.0054340362548828125 nb_pixel_total : 175426 time to create 1 rle with new method : 0.011832952499389648 length of segment : 391 time for calcul the mask position with numpy : 0.004291534423828125 nb_pixel_total : 144988 time to create 1 rle with old method : 0.17122435569763184 length of segment : 426 time for calcul the mask position with numpy : 0.0023746490478515625 nb_pixel_total : 79103 time to create 1 rle with old method : 0.09077596664428711 length of segment : 583 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 20226 time to create 1 rle with old method : 0.02463555335998535 length of segment : 224 time for calcul the mask position with numpy : 0.0041255950927734375 nb_pixel_total : 165747 time to create 1 rle with new method : 0.012526750564575195 length of segment : 395 time for calcul the mask position with numpy : 0.0015099048614501953 nb_pixel_total : 64518 time to create 1 rle with old method : 0.09901976585388184 length of segment : 232 time for calcul the mask position with numpy : 0.0019142627716064453 nb_pixel_total : 72480 time to create 1 rle with old method : 0.08370757102966309 length of segment : 350 time for calcul the mask position with numpy : 0.0023887157440185547 nb_pixel_total : 77140 time to create 1 rle with old method : 0.11134862899780273 length of segment : 367 time for calcul the mask position with numpy : 0.003964424133300781 nb_pixel_total : 157652 time to create 1 rle with new method : 0.01268148422241211 length of segment : 488 time for calcul the mask position with numpy : 0.0011758804321289062 nb_pixel_total : 50942 time to create 1 rle with old method : 0.05728435516357422 length of segment : 255 time for calcul the mask position with numpy : 0.001081705093383789 nb_pixel_total : 51307 time to create 1 rle with old method : 0.05872845649719238 length of segment : 265 time for calcul the mask position with numpy : 0.013176202774047852 nb_pixel_total : 357067 time to create 1 rle with new method : 0.04542684555053711 length of segment : 679 time for calcul the mask position with numpy : 0.003656148910522461 nb_pixel_total : 149303 time to create 1 rle with old method : 0.2138514518737793 length of segment : 543 time for calcul the mask position with numpy : 0.0045931339263916016 nb_pixel_total : 161167 time to create 1 rle with new method : 0.010170221328735352 length of segment : 513 time for calcul the mask position with numpy : 1.1569139957427979 nb_pixel_total : 9821572 time to create 1 rle with new method : 1.278836727142334 length of segment : 5768 time for calcul the mask position with numpy : 0.0015692710876464844 nb_pixel_total : 85492 time to create 1 rle with old method : 0.10100436210632324 length of segment : 580 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 39725 time to create 1 rle with old method : 0.04569649696350098 length of segment : 192 time for calcul the mask position with numpy : 0.0007627010345458984 nb_pixel_total : 38833 time to create 1 rle with old method : 0.05492711067199707 length of segment : 187 time spent for convertir_results : 64.67510151863098 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 388 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 187.74981594085693 time spend to save output : 0.31423401832580566 total time spend for step 2 : 188.06404995918274 step3:blur_detection Tue Mar 11 01:06:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 1506.1025504747681 (4160, 3120) 1245.6866617838193 (4160, 3120) 3073.7241590778112 (4160, 3120) 2083.4446205426 (4160, 3120) 3340.4160923632567 (4160, 3120) 704.5751881980573 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.011966228485107422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.013208150863647461 save missing photos in datou_result : time spend for datou_step_exec : 4.382692813873291 time spend to save output : 0.030011653900146484 total time spend for step 3 : 4.4127044677734375 step4:brightness Tue Mar 11 01:06:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741651288_1866620_1342523879_0c108ac23bb4a45d70c8611b13efb7bc.jpg treat image : temp/1741651288_1866620_1342523853_ffa7d935265627ca710816ac818643b3.jpg treat image : temp/1741651288_1866620_1342523849_dbe58198a9ed44b585df59d0b5d27cd2.jpg treat image : temp/1741651288_1866620_1342523842_a63c62b68ffbaeebfc930c95884cb3c9.jpg treat image : temp/1741651288_1866620_1342523838_bba0b8bfe8a0d57b83336082265453c1.jpg treat image : temp/1741651288_1866620_1342523834_43d7f3cc846fcee449c5ba9efb823e65.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.01325535774230957 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.013610124588012695 save missing photos in datou_result : time spend for datou_step_exec : 10.75000524520874 time spend to save output : 0.03201460838317871 total time spend for step 4 : 10.782019853591919 step5:rle_unique_nms_with_priority Tue Mar 11 01:06:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 388 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 74 nb_hashtags : 10 time to prepare the origin masks : 71.77480435371399 time for calcul the mask position with numpy : 0.2785823345184326 nb_pixel_total : 2814672 time to create 1 rle with new method : 2.041018486022949 time for calcul the mask position with numpy : 0.18446660041809082 nb_pixel_total : 14335 time to create 1 rle with old method : 0.015581130981445312 time for calcul the mask position with numpy : 0.0553584098815918 nb_pixel_total : 73643 time to create 1 rle with old method : 0.08306503295898438 time for calcul the mask position with numpy : 0.17714285850524902 nb_pixel_total : 78893 time to create 1 rle with old method : 0.08677077293395996 time for calcul the mask position with numpy : 0.06406378746032715 nb_pixel_total : 264837 time to create 1 rle with new method : 3.341698169708252 time for calcul the mask position with numpy : 0.1741781234741211 nb_pixel_total : 291411 time to create 1 rle with new method : 1.4522037506103516 time for calcul the mask position with numpy : 0.054601430892944336 nb_pixel_total : 78756 time to create 1 rle with old method : 0.08896541595458984 time for calcul the mask position with numpy : 0.17520523071289062 nb_pixel_total : 611 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.16720914840698242 nb_pixel_total : 23205 time to create 1 rle with old method : 0.024959087371826172 time for calcul the mask position with numpy : 0.17155122756958008 nb_pixel_total : 22444 time to create 1 rle with old method : 0.02523183822631836 time for calcul the mask position with numpy : 0.10822772979736328 nb_pixel_total : 28720 time to create 1 rle with old method : 0.03355526924133301 time for calcul the mask position with numpy : 0.1477499008178711 nb_pixel_total : 171849 time to create 1 rle with new method : 2.99717378616333 time for calcul the mask position with numpy : 0.11449646949768066 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007936954498291016 time for calcul the mask position with numpy : 0.4270753860473633 nb_pixel_total : 664161 time to create 1 rle with new method : 1.8022518157958984 time for calcul the mask position with numpy : 0.1755232810974121 nb_pixel_total : 117476 time to create 1 rle with old method : 0.1375880241394043 time for calcul the mask position with numpy : 0.1790001392364502 nb_pixel_total : 159552 time to create 1 rle with new method : 2.925058126449585 time for calcul the mask position with numpy : 0.07120704650878906 nb_pixel_total : 4865 time to create 1 rle with old method : 0.005770206451416016 time for calcul the mask position with numpy : 0.06897974014282227 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0018177032470703125 time for calcul the mask position with numpy : 0.11178755760192871 nb_pixel_total : 681805 time to create 1 rle with new method : 1.3770627975463867 time for calcul the mask position with numpy : 0.19176959991455078 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004512786865234375 time for calcul the mask position with numpy : 0.17394781112670898 nb_pixel_total : 11648 time to create 1 rle with old method : 0.014163732528686523 time for calcul the mask position with numpy : 0.1785287857055664 nb_pixel_total : 272234 time to create 1 rle with new method : 1.7284901142120361 time for calcul the mask position with numpy : 0.05851149559020996 nb_pixel_total : 199691 time to create 1 rle with new method : 0.7584104537963867 time for calcul the mask position with numpy : 0.16138315200805664 nb_pixel_total : 24938 time to create 1 rle with old method : 0.028372764587402344 time for calcul the mask position with numpy : 0.05803251266479492 nb_pixel_total : 171088 time to create 1 rle with new method : 1.2565312385559082 time for calcul the mask position with numpy : 0.18500995635986328 nb_pixel_total : 751698 time to create 1 rle with new method : 1.8930103778839111 time for calcul the mask position with numpy : 0.09678268432617188 nb_pixel_total : 6345 time to create 1 rle with old method : 0.008266925811767578 time for calcul the mask position with numpy : 0.1655442714691162 nb_pixel_total : 463834 time to create 1 rle with new method : 1.2545390129089355 time for calcul the mask position with numpy : 0.17629480361938477 nb_pixel_total : 34388 time to create 1 rle with old method : 0.03980875015258789 time for calcul the mask position with numpy : 0.17581439018249512 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002968311309814453 time for calcul the mask position with numpy : 0.17573976516723633 nb_pixel_total : 106660 time to create 1 rle with old method : 0.11844825744628906 time for calcul the mask position with numpy : 0.17591595649719238 nb_pixel_total : 17800 time to create 1 rle with old method : 0.020851612091064453 time for calcul the mask position with numpy : 0.1737508773803711 nb_pixel_total : 14726 time to create 1 rle with old method : 0.016440868377685547 time for calcul the mask position with numpy : 0.17641210556030273 nb_pixel_total : 28007 time to create 1 rle with old method : 0.0313720703125 time for calcul the mask position with numpy : 0.07832574844360352 nb_pixel_total : 388667 time to create 1 rle with new method : 1.5759856700897217 time for calcul the mask position with numpy : 0.17408251762390137 nb_pixel_total : 6212 time to create 1 rle with old method : 0.007131814956665039 time for calcul the mask position with numpy : 0.1499030590057373 nb_pixel_total : 102262 time to create 1 rle with old method : 0.1153402328491211 time for calcul the mask position with numpy : 0.1584489345550537 nb_pixel_total : 58014 time to create 1 rle with old method : 0.06435108184814453 time for calcul the mask position with numpy : 0.17595982551574707 nb_pixel_total : 12139 time to create 1 rle with old method : 0.014080047607421875 time for calcul the mask position with numpy : 0.05964398384094238 nb_pixel_total : 57370 time to create 1 rle with old method : 0.06749749183654785 time for calcul the mask position with numpy : 0.17476511001586914 nb_pixel_total : 42909 time to create 1 rle with old method : 0.04723310470581055 time for calcul the mask position with numpy : 0.17628836631774902 nb_pixel_total : 43586 time to create 1 rle with old method : 0.04875373840332031 time for calcul the mask position with numpy : 0.19118714332580566 nb_pixel_total : 4787 time to create 1 rle with old method : 0.00915980339050293 time for calcul the mask position with numpy : 0.10116076469421387 nb_pixel_total : 11382 time to create 1 rle with old method : 0.013497352600097656 time for calcul the mask position with numpy : 0.11964845657348633 nb_pixel_total : 69177 time to create 1 rle with old method : 0.07947301864624023 time for calcul the mask position with numpy : 0.09373307228088379 nb_pixel_total : 56105 time to create 1 rle with old method : 0.06623578071594238 time for calcul the mask position with numpy : 0.19180917739868164 nb_pixel_total : 1715799 time to create 1 rle with new method : 0.561009407043457 time for calcul the mask position with numpy : 0.1768326759338379 nb_pixel_total : 6980 time to create 1 rle with old method : 0.008622407913208008 time for calcul the mask position with numpy : 0.17632341384887695 nb_pixel_total : 75613 time to create 1 rle with old method : 0.09047722816467285 time for calcul the mask position with numpy : 0.181596040725708 nb_pixel_total : 597301 time to create 1 rle with new method : 0.9921560287475586 time for calcul the mask position with numpy : 0.05794191360473633 nb_pixel_total : 15816 time to create 1 rle with old method : 0.01795673370361328 time for calcul the mask position with numpy : 0.05544590950012207 nb_pixel_total : 25972 time to create 1 rle with old method : 0.03159642219543457 time for calcul the mask position with numpy : 0.06501984596252441 nb_pixel_total : 89751 time to create 1 rle with old method : 0.10663914680480957 time for calcul the mask position with numpy : 0.08305048942565918 nb_pixel_total : 4697 time to create 1 rle with old method : 0.0054209232330322266 time for calcul the mask position with numpy : 0.05576729774475098 nb_pixel_total : 29068 time to create 1 rle with old method : 0.0336003303527832 time for calcul the mask position with numpy : 0.11213421821594238 nb_pixel_total : 8466 time to create 1 rle with old method : 0.009935855865478516 time for calcul the mask position with numpy : 0.1772289276123047 nb_pixel_total : 54237 time to create 1 rle with old method : 0.06392884254455566 time for calcul the mask position with numpy : 0.15154051780700684 nb_pixel_total : 44086 time to create 1 rle with old method : 0.04907822608947754 time for calcul the mask position with numpy : 0.08422994613647461 nb_pixel_total : 1833 time to create 1 rle with old method : 0.002401590347290039 time for calcul the mask position with numpy : 0.09657073020935059 nb_pixel_total : 28876 time to create 1 rle with old method : 0.03344082832336426 time for calcul the mask position with numpy : 0.18536806106567383 nb_pixel_total : 347385 time to create 1 rle with new method : 1.177903652191162 time for calcul the mask position with numpy : 0.17582368850708008 nb_pixel_total : 27529 time to create 1 rle with old method : 0.03198504447937012 time for calcul the mask position with numpy : 0.06203579902648926 nb_pixel_total : 339762 time to create 1 rle with new method : 0.9310662746429443 time for calcul the mask position with numpy : 0.18458175659179688 nb_pixel_total : 38806 time to create 1 rle with old method : 0.047162771224975586 time for calcul the mask position with numpy : 0.12859797477722168 nb_pixel_total : 560168 time to create 1 rle with new method : 2.635453939437866 time for calcul the mask position with numpy : 0.14620757102966309 nb_pixel_total : 5969 time to create 1 rle with old method : 0.008300065994262695 time for calcul the mask position with numpy : 0.07784438133239746 nb_pixel_total : 93444 time to create 1 rle with old method : 0.10067248344421387 time for calcul the mask position with numpy : 0.152024507522583 nb_pixel_total : 28130 time to create 1 rle with old method : 0.03262686729431152 time for calcul the mask position with numpy : 0.17312383651733398 nb_pixel_total : 2921 time to create 1 rle with old method : 0.0035326480865478516 time for calcul the mask position with numpy : 0.1721055507659912 nb_pixel_total : 1672 time to create 1 rle with old method : 0.0019259452819824219 time for calcul the mask position with numpy : 0.17228364944458008 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004942417144775391 time for calcul the mask position with numpy : 0.18041729927062988 nb_pixel_total : 277074 time to create 1 rle with new method : 1.5028152465820312 time for calcul the mask position with numpy : 0.16996097564697266 nb_pixel_total : 43234 time to create 1 rle with old method : 0.047425031661987305 time for calcul the mask position with numpy : 0.08752250671386719 nb_pixel_total : 8310 time to create 1 rle with old method : 0.009111166000366211 time for calcul the mask position with numpy : 0.1625535488128662 nb_pixel_total : 53209 time to create 1 rle with old method : 0.15204524993896484 create new chi : 46.5165376663208 time to delete rle : 0.0431513786315918 batch 1 Loaded 75 chid ids of type : 4855 Number RLEs to save : 59687 TO DO : save crop sub photo not yet done ! save time : 25.60602378845215 nb_obj : 78 nb_hashtags : 9 time to prepare the origin masks : 66.73077607154846 time for calcul the mask position with numpy : 0.33509087562561035 nb_pixel_total : 3358032 time to create 1 rle with new method : 1.3466401100158691 time for calcul the mask position with numpy : 0.12857484817504883 nb_pixel_total : 48575 time to create 1 rle with old method : 0.05527806282043457 time for calcul the mask position with numpy : 0.055182695388793945 nb_pixel_total : 7946 time to create 1 rle with old method : 0.010356664657592773 time for calcul the mask position with numpy : 0.1533832550048828 nb_pixel_total : 27612 time to create 1 rle with old method : 0.03032708168029785 time for calcul the mask position with numpy : 0.17323756217956543 nb_pixel_total : 18480 time to create 1 rle with old method : 0.020039796829223633 time for calcul the mask position with numpy : 0.16724634170532227 nb_pixel_total : 8368 time to create 1 rle with old method : 0.009515047073364258 time for calcul the mask position with numpy : 0.05398273468017578 nb_pixel_total : 45281 time to create 1 rle with old method : 0.04845070838928223 time for calcul the mask position with numpy : 0.11661219596862793 nb_pixel_total : 22343 time to create 1 rle with old method : 0.025947093963623047 time for calcul the mask position with numpy : 0.10283160209655762 nb_pixel_total : 94156 time to create 1 rle with old method : 0.10628223419189453 time for calcul the mask position with numpy : 0.05312371253967285 nb_pixel_total : 31227 time to create 1 rle with old method : 0.03439831733703613 time for calcul the mask position with numpy : 0.1726691722869873 nb_pixel_total : 78176 time to create 1 rle with old method : 0.08651041984558105 time for calcul the mask position with numpy : 0.07349300384521484 nb_pixel_total : 80554 time to create 1 rle with old method : 0.08947873115539551 time for calcul the mask position with numpy : 0.169677734375 nb_pixel_total : 6566 time to create 1 rle with old method : 0.007428169250488281 time for calcul the mask position with numpy : 0.1610112190246582 nb_pixel_total : 157336 time to create 1 rle with new method : 1.424738883972168 time for calcul the mask position with numpy : 0.18163752555847168 nb_pixel_total : 228808 time to create 1 rle with new method : 1.4511446952819824 time for calcul the mask position with numpy : 0.18257546424865723 nb_pixel_total : 234375 time to create 1 rle with new method : 1.0554358959197998 time for calcul the mask position with numpy : 0.05737900733947754 nb_pixel_total : 107050 time to create 1 rle with old method : 0.1254277229309082 time for calcul the mask position with numpy : 0.17777204513549805 nb_pixel_total : 4043 time to create 1 rle with old method : 0.004830121994018555 time for calcul the mask position with numpy : 0.1761152744293213 nb_pixel_total : 18844 time to create 1 rle with old method : 0.021903038024902344 time for calcul the mask position with numpy : 0.17515778541564941 nb_pixel_total : 17700 time to create 1 rle with old method : 0.020452022552490234 time for calcul the mask position with numpy : 0.17469358444213867 nb_pixel_total : 52214 time to create 1 rle with old method : 0.058856964111328125 time for calcul the mask position with numpy : 0.05482935905456543 nb_pixel_total : 60301 time to create 1 rle with old method : 0.0675511360168457 time for calcul the mask position with numpy : 0.1773850917816162 nb_pixel_total : 40178 time to create 1 rle with old method : 0.045029401779174805 time for calcul the mask position with numpy : 0.055342912673950195 nb_pixel_total : 65710 time to create 1 rle with old method : 0.07400918006896973 time for calcul the mask position with numpy : 0.17522048950195312 nb_pixel_total : 91733 time to create 1 rle with old method : 0.10365176200866699 time for calcul the mask position with numpy : 0.17958545684814453 nb_pixel_total : 220274 time to create 1 rle with new method : 1.5049619674682617 time for calcul the mask position with numpy : 0.1739966869354248 nb_pixel_total : 9382 time to create 1 rle with old method : 0.010442495346069336 time for calcul the mask position with numpy : 0.17674469947814941 nb_pixel_total : 23915 time to create 1 rle with old method : 0.026697635650634766 time for calcul the mask position with numpy : 0.052765607833862305 nb_pixel_total : 581 time to create 1 rle with old method : 0.0009675025939941406 time for calcul the mask position with numpy : 0.16806912422180176 nb_pixel_total : 50619 time to create 1 rle with old method : 0.05353236198425293 time for calcul the mask position with numpy : 0.05419015884399414 nb_pixel_total : 112727 time to create 1 rle with old method : 0.12059402465820312 time for calcul the mask position with numpy : 0.05208420753479004 nb_pixel_total : 40700 time to create 1 rle with old method : 0.04561948776245117 time for calcul the mask position with numpy : 0.17661690711975098 nb_pixel_total : 184233 time to create 1 rle with new method : 1.2201907634735107 time for calcul the mask position with numpy : 0.1822357177734375 nb_pixel_total : 316782 time to create 1 rle with new method : 0.8658158779144287 time for calcul the mask position with numpy : 0.17810511589050293 nb_pixel_total : 144413 time to create 1 rle with old method : 0.17322111129760742 time for calcul the mask position with numpy : 0.17731618881225586 nb_pixel_total : 39421 time to create 1 rle with old method : 0.043663978576660156 time for calcul the mask position with numpy : 0.08391141891479492 nb_pixel_total : 1163848 time to create 1 rle with new method : 1.0753240585327148 time for calcul the mask position with numpy : 0.05419278144836426 nb_pixel_total : 35428 time to create 1 rle with old method : 0.03936767578125 time for calcul the mask position with numpy : 0.17725324630737305 nb_pixel_total : 29531 time to create 1 rle with old method : 0.034479618072509766 time for calcul the mask position with numpy : 0.05447983741760254 nb_pixel_total : 55204 time to create 1 rle with old method : 0.06217598915100098 time for calcul the mask position with numpy : 0.055774688720703125 nb_pixel_total : 56261 time to create 1 rle with old method : 0.06564092636108398 time for calcul the mask position with numpy : 0.05566048622131348 nb_pixel_total : 64837 time to create 1 rle with old method : 0.0754709243774414 time for calcul the mask position with numpy : 0.17597627639770508 nb_pixel_total : 63229 time to create 1 rle with old method : 0.07062482833862305 time for calcul the mask position with numpy : 0.17694687843322754 nb_pixel_total : 126556 time to create 1 rle with old method : 0.1407010555267334 time for calcul the mask position with numpy : 0.10449767112731934 nb_pixel_total : 6842 time to create 1 rle with old method : 0.008061885833740234 time for calcul the mask position with numpy : 0.1785447597503662 nb_pixel_total : 273137 time to create 1 rle with new method : 1.3262214660644531 time for calcul the mask position with numpy : 0.17946171760559082 nb_pixel_total : 228514 time to create 1 rle with new method : 1.4725451469421387 time for calcul the mask position with numpy : 0.05575203895568848 nb_pixel_total : 768 time to create 1 rle with old method : 0.0011909008026123047 time for calcul the mask position with numpy : 0.17438149452209473 nb_pixel_total : 37731 time to create 1 rle with old method : 0.04476213455200195 time for calcul the mask position with numpy : 0.0596010684967041 nb_pixel_total : 300161 time to create 1 rle with new method : 1.0820679664611816 time for calcul the mask position with numpy : 0.17661213874816895 nb_pixel_total : 61371 time to create 1 rle with old method : 0.07421493530273438 time for calcul the mask position with numpy : 0.18176579475402832 nb_pixel_total : 719239 time to create 1 rle with new method : 1.1061649322509766 time for calcul the mask position with numpy : 0.17756056785583496 nb_pixel_total : 2086 time to create 1 rle with old method : 0.0026330947875976562 time for calcul the mask position with numpy : 0.14751362800598145 nb_pixel_total : 62951 time to create 1 rle with old method : 0.06997847557067871 time for calcul the mask position with numpy : 0.1952524185180664 nb_pixel_total : 809789 time to create 1 rle with new method : 3.249236583709717 time for calcul the mask position with numpy : 0.12900519371032715 nb_pixel_total : 16138 time to create 1 rle with old method : 0.0189816951751709 time for calcul the mask position with numpy : 0.056122541427612305 nb_pixel_total : 76 time to create 1 rle with old method : 0.0005178451538085938 time for calcul the mask position with numpy : 0.1134786605834961 nb_pixel_total : 113837 time to create 1 rle with old method : 0.13612699508666992 time for calcul the mask position with numpy : 0.18428277969360352 nb_pixel_total : 367174 time to create 1 rle with new method : 1.1959724426269531 time for calcul the mask position with numpy : 0.17812561988830566 nb_pixel_total : 120790 time to create 1 rle with old method : 0.1423358917236328 time for calcul the mask position with numpy : 0.178131103515625 nb_pixel_total : 20816 time to create 1 rle with old method : 0.024498939514160156 time for calcul the mask position with numpy : 0.061339378356933594 nb_pixel_total : 23896 time to create 1 rle with old method : 0.028445720672607422 time for calcul the mask position with numpy : 0.17772126197814941 nb_pixel_total : 69433 time to create 1 rle with old method : 0.08018755912780762 time for calcul the mask position with numpy : 0.08452987670898438 nb_pixel_total : 2978 time to create 1 rle with old method : 0.0040552616119384766 time for calcul the mask position with numpy : 0.12102675437927246 nb_pixel_total : 129945 time to create 1 rle with old method : 0.1699984073638916 time for calcul the mask position with numpy : 0.12886476516723633 nb_pixel_total : 495 time to create 1 rle with old method : 0.0007851123809814453 time for calcul the mask position with numpy : 0.1807384490966797 nb_pixel_total : 6933 time to create 1 rle with old method : 0.008131027221679688 time for calcul the mask position with numpy : 0.0604863166809082 nb_pixel_total : 16258 time to create 1 rle with old method : 0.01976490020751953 time for calcul the mask position with numpy : 0.17635893821716309 nb_pixel_total : 132024 time to create 1 rle with old method : 0.14898681640625 time for calcul the mask position with numpy : 0.18045258522033691 nb_pixel_total : 29655 time to create 1 rle with old method : 0.033776044845581055 time for calcul the mask position with numpy : 0.1673274040222168 nb_pixel_total : 32932 time to create 1 rle with old method : 0.03511500358581543 time for calcul the mask position with numpy : 0.17589187622070312 nb_pixel_total : 608079 time to create 1 rle with new method : 2.1384315490722656 time for calcul the mask position with numpy : 0.18439817428588867 nb_pixel_total : 655244 time to create 1 rle with new method : 2.2537734508514404 time for calcul the mask position with numpy : 0.1759355068206787 nb_pixel_total : 3816 time to create 1 rle with old method : 0.00551915168762207 time for calcul the mask position with numpy : 0.1830606460571289 nb_pixel_total : 442593 time to create 1 rle with new method : 1.8452229499816895 time for calcul the mask position with numpy : 0.08514809608459473 nb_pixel_total : 8241 time to create 1 rle with old method : 0.009511947631835938 time for calcul the mask position with numpy : 0.1696920394897461 nb_pixel_total : 16203 time to create 1 rle with old method : 0.01907944679260254 time for calcul the mask position with numpy : 0.17311549186706543 nb_pixel_total : 15002 time to create 1 rle with old method : 0.016509532928466797 time for calcul the mask position with numpy : 0.17398428916931152 nb_pixel_total : 504 time to create 1 rle with old method : 0.0007879734039306641 create new chi : 40.779479026794434 time to delete rle : 0.012558937072753906 batch 1 Loaded 79 chid ids of type : 4855 Number RLEs to save : 60658 TO DO : save crop sub photo not yet done ! save time : 10.170692443847656 nb_obj : 80 nb_hashtags : 10 time to prepare the origin masks : 76.10239958763123 time for calcul the mask position with numpy : 0.8261585235595703 nb_pixel_total : 3330069 time to create 1 rle with new method : 2.242208242416382 time for calcul the mask position with numpy : 0.1674342155456543 nb_pixel_total : 22970 time to create 1 rle with old method : 0.023871898651123047 time for calcul the mask position with numpy : 0.06644487380981445 nb_pixel_total : 210120 time to create 1 rle with new method : 1.4577984809875488 time for calcul the mask position with numpy : 0.16699528694152832 nb_pixel_total : 2696 time to create 1 rle with old method : 0.003580808639526367 time for calcul the mask position with numpy : 0.16967487335205078 nb_pixel_total : 149445 time to create 1 rle with old method : 0.15882134437561035 time for calcul the mask position with numpy : 0.16984009742736816 nb_pixel_total : 21169 time to create 1 rle with old method : 0.022871732711791992 time for calcul the mask position with numpy : 0.17140507698059082 nb_pixel_total : 229909 time to create 1 rle with new method : 1.417358160018921 time for calcul the mask position with numpy : 0.17491912841796875 nb_pixel_total : 16026 time to create 1 rle with old method : 0.01813817024230957 time for calcul the mask position with numpy : 0.17949700355529785 nb_pixel_total : 142867 time to create 1 rle with old method : 0.15655875205993652 time for calcul the mask position with numpy : 0.16828060150146484 nb_pixel_total : 24353 time to create 1 rle with old method : 0.026176929473876953 time for calcul the mask position with numpy : 0.054331302642822266 nb_pixel_total : 57523 time to create 1 rle with old method : 0.0630650520324707 time for calcul the mask position with numpy : 0.05319857597351074 nb_pixel_total : 35667 time to create 1 rle with old method : 0.037691593170166016 time for calcul the mask position with numpy : 0.17002296447753906 nb_pixel_total : 27583 time to create 1 rle with old method : 0.02993607521057129 time for calcul the mask position with numpy : 0.17372632026672363 nb_pixel_total : 19047 time to create 1 rle with old method : 0.021506786346435547 time for calcul the mask position with numpy : 0.17756199836730957 nb_pixel_total : 80432 time to create 1 rle with old method : 0.09131240844726562 time for calcul the mask position with numpy : 0.05501437187194824 nb_pixel_total : 14732 time to create 1 rle with old method : 0.016857385635375977 time for calcul the mask position with numpy : 0.17831015586853027 nb_pixel_total : 69653 time to create 1 rle with old method : 0.0797114372253418 time for calcul the mask position with numpy : 0.17820239067077637 nb_pixel_total : 5589 time to create 1 rle with old method : 0.0071222782135009766 time for calcul the mask position with numpy : 0.09961438179016113 nb_pixel_total : 36997 time to create 1 rle with old method : 0.043122053146362305 time for calcul the mask position with numpy : 0.17907166481018066 nb_pixel_total : 29608 time to create 1 rle with old method : 0.034798383712768555 time for calcul the mask position with numpy : 0.1823258399963379 nb_pixel_total : 179394 time to create 1 rle with new method : 1.590235948562622 time for calcul the mask position with numpy : 0.12347078323364258 nb_pixel_total : 7172 time to create 1 rle with old method : 0.013240814208984375 time for calcul the mask position with numpy : 0.059327125549316406 nb_pixel_total : 166067 time to create 1 rle with new method : 1.5823264122009277 time for calcul the mask position with numpy : 0.1789093017578125 nb_pixel_total : 12199 time to create 1 rle with old method : 0.014693260192871094 time for calcul the mask position with numpy : 0.10553789138793945 nb_pixel_total : 146707 time to create 1 rle with old method : 0.16395354270935059 time for calcul the mask position with numpy : 0.07897353172302246 nb_pixel_total : 108027 time to create 1 rle with old method : 0.12677741050720215 time for calcul the mask position with numpy : 0.17958760261535645 nb_pixel_total : 38766 time to create 1 rle with old method : 0.04286789894104004 time for calcul the mask position with numpy : 0.17939090728759766 nb_pixel_total : 120502 time to create 1 rle with old method : 0.1386096477508545 time for calcul the mask position with numpy : 0.18033933639526367 nb_pixel_total : 83964 time to create 1 rle with old method : 0.09274506568908691 time for calcul the mask position with numpy : 0.18236637115478516 nb_pixel_total : 143841 time to create 1 rle with old method : 0.1609342098236084 time for calcul the mask position with numpy : 0.19634270668029785 nb_pixel_total : 9129 time to create 1 rle with old method : 0.010811567306518555 time for calcul the mask position with numpy : 0.06926846504211426 nb_pixel_total : 345293 time to create 1 rle with new method : 1.5622527599334717 time for calcul the mask position with numpy : 0.17809128761291504 nb_pixel_total : 968 time to create 1 rle with old method : 0.0013315677642822266 time for calcul the mask position with numpy : 0.05705428123474121 nb_pixel_total : 84275 time to create 1 rle with old method : 0.0946493148803711 time for calcul the mask position with numpy : 0.18053126335144043 nb_pixel_total : 150367 time to create 1 rle with new method : 1.7026288509368896 time for calcul the mask position with numpy : 0.17820978164672852 nb_pixel_total : 32228 time to create 1 rle with old method : 0.0363004207611084 time for calcul the mask position with numpy : 0.18148326873779297 nb_pixel_total : 4802 time to create 1 rle with old method : 0.008310317993164062 time for calcul the mask position with numpy : 0.10143232345581055 nb_pixel_total : 52161 time to create 1 rle with old method : 0.09218716621398926 time for calcul the mask position with numpy : 0.13410663604736328 nb_pixel_total : 609482 time to create 1 rle with new method : 1.5609312057495117 time for calcul the mask position with numpy : 0.10418033599853516 nb_pixel_total : 63717 time to create 1 rle with old method : 0.07478952407836914 time for calcul the mask position with numpy : 0.057373046875 nb_pixel_total : 65874 time to create 1 rle with old method : 0.08268022537231445 time for calcul the mask position with numpy : 0.11226773262023926 nb_pixel_total : 48830 time to create 1 rle with old method : 0.1009674072265625 time for calcul the mask position with numpy : 0.17400336265563965 nb_pixel_total : 972616 time to create 1 rle with new method : 1.585632085800171 time for calcul the mask position with numpy : 0.07144570350646973 nb_pixel_total : 27490 time to create 1 rle with old method : 0.0345463752746582 time for calcul the mask position with numpy : 0.06691122055053711 nb_pixel_total : 6164 time to create 1 rle with old method : 0.010191679000854492 time for calcul the mask position with numpy : 0.07262754440307617 nb_pixel_total : 35740 time to create 1 rle with old method : 0.049848318099975586 time for calcul the mask position with numpy : 0.06294488906860352 nb_pixel_total : 207404 time to create 1 rle with new method : 1.8000080585479736 time for calcul the mask position with numpy : 0.13238191604614258 nb_pixel_total : 35526 time to create 1 rle with old method : 0.04219698905944824 time for calcul the mask position with numpy : 0.07895708084106445 nb_pixel_total : 83205 time to create 1 rle with old method : 0.09191131591796875 time for calcul the mask position with numpy : 0.06508708000183105 nb_pixel_total : 187252 time to create 1 rle with new method : 1.765380620956421 time for calcul the mask position with numpy : 0.18111062049865723 nb_pixel_total : 168990 time to create 1 rle with new method : 1.0929040908813477 time for calcul the mask position with numpy : 0.156968355178833 nb_pixel_total : 55573 time to create 1 rle with old method : 0.06580615043640137 time for calcul the mask position with numpy : 0.1251828670501709 nb_pixel_total : 193198 time to create 1 rle with new method : 1.426685094833374 time for calcul the mask position with numpy : 0.10537171363830566 nb_pixel_total : 529851 time to create 1 rle with new method : 1.4903595447540283 time for calcul the mask position with numpy : 0.05847978591918945 nb_pixel_total : 155923 time to create 1 rle with new method : 1.1015243530273438 time for calcul the mask position with numpy : 0.05778861045837402 nb_pixel_total : 47078 time to create 1 rle with old method : 0.056298255920410156 time for calcul the mask position with numpy : 0.08331441879272461 nb_pixel_total : 1066147 time to create 1 rle with new method : 1.0857903957366943 time for calcul the mask position with numpy : 0.10619974136352539 nb_pixel_total : 14935 time to create 1 rle with old method : 0.02075481414794922 time for calcul the mask position with numpy : 0.10183835029602051 nb_pixel_total : 73051 time to create 1 rle with old method : 0.11919689178466797 time for calcul the mask position with numpy : 0.09799432754516602 nb_pixel_total : 506526 time to create 1 rle with new method : 0.870307445526123 time for calcul the mask position with numpy : 0.07686877250671387 nb_pixel_total : 31830 time to create 1 rle with old method : 0.04124760627746582 time for calcul the mask position with numpy : 0.05769944190979004 nb_pixel_total : 52571 time to create 1 rle with old method : 0.07158541679382324 time for calcul the mask position with numpy : 0.13164448738098145 nb_pixel_total : 149611 time to create 1 rle with old method : 0.17191052436828613 time for calcul the mask position with numpy : 0.12618446350097656 nb_pixel_total : 3236 time to create 1 rle with old method : 0.003933429718017578 time for calcul the mask position with numpy : 0.12317371368408203 nb_pixel_total : 8861 time to create 1 rle with old method : 0.010757207870483398 time for calcul the mask position with numpy : 0.08797311782836914 nb_pixel_total : 222276 time to create 1 rle with new method : 1.6640357971191406 time for calcul the mask position with numpy : 0.0707395076751709 nb_pixel_total : 22548 time to create 1 rle with old method : 0.027039527893066406 time for calcul the mask position with numpy : 0.1617274284362793 nb_pixel_total : 181554 time to create 1 rle with new method : 1.5778672695159912 time for calcul the mask position with numpy : 0.12954378128051758 nb_pixel_total : 181040 time to create 1 rle with new method : 1.5647470951080322 time for calcul the mask position with numpy : 0.05479860305786133 nb_pixel_total : 29398 time to create 1 rle with old method : 0.032915592193603516 time for calcul the mask position with numpy : 0.17850255966186523 nb_pixel_total : 23680 time to create 1 rle with old method : 0.03246903419494629 time for calcul the mask position with numpy : 0.0609288215637207 nb_pixel_total : 403033 time to create 1 rle with new method : 1.6062698364257812 time for calcul the mask position with numpy : 0.0579838752746582 nb_pixel_total : 131 time to create 1 rle with old method : 0.00042700767517089844 time for calcul the mask position with numpy : 0.10030937194824219 nb_pixel_total : 14532 time to create 1 rle with old method : 0.02266240119934082 time for calcul the mask position with numpy : 0.08407187461853027 nb_pixel_total : 12469 time to create 1 rle with old method : 0.014712810516357422 time for calcul the mask position with numpy : 0.0848398208618164 nb_pixel_total : 46494 time to create 1 rle with old method : 0.053221940994262695 time for calcul the mask position with numpy : 0.09923839569091797 nb_pixel_total : 45045 time to create 1 rle with old method : 0.056882381439208984 time for calcul the mask position with numpy : 0.17496371269226074 nb_pixel_total : 65754 time to create 1 rle with old method : 0.07814550399780273 time for calcul the mask position with numpy : 0.0773930549621582 nb_pixel_total : 94141 time to create 1 rle with old method : 0.1102149486541748 time for calcul the mask position with numpy : 0.08867430686950684 nb_pixel_total : 4741 time to create 1 rle with old method : 0.006100893020629883 time for calcul the mask position with numpy : 0.06523370742797852 nb_pixel_total : 19366 time to create 1 rle with old method : 0.02265310287475586 create new chi : 46.782777547836304 time to delete rle : 0.016698837280273438 batch 1 Loaded 81 chid ids of type : 4855 Number RLEs to save : 70489 TO DO : save crop sub photo not yet done ! save time : 27.096423149108887 nb_obj : 68 nb_hashtags : 11 time to prepare the origin masks : 60.98069190979004 time for calcul the mask position with numpy : 0.3395054340362549 nb_pixel_total : 4006740 time to create 1 rle with new method : 2.1700994968414307 time for calcul the mask position with numpy : 0.07064986228942871 nb_pixel_total : 26726 time to create 1 rle with old method : 0.030431509017944336 time for calcul the mask position with numpy : 0.05567502975463867 nb_pixel_total : 83014 time to create 1 rle with old method : 0.09818482398986816 time for calcul the mask position with numpy : 0.06572628021240234 nb_pixel_total : 255342 time to create 1 rle with new method : 1.0929038524627686 time for calcul the mask position with numpy : 0.17652416229248047 nb_pixel_total : 30509 time to create 1 rle with old method : 0.03584170341491699 time for calcul the mask position with numpy : 0.17441797256469727 nb_pixel_total : 25658 time to create 1 rle with old method : 0.030621051788330078 time for calcul the mask position with numpy : 0.19138455390930176 nb_pixel_total : 213393 time to create 1 rle with new method : 2.3531391620635986 time for calcul the mask position with numpy : 0.17825603485107422 nb_pixel_total : 261510 time to create 1 rle with new method : 1.2417404651641846 time for calcul the mask position with numpy : 0.1811225414276123 nb_pixel_total : 161053 time to create 1 rle with new method : 1.3893730640411377 time for calcul the mask position with numpy : 0.17502713203430176 nb_pixel_total : 32784 time to create 1 rle with old method : 0.038323163986206055 time for calcul the mask position with numpy : 0.0828249454498291 nb_pixel_total : 393035 time to create 1 rle with new method : 1.2639884948730469 time for calcul the mask position with numpy : 0.06926488876342773 nb_pixel_total : 148730 time to create 1 rle with old method : 0.19508934020996094 time for calcul the mask position with numpy : 0.05541563034057617 nb_pixel_total : 97740 time to create 1 rle with old method : 0.11573052406311035 time for calcul the mask position with numpy : 0.055254459381103516 nb_pixel_total : 36753 time to create 1 rle with old method : 0.05309319496154785 time for calcul the mask position with numpy : 0.18544840812683105 nb_pixel_total : 53686 time to create 1 rle with old method : 0.060773372650146484 time for calcul the mask position with numpy : 0.058960914611816406 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0018236637115478516 time for calcul the mask position with numpy : 0.06476116180419922 nb_pixel_total : 50584 time to create 1 rle with old method : 0.06010937690734863 time for calcul the mask position with numpy : 0.07463717460632324 nb_pixel_total : 364 time to create 1 rle with old method : 0.0035104751586914062 time for calcul the mask position with numpy : 0.05874752998352051 nb_pixel_total : 2879 time to create 1 rle with old method : 0.0051763057708740234 time for calcul the mask position with numpy : 0.08153700828552246 nb_pixel_total : 17860 time to create 1 rle with old method : 0.020886659622192383 time for calcul the mask position with numpy : 0.054306745529174805 nb_pixel_total : 61432 time to create 1 rle with old method : 0.06973743438720703 time for calcul the mask position with numpy : 0.13604140281677246 nb_pixel_total : 25337 time to create 1 rle with old method : 0.0284881591796875 time for calcul the mask position with numpy : 0.05889248847961426 nb_pixel_total : 22576 time to create 1 rle with old method : 0.028304576873779297 time for calcul the mask position with numpy : 0.13193178176879883 nb_pixel_total : 4763 time to create 1 rle with old method : 0.0058405399322509766 time for calcul the mask position with numpy : 0.17593884468078613 nb_pixel_total : 213780 time to create 1 rle with new method : 1.3527381420135498 time for calcul the mask position with numpy : 0.0656123161315918 nb_pixel_total : 145132 time to create 1 rle with old method : 0.1815953254699707 time for calcul the mask position with numpy : 0.17671656608581543 nb_pixel_total : 112095 time to create 1 rle with old method : 0.147355318069458 time for calcul the mask position with numpy : 0.05800652503967285 nb_pixel_total : 15756 time to create 1 rle with old method : 0.019971847534179688 time for calcul the mask position with numpy : 0.054888248443603516 nb_pixel_total : 4013 time to create 1 rle with old method : 0.004609346389770508 time for calcul the mask position with numpy : 0.05629992485046387 nb_pixel_total : 78222 time to create 1 rle with old method : 0.11966538429260254 time for calcul the mask position with numpy : 0.058167219161987305 nb_pixel_total : 213538 time to create 1 rle with new method : 1.4605629444122314 time for calcul the mask position with numpy : 0.11918425559997559 nb_pixel_total : 1262 time to create 1 rle with old method : 0.001584768295288086 time for calcul the mask position with numpy : 0.07585597038269043 nb_pixel_total : 31640 time to create 1 rle with old method : 0.03525280952453613 time for calcul the mask position with numpy : 0.05354642868041992 nb_pixel_total : 51773 time to create 1 rle with old method : 0.05724763870239258 time for calcul the mask position with numpy : 0.05503106117248535 nb_pixel_total : 162526 time to create 1 rle with new method : 2.621652603149414 time for calcul the mask position with numpy : 0.06363129615783691 nb_pixel_total : 185791 time to create 1 rle with new method : 1.6249608993530273 time for calcul the mask position with numpy : 0.15396666526794434 nb_pixel_total : 321990 time to create 1 rle with new method : 1.4558186531066895 time for calcul the mask position with numpy : 0.11340522766113281 nb_pixel_total : 23423 time to create 1 rle with old method : 0.028362035751342773 time for calcul the mask position with numpy : 0.12282800674438477 nb_pixel_total : 33677 time to create 1 rle with old method : 0.042771339416503906 time for calcul the mask position with numpy : 0.07744193077087402 nb_pixel_total : 222768 time to create 1 rle with new method : 1.031282663345337 time for calcul the mask position with numpy : 0.13805246353149414 nb_pixel_total : 68292 time to create 1 rle with old method : 0.07605910301208496 time for calcul the mask position with numpy : 0.20136785507202148 nb_pixel_total : 316301 time to create 1 rle with new method : 1.1325643062591553 time for calcul the mask position with numpy : 0.07074809074401855 nb_pixel_total : 49620 time to create 1 rle with old method : 0.06601738929748535 time for calcul the mask position with numpy : 0.059876203536987305 nb_pixel_total : 1771 time to create 1 rle with old method : 0.0026192665100097656 time for calcul the mask position with numpy : 0.07727193832397461 nb_pixel_total : 141892 time to create 1 rle with old method : 0.17478537559509277 time for calcul the mask position with numpy : 0.11633634567260742 nb_pixel_total : 18771 time to create 1 rle with old method : 0.021421194076538086 time for calcul the mask position with numpy : 0.1867828369140625 nb_pixel_total : 155669 time to create 1 rle with new method : 2.352160692214966 time for calcul the mask position with numpy : 0.20277166366577148 nb_pixel_total : 290391 time to create 1 rle with new method : 1.069540023803711 time for calcul the mask position with numpy : 0.16402959823608398 nb_pixel_total : 4848 time to create 1 rle with old method : 0.008339881896972656 time for calcul the mask position with numpy : 0.195237398147583 nb_pixel_total : 374411 time to create 1 rle with new method : 1.22456693649292 time for calcul the mask position with numpy : 0.20636677742004395 nb_pixel_total : 88066 time to create 1 rle with old method : 0.1039419174194336 time for calcul the mask position with numpy : 0.17749571800231934 nb_pixel_total : 4392 time to create 1 rle with old method : 0.00533294677734375 time for calcul the mask position with numpy : 0.1851520538330078 nb_pixel_total : 189823 time to create 1 rle with new method : 0.6312634944915771 time for calcul the mask position with numpy : 0.0653374195098877 nb_pixel_total : 146949 time to create 1 rle with old method : 0.1997995376586914 time for calcul the mask position with numpy : 0.17986416816711426 nb_pixel_total : 59816 time to create 1 rle with old method : 0.07102203369140625 time for calcul the mask position with numpy : 0.07399630546569824 nb_pixel_total : 136434 time to create 1 rle with old method : 0.1606440544128418 time for calcul the mask position with numpy : 0.19087481498718262 nb_pixel_total : 80383 time to create 1 rle with old method : 0.09546804428100586 time for calcul the mask position with numpy : 0.19351577758789062 nb_pixel_total : 14944 time to create 1 rle with old method : 0.0183718204498291 time for calcul the mask position with numpy : 0.2705678939819336 nb_pixel_total : 960485 time to create 1 rle with new method : 1.2664520740509033 time for calcul the mask position with numpy : 0.17428159713745117 nb_pixel_total : 156192 time to create 1 rle with new method : 1.0767791271209717 time for calcul the mask position with numpy : 0.259230375289917 nb_pixel_total : 802054 time to create 1 rle with new method : 2.4737472534179688 time for calcul the mask position with numpy : 0.06981992721557617 nb_pixel_total : 84568 time to create 1 rle with old method : 0.0943603515625 time for calcul the mask position with numpy : 0.15529966354370117 nb_pixel_total : 109021 time to create 1 rle with old method : 0.13469409942626953 time for calcul the mask position with numpy : 0.2118663787841797 nb_pixel_total : 45448 time to create 1 rle with old method : 0.06856632232666016 time for calcul the mask position with numpy : 0.05724740028381348 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0022444725036621094 time for calcul the mask position with numpy : 0.17318224906921387 nb_pixel_total : 644927 time to create 1 rle with new method : 1.664870023727417 time for calcul the mask position with numpy : 0.11268258094787598 nb_pixel_total : 32679 time to create 1 rle with old method : 0.04367780685424805 time for calcul the mask position with numpy : 0.21148157119750977 nb_pixel_total : 91512 time to create 1 rle with old method : 0.11091327667236328 time for calcul the mask position with numpy : 0.12152981758117676 nb_pixel_total : 76495 time to create 1 rle with old method : 0.09304189682006836 create new chi : 44.88732051849365 time to delete rle : 0.04261350631713867 batch 1 Loaded 69 chid ids of type : 4855 Number RLEs to save : 61872 TO DO : save crop sub photo not yet done ! save time : 23.46773076057434 nb_obj : 73 nb_hashtags : 8 time to prepare the origin masks : 66.13175940513611 time for calcul the mask position with numpy : 1.0295825004577637 nb_pixel_total : 4443353 time to create 1 rle with new method : 1.9463460445404053 time for calcul the mask position with numpy : 0.17395329475402832 nb_pixel_total : 71167 time to create 1 rle with old method : 0.10394740104675293 time for calcul the mask position with numpy : 0.16807198524475098 nb_pixel_total : 21368 time to create 1 rle with old method : 0.024010658264160156 time for calcul the mask position with numpy : 0.17005562782287598 nb_pixel_total : 51250 time to create 1 rle with old method : 0.05313301086425781 time for calcul the mask position with numpy : 0.05366253852844238 nb_pixel_total : 171253 time to create 1 rle with new method : 2.2298943996429443 time for calcul the mask position with numpy : 0.18388628959655762 nb_pixel_total : 286275 time to create 1 rle with new method : 1.2129123210906982 time for calcul the mask position with numpy : 0.16938114166259766 nb_pixel_total : 63445 time to create 1 rle with old method : 0.06698846817016602 time for calcul the mask position with numpy : 0.17110919952392578 nb_pixel_total : 24470 time to create 1 rle with old method : 0.02590155601501465 time for calcul the mask position with numpy : 0.05539512634277344 nb_pixel_total : 13773 time to create 1 rle with old method : 0.015461444854736328 time for calcul the mask position with numpy : 0.16440129280090332 nb_pixel_total : 36941 time to create 1 rle with old method : 0.03876662254333496 time for calcul the mask position with numpy : 0.16544604301452637 nb_pixel_total : 155054 time to create 1 rle with new method : 1.43271803855896 time for calcul the mask position with numpy : 0.2173459529876709 nb_pixel_total : 734037 time to create 1 rle with new method : 2.667351007461548 time for calcul the mask position with numpy : 0.14867734909057617 nb_pixel_total : 4111 time to create 1 rle with old method : 0.00543975830078125 time for calcul the mask position with numpy : 0.05285477638244629 nb_pixel_total : 109448 time to create 1 rle with old method : 0.1387791633605957 time for calcul the mask position with numpy : 0.1764836311340332 nb_pixel_total : 32193 time to create 1 rle with old method : 0.038431644439697266 time for calcul the mask position with numpy : 0.17838048934936523 nb_pixel_total : 53588 time to create 1 rle with old method : 0.06011176109313965 time for calcul the mask position with numpy : 0.17753267288208008 nb_pixel_total : 16541 time to create 1 rle with old method : 0.018399953842163086 time for calcul the mask position with numpy : 0.17707276344299316 nb_pixel_total : 3044 time to create 1 rle with old method : 0.0035238265991210938 time for calcul the mask position with numpy : 0.1766519546508789 nb_pixel_total : 22832 time to create 1 rle with old method : 0.02573108673095703 time for calcul the mask position with numpy : 0.17858409881591797 nb_pixel_total : 42347 time to create 1 rle with old method : 0.04772067070007324 time for calcul the mask position with numpy : 0.17798972129821777 nb_pixel_total : 13154 time to create 1 rle with old method : 0.014738798141479492 time for calcul the mask position with numpy : 0.17747879028320312 nb_pixel_total : 44919 time to create 1 rle with old method : 0.05042529106140137 time for calcul the mask position with numpy : 0.08313226699829102 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0015423297882080078 time for calcul the mask position with numpy : 0.18167424201965332 nb_pixel_total : 77319 time to create 1 rle with old method : 0.1121072769165039 time for calcul the mask position with numpy : 0.10194206237792969 nb_pixel_total : 112330 time to create 1 rle with old method : 0.13468718528747559 time for calcul the mask position with numpy : 0.06003546714782715 nb_pixel_total : 78768 time to create 1 rle with old method : 0.09354925155639648 time for calcul the mask position with numpy : 0.05686330795288086 nb_pixel_total : 36835 time to create 1 rle with old method : 0.04228782653808594 time for calcul the mask position with numpy : 0.054518699645996094 nb_pixel_total : 4798 time to create 1 rle with old method : 0.005660533905029297 time for calcul the mask position with numpy : 0.17484378814697266 nb_pixel_total : 72283 time to create 1 rle with old method : 0.09256792068481445 time for calcul the mask position with numpy : 0.054099082946777344 nb_pixel_total : 10487 time to create 1 rle with old method : 0.012420892715454102 time for calcul the mask position with numpy : 0.17188644409179688 nb_pixel_total : 50824 time to create 1 rle with old method : 0.05697154998779297 time for calcul the mask position with numpy : 0.1783006191253662 nb_pixel_total : 199831 time to create 1 rle with new method : 1.9780020713806152 time for calcul the mask position with numpy : 0.05456185340881348 nb_pixel_total : 8590 time to create 1 rle with old method : 0.010400533676147461 time for calcul the mask position with numpy : 0.05645632743835449 nb_pixel_total : 156187 time to create 1 rle with new method : 1.337418556213379 time for calcul the mask position with numpy : 0.07035160064697266 nb_pixel_total : 61602 time to create 1 rle with old method : 0.08919429779052734 time for calcul the mask position with numpy : 0.05448269844055176 nb_pixel_total : 27080 time to create 1 rle with old method : 0.031036376953125 time for calcul the mask position with numpy : 0.17642617225646973 nb_pixel_total : 64039 time to create 1 rle with old method : 0.07174539566040039 time for calcul the mask position with numpy : 0.17599868774414062 nb_pixel_total : 2020 time to create 1 rle with old method : 0.0027086734771728516 time for calcul the mask position with numpy : 0.17568325996398926 nb_pixel_total : 148001 time to create 1 rle with old method : 0.18564772605895996 time for calcul the mask position with numpy : 0.17726492881774902 nb_pixel_total : 69725 time to create 1 rle with old method : 0.07805681228637695 time for calcul the mask position with numpy : 0.17505526542663574 nb_pixel_total : 10752 time to create 1 rle with old method : 0.012308120727539062 time for calcul the mask position with numpy : 0.17430877685546875 nb_pixel_total : 15691 time to create 1 rle with old method : 0.017500877380371094 time for calcul the mask position with numpy : 0.17631173133850098 nb_pixel_total : 142902 time to create 1 rle with old method : 0.15982770919799805 time for calcul the mask position with numpy : 0.17669057846069336 nb_pixel_total : 13117 time to create 1 rle with old method : 0.014694929122924805 time for calcul the mask position with numpy : 0.17618775367736816 nb_pixel_total : 131179 time to create 1 rle with old method : 0.1465766429901123 time for calcul the mask position with numpy : 0.054494380950927734 nb_pixel_total : 33970 time to create 1 rle with old method : 0.0404050350189209 time for calcul the mask position with numpy : 0.17447209358215332 nb_pixel_total : 99460 time to create 1 rle with old method : 0.1101531982421875 time for calcul the mask position with numpy : 0.17391300201416016 nb_pixel_total : 79619 time to create 1 rle with old method : 0.08999347686767578 time for calcul the mask position with numpy : 0.06329536437988281 nb_pixel_total : 836826 time to create 1 rle with new method : 1.3748419284820557 time for calcul the mask position with numpy : 0.1769554615020752 nb_pixel_total : 204687 time to create 1 rle with new method : 1.6337504386901855 time for calcul the mask position with numpy : 0.1756303310394287 nb_pixel_total : 109040 time to create 1 rle with old method : 0.12144684791564941 time for calcul the mask position with numpy : 0.12517690658569336 nb_pixel_total : 31409 time to create 1 rle with old method : 0.03581595420837402 time for calcul the mask position with numpy : 0.17513585090637207 nb_pixel_total : 118542 time to create 1 rle with old method : 0.13988447189331055 time for calcul the mask position with numpy : 0.20402073860168457 nb_pixel_total : 2082529 time to create 1 rle with new method : 1.616682767868042 time for calcul the mask position with numpy : 0.0758676528930664 nb_pixel_total : 96012 time to create 1 rle with old method : 0.10657882690429688 time for calcul the mask position with numpy : 0.0549769401550293 nb_pixel_total : 50105 time to create 1 rle with old method : 0.05635428428649902 time for calcul the mask position with numpy : 0.1815357208251953 nb_pixel_total : 29967 time to create 1 rle with old method : 0.0354461669921875 time for calcul the mask position with numpy : 0.17584800720214844 nb_pixel_total : 20136 time to create 1 rle with old method : 0.023923635482788086 time for calcul the mask position with numpy : 0.1756901741027832 nb_pixel_total : 30960 time to create 1 rle with old method : 0.035077810287475586 time for calcul the mask position with numpy : 0.054511308670043945 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0022330284118652344 time for calcul the mask position with numpy : 0.17705273628234863 nb_pixel_total : 144525 time to create 1 rle with old method : 0.16104865074157715 time for calcul the mask position with numpy : 0.17512154579162598 nb_pixel_total : 36060 time to create 1 rle with old method : 0.039968013763427734 time for calcul the mask position with numpy : 0.08498764038085938 nb_pixel_total : 202894 time to create 1 rle with new method : 2.673598051071167 time for calcul the mask position with numpy : 0.17693161964416504 nb_pixel_total : 271454 time to create 1 rle with new method : 1.7296056747436523 time for calcul the mask position with numpy : 0.17412614822387695 nb_pixel_total : 37454 time to create 1 rle with old method : 0.04147505760192871 time for calcul the mask position with numpy : 0.1752767562866211 nb_pixel_total : 8523 time to create 1 rle with old method : 0.01009988784790039 time for calcul the mask position with numpy : 0.17495203018188477 nb_pixel_total : 21518 time to create 1 rle with old method : 0.02398824691772461 time for calcul the mask position with numpy : 0.17615127563476562 nb_pixel_total : 164123 time to create 1 rle with new method : 1.7850184440612793 time for calcul the mask position with numpy : 0.11668062210083008 nb_pixel_total : 38472 time to create 1 rle with old method : 0.043720245361328125 time for calcul the mask position with numpy : 0.0671694278717041 nb_pixel_total : 10133 time to create 1 rle with old method : 0.012295246124267578 time for calcul the mask position with numpy : 0.1702888011932373 nb_pixel_total : 168449 time to create 1 rle with new method : 1.5524656772613525 time for calcul the mask position with numpy : 0.17516112327575684 nb_pixel_total : 101745 time to create 1 rle with old method : 0.11973738670349121 time for calcul the mask position with numpy : 0.1742420196533203 nb_pixel_total : 29786 time to create 1 rle with old method : 0.03368234634399414 time for calcul the mask position with numpy : 0.17404770851135254 nb_pixel_total : 8750 time to create 1 rle with old method : 0.00980234146118164 create new chi : 40.815913438797 time to delete rle : 0.00945138931274414 batch 1 Loaded 74 chid ids of type : 4855 Number RLEs to save : 57400 TO DO : save crop sub photo not yet done ! save time : 17.97219753265381 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 23.623334407806396 time for calcul the mask position with numpy : 0.19012904167175293 nb_pixel_total : 1869762 time to create 1 rle with new method : 2.274808168411255 time for calcul the mask position with numpy : 0.12125158309936523 nb_pixel_total : 25877 time to create 1 rle with old method : 0.027567386627197266 time for calcul the mask position with numpy : 0.15643596649169922 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003497600555419922 time for calcul the mask position with numpy : 0.15828204154968262 nb_pixel_total : 56749 time to create 1 rle with old method : 0.05875825881958008 time for calcul the mask position with numpy : 0.16522932052612305 nb_pixel_total : 85251 time to create 1 rle with old method : 0.09270119667053223 time for calcul the mask position with numpy : 0.19324612617492676 nb_pixel_total : 214163 time to create 1 rle with new method : 1.9438891410827637 time for calcul the mask position with numpy : 0.583512544631958 nb_pixel_total : 5923317 time to create 1 rle with new method : 1.6438627243041992 time for calcul the mask position with numpy : 0.4530172348022461 nb_pixel_total : 4729557 time to create 1 rle with new method : 1.3716495037078857 time for calcul the mask position with numpy : 0.19651126861572266 nb_pixel_total : 74306 time to create 1 rle with old method : 0.08715033531188965 create new chi : 9.969683408737183 time to delete rle : 0.0031135082244873047 batch 1 Loaded 9 chid ids of type : 4855 Number RLEs to save : 21392 TO DO : save crop sub photo not yet done ! save time : 1.6137912273406982 map_output_result : {1342523879: (0.31177743241226946, 'Should be the crop_list due to order', 0.3771899349435199), 1342523853: (0.31177743241226946, 'Should be the crop_list due to order', 0.19269365278846276), 1342523849: (0.31177743241226946, 'Should be the crop_list due to order', 0.2666295340871882), 1342523842: (0.31177743241226946, 'Should be the crop_list due to order', 0.2930000422900314), 1342523838: (0.31177743241226946, 'Should be the crop_list due to order', 0.10226501611051714), 1342523834: (0.31177743241226946, 'Should be the crop_list due to order', 0.6388864142538975)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 6 /1342523879.Didn't retrieve data . /1342523853.Didn't retrieve data . /1342523849.Didn't retrieve data . /1342523842.Didn't retrieve data . /1342523838.Didn't retrieve data . /1342523834.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.013486862182617188 save_final save missing photos in datou_result : time spend for datou_step_exec : 703.8150794506073 time spend to save output : 0.1607820987701416 total time spend for step 5 : 703.9758615493774 step6:crop_condition Tue Mar 11 01:18:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 387 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3015255 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652381_1866620 we have uploaded 47 photos in the portfolio 3015255 time of upload the photos Elapsed time : 21.223891735076904 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 3015255 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652464_1866620 we have uploaded 77 photos in the portfolio 3015255 time of upload the photos Elapsed time : 24.084679126739502 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652502_1866620 we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.39050030708313 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3015255 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652519_1866620 we have uploaded 9 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.4907236099243164 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652529_1866620 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.1286840438842773 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652547_1866620 we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.138604402542114 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652558_1866620 we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.2699382305145264 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652564_1866620 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6263222694396973 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3015255 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652599_1866620 we have uploaded 29 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.441550970077515 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3015255 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652624_1866620 we have uploaded 11 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.571404218673706 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741652732_1866620 we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 17.269351482391357 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 288 /1342746186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342746772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342747402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342748378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342749790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 870 time used for this insertion : 0.5168981552124023 save_final save missing photos in datou_result : time spend for datou_step_exec : 504.671573638916 time spend to save output : 0.7190635204315186 total time spend for step 6 : 505.39063715934753 step7:ventilate_hashtags_in_portfolio Tue Mar 11 01:26:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21222497 get user id for portfolio 21222497 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21249093,21249094,21249095,21249096,21249097,21249102,21249104,21249105,21249106,21249107,21249108,21249109,21249111,21249112,21249113,21249114,21249115,21249116,21249117,21249118?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222497 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 1 /21222497. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015332937240600586 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.105825424194336 time spend to save output : 0.01564311981201172 total time spend for step 7 : 9.121468544006348 step8:final Tue Mar 11 01:26:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342523879: ('0.2519774671649127',), 1342523853: ('0.2519774671649127',), 1342523849: ('0.2519774671649127',), 1342523842: ('0.2519774671649127',), 1342523838: ('0.2519774671649127',), 1342523834: ('0.2519774671649127',)} new output for save of step final : {1342523879: ('0.2519774671649127',), 1342523853: ('0.2519774671649127',), 1342523849: ('0.2519774671649127',), 1342523842: ('0.2519774671649127',), 1342523838: ('0.2519774671649127',), 1342523834: ('0.2519774671649127',)} [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 6 /1342523879.Didn't retrieve data . /1342523853.Didn't retrieve data . /1342523849.Didn't retrieve data . /1342523842.Didn't retrieve data . /1342523838.Didn't retrieve data . /1342523834.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.016864299774169922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1909639835357666 time spend to save output : 0.017487764358520508 total time spend for step 8 : 0.2084517478942871 step9:velours_tree Tue Mar 11 01:26:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 9.752165079116821 time spend to save output : 6.914138793945312e-05 total time spend for step 9 : 9.75223422050476 step10:send_mail_cod Tue Mar 11 01:26:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21222497_11-03-2025_01_26_55.pdf 21249067 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490671741652815 21249068 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490681741652817 21249069 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490691741652819 21249070 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490701741652820 21249071 change filename to text .change filename to text .imagette212490711741652821 21249072 imagette212490721741652821 21249073 imagette212490731741652821 21249074 imagette212490741741652821 21249075 imagette212490751741652821 21249076 imagette212490761741652821 21249077 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490771741652821 21249078 change filename to text .change filename to text .change filename to text .imagette212490781741652823 21249079 change filename to text .imagette212490791741652823 21249080 imagette212490801741652823 21249081 imagette212490811741652823 21249082 imagette212490821741652823 21249083 imagette212490831741652823 21249084 imagette212490841741652823 21249085 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490851741652823 21249087 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212490871741652824 21249088 imagette212490881741652825 21249089 imagette212490891741652825 21249090 imagette212490901741652825 21249091 imagette212490911741652825 21249092 imagette212490921741652825 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21222497 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21249093,21249094,21249095,21249096,21249097,21249102,21249104,21249105,21249106,21249107,21249108,21249109,21249111,21249112,21249113,21249114,21249115,21249116,21249117,21249118?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222497 your option no_mail is active, we will not send the real mail to your client args[1342523879] : ((1342523879, 1506.1025504747681, 2107751945), (1342523879, -0.22493806596153165, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523853] : ((1342523853, 1245.6866617838193, 2107751945), (1342523853, -0.4045309661544747, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523849] : ((1342523849, 3073.7241590778112, 492609224), (1342523849, -0.14941267284766918, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523842] : ((1342523842, 2083.4446205426, 492609224), (1342523842, -0.25801164554798617, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523838] : ((1342523838, 3340.4160923632567, 492609224), (1342523838, -0.27693074498712417, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523834] : ((1342523834, 704.5751881980573, 492688767), (1342523834, -0.14296755358693322, 496442774), '0.2519774671649127') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.2519774671649127 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222497_11-03-2025_01_26_55.pdf results_Auto_P21222497_11-03-2025_01_26_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222497_11-03-2025_01_26_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21222497','results_Auto_P21222497_11-03-2025_01_26_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222497_11-03-2025_01_26_55.pdf','pdf','','2.91','0.2519774671649127') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015694856643676758 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.950272560119629 time spend to save output : 0.015934467315673828 total time spend for step 10 : 13.966207027435303 step11:split_time_score Tue Mar 11 01:27:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('56', 2), ('57', 3), ('58', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08022025 21222497 Nombre de photos uploadées : 6 / 23040 (0%) 08022025 21222497 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 08022025 21222497 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00035953521728515625 elapsed_time : insert_dashboard_record_day_entry 0.022810697555541992 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.30163425013503214 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222496_11-03-2025_01_19_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222496 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222496 AND mptpi.`type`=4855 To do Qualite : 0.2519774671649127 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222497_11-03-2025_01_26_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222497 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222499 order by id desc limit 1 Qualite : 0.40756533634970127 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222500_11-03-2025_00_13_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222500 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222500 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08022025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342523879, 1342523853, 1342523849, 1342523842, 1342523838, 1342523834] Looping around the photos to save general results len do output : 1 /21222497Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523879', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523853', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523849', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523842', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523838', None, None, None, None, None, '2654377') ('4741', None, None, None, None, None, None, None, '2654377') ('4741', '21222497', '1342523834', None, None, None, None, None, '2654377') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015973329544067383 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2315270900726318 time spend to save output : 0.01619720458984375 total time spend for step 11 : 1.2477242946624756 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 821.47user 448.68system 25:47.06elapsed 82%CPU (0avgtext+0avgdata 7884568maxresident)k 6325448inputs+774008outputs (70629major+60930292minor)pagefaults 0swaps