python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 729003 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2833131'] with mtr_portfolio_ids : ['22902875'] and first list_photo_ids : [] new path : /proc/729003/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.3495349884033203 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 13 03:01:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1746 wait 20 seconds l 3637 free memory gpu now : 1746 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-13 03:01:53.839435: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-13 03:01:53.867225: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-13 03:01:53.869130: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7febac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:01:53.869152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-13 03:01:53.872205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-13 03:01:54.031217: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3afb4850 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:01:54.031282: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-13 03:01:54.032100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:01:54.032595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:01:54.035961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:01:54.039121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:01:54.039654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:01:54.042522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:01:54.043925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:01:54.049317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:01:54.050346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:01:54.050426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:01:54.050965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:01:54.050981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:01:54.050990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:01:54.051867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1369 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-13 03:01:54.329968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:01:54.330083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:01:54.330102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:01:54.330118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:01:54.330136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:01:54.330157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:01:54.330174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:01:54.330195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:01:54.331041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:01:54.332287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:01:54.332331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:01:54.332350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:01:54.332386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:01:54.332405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:01:54.332423: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:01:54.332441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:01:54.332459: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:01:54.333469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:01:54.333516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:01:54.333528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:01:54.333543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:01:54.334626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1369 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-13 03:01:58.477964: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-05-13 03:02:05.472714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:02:05.673305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:02:06.903749: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:06.903799: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:06.910230: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:06.910254: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:06.960095: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:06.960136: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:07.002009: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:07.002049: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:07.053206: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:07.053243: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:02:07.084714: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 731117 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3472 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0012581348419189453 nb_pixel_total : 28837 time to create 1 rle with old method : 0.03260302543640137 length of segment : 157 time for calcul the mask position with numpy : 0.010274171829223633 nb_pixel_total : 284423 time to create 1 rle with new method : 0.023458003997802734 length of segment : 639 time for calcul the mask position with numpy : 0.7209534645080566 nb_pixel_total : 652312 time to create 1 rle with new method : 0.04951643943786621 length of segment : 1229 time for calcul the mask position with numpy : 0.0007100105285644531 nb_pixel_total : 32469 time to create 1 rle with old method : 0.03510403633117676 length of segment : 273 time for calcul the mask position with numpy : 0.008265972137451172 nb_pixel_total : 489641 time to create 1 rle with new method : 0.033879995346069336 length of segment : 799 time for calcul the mask position with numpy : 0.0017774105072021484 nb_pixel_total : 109997 time to create 1 rle with old method : 0.11570429801940918 length of segment : 527 time for calcul the mask position with numpy : 0.0004565715789794922 nb_pixel_total : 22912 time to create 1 rle with old method : 0.02626800537109375 length of segment : 272 time for calcul the mask position with numpy : 0.0014848709106445312 nb_pixel_total : 115192 time to create 1 rle with old method : 0.12483453750610352 length of segment : 350 time for calcul the mask position with numpy : 0.002321481704711914 nb_pixel_total : 143160 time to create 1 rle with old method : 0.16061139106750488 length of segment : 435 time for calcul the mask position with numpy : 0.0009436607360839844 nb_pixel_total : 69450 time to create 1 rle with old method : 0.07810354232788086 length of segment : 422 time for calcul the mask position with numpy : 0.0007121562957763672 nb_pixel_total : 25060 time to create 1 rle with old method : 0.02895951271057129 length of segment : 211 time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 7514 time to create 1 rle with old method : 0.008970260620117188 length of segment : 151 time for calcul the mask position with numpy : 0.00022602081298828125 nb_pixel_total : 4076 time to create 1 rle with old method : 0.005047798156738281 length of segment : 56 time for calcul the mask position with numpy : 0.003847360610961914 nb_pixel_total : 202166 time to create 1 rle with new method : 0.009010553359985352 length of segment : 361 time for calcul the mask position with numpy : 0.0010380744934082031 nb_pixel_total : 40816 time to create 1 rle with old method : 0.046971797943115234 length of segment : 184 time for calcul the mask position with numpy : 0.002446413040161133 nb_pixel_total : 125199 time to create 1 rle with old method : 0.1429121494293213 length of segment : 289 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 40623 time to create 1 rle with old method : 0.04554343223571777 length of segment : 256 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 19409 time to create 1 rle with old method : 0.022534847259521484 length of segment : 119 time for calcul the mask position with numpy : 0.0009579658508300781 nb_pixel_total : 36869 time to create 1 rle with old method : 0.0415494441986084 length of segment : 266 time for calcul the mask position with numpy : 0.0005469322204589844 nb_pixel_total : 16115 time to create 1 rle with old method : 0.018511533737182617 length of segment : 212 time for calcul the mask position with numpy : 0.0018720626831054688 nb_pixel_total : 64774 time to create 1 rle with old method : 0.07446146011352539 length of segment : 683 time for calcul the mask position with numpy : 0.0008974075317382812 nb_pixel_total : 35768 time to create 1 rle with old method : 0.03962373733520508 length of segment : 250 time for calcul the mask position with numpy : 0.0007693767547607422 nb_pixel_total : 15125 time to create 1 rle with old method : 0.01726984977722168 length of segment : 190 time for calcul the mask position with numpy : 0.005918264389038086 nb_pixel_total : 256849 time to create 1 rle with new method : 0.01313638687133789 length of segment : 472 time for calcul the mask position with numpy : 0.0013699531555175781 nb_pixel_total : 51510 time to create 1 rle with old method : 0.0713660717010498 length of segment : 210 time for calcul the mask position with numpy : 0.013252735137939453 nb_pixel_total : 756593 time to create 1 rle with new method : 0.04423046112060547 length of segment : 1049 time for calcul the mask position with numpy : 0.0011875629425048828 nb_pixel_total : 78052 time to create 1 rle with old method : 0.08693671226501465 length of segment : 249 time for calcul the mask position with numpy : 0.004250288009643555 nb_pixel_total : 236516 time to create 1 rle with new method : 0.010790109634399414 length of segment : 717 time for calcul the mask position with numpy : 0.0016384124755859375 nb_pixel_total : 80163 time to create 1 rle with old method : 0.08838725090026855 length of segment : 518 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 87357 time to create 1 rle with old method : 0.09654712677001953 length of segment : 441 time for calcul the mask position with numpy : 0.0009217262268066406 nb_pixel_total : 59540 time to create 1 rle with old method : 0.06638240814208984 length of segment : 212 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 20743 time to create 1 rle with old method : 0.023909568786621094 length of segment : 238 time for calcul the mask position with numpy : 0.0006544589996337891 nb_pixel_total : 11758 time to create 1 rle with old method : 0.014134407043457031 length of segment : 226 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 17803 time to create 1 rle with old method : 0.020770549774169922 length of segment : 153 time for calcul the mask position with numpy : 0.0005891323089599609 nb_pixel_total : 27021 time to create 1 rle with old method : 0.03015422821044922 length of segment : 267 time for calcul the mask position with numpy : 0.0007405281066894531 nb_pixel_total : 22060 time to create 1 rle with old method : 0.025342226028442383 length of segment : 195 time for calcul the mask position with numpy : 0.011970043182373047 nb_pixel_total : 643440 time to create 1 rle with new method : 0.1552598476409912 length of segment : 676 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 43167 time to create 1 rle with old method : 0.04750847816467285 length of segment : 198 time for calcul the mask position with numpy : 0.0006520748138427734 nb_pixel_total : 18264 time to create 1 rle with old method : 0.01981210708618164 length of segment : 233 time for calcul the mask position with numpy : 0.0011599063873291016 nb_pixel_total : 49015 time to create 1 rle with old method : 0.053873538970947266 length of segment : 403 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 67319 time to create 1 rle with old method : 0.07386469841003418 length of segment : 366 time for calcul the mask position with numpy : 0.0043332576751708984 nb_pixel_total : 240684 time to create 1 rle with new method : 0.011400222778320312 length of segment : 587 time for calcul the mask position with numpy : 0.015204906463623047 nb_pixel_total : 574864 time to create 1 rle with new method : 0.03905773162841797 length of segment : 676 time for calcul the mask position with numpy : 0.0026438236236572266 nb_pixel_total : 110559 time to create 1 rle with old method : 0.11814546585083008 length of segment : 382 time for calcul the mask position with numpy : 0.0010678768157958984 nb_pixel_total : 49052 time to create 1 rle with old method : 0.053055524826049805 length of segment : 228 time for calcul the mask position with numpy : 0.0013387203216552734 nb_pixel_total : 53568 time to create 1 rle with old method : 0.0598139762878418 length of segment : 260 time for calcul the mask position with numpy : 0.0009174346923828125 nb_pixel_total : 47233 time to create 1 rle with old method : 0.05235457420349121 length of segment : 202 time for calcul the mask position with numpy : 0.002702474594116211 nb_pixel_total : 115017 time to create 1 rle with old method : 0.1238553524017334 length of segment : 586 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 51548 time to create 1 rle with old method : 0.05841803550720215 length of segment : 186 time for calcul the mask position with numpy : 0.001813650131225586 nb_pixel_total : 83358 time to create 1 rle with old method : 0.09075760841369629 length of segment : 411 time for calcul the mask position with numpy : 0.0008602142333984375 nb_pixel_total : 7334 time to create 1 rle with old method : 0.008540630340576172 length of segment : 177 time for calcul the mask position with numpy : 0.41003990173339844 nb_pixel_total : 6340649 time to create 1 rle with new method : 0.7528610229492188 length of segment : 3925 time for calcul the mask position with numpy : 0.24132251739501953 nb_pixel_total : 2399610 time to create 1 rle with new method : 0.20032739639282227 length of segment : 1742 time for calcul the mask position with numpy : 0.0027022361755371094 nb_pixel_total : 238151 time to create 1 rle with new method : 0.004331350326538086 length of segment : 205 time for calcul the mask position with numpy : 0.0008447170257568359 nb_pixel_total : 46578 time to create 1 rle with old method : 0.05133366584777832 length of segment : 179 time for calcul the mask position with numpy : 0.48531365394592285 nb_pixel_total : 3947281 time to create 1 rle with new method : 0.3373856544494629 length of segment : 2066 time for calcul the mask position with numpy : 0.2772529125213623 nb_pixel_total : 5130311 time to create 1 rle with new method : 0.49132442474365234 length of segment : 2093 time spent for convertir_results : 14.215451002120972 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 264 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 73.11188983917236 time spend to save output : 0.12592172622680664 total time spend for step 1 : 73.23781156539917 step2:mask_detect Tue May 13 03:02:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-13 03:02:46.823637: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-13 03:02:46.847675: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-13 03:02:46.849750: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7febb0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:02:46.849797: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-13 03:02:46.853515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-13 03:02:47.094117: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3c4b7db0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:02:47.094158: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-13 03:02:47.095301: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:02:47.095718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:02:47.098775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:02:47.101220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:02:47.101632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:02:47.104254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:02:47.105569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:02:47.110211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:02:47.111344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:02:47.111407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:02:47.112019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:02:47.112036: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:02:47.112044: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:02:47.113105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-13 03:02:47.224613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:02:47.224696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:02:47.224719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:02:47.224740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:02:47.224760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:02:47.224780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:02:47.224800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:02:47.224820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:02:47.226009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:02:47.227073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:02:47.227111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:02:47.227132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:02:47.227151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:02:47.227171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:02:47.227190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:02:47.227209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:02:47.227229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:02:47.228419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:02:47.228450: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:02:47.228460: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:02:47.228471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:02:47.229699: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFID2025-05-13 03:02:58.152346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:02:58.326176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 733778 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.013973474502563477 nb_pixel_total : 158634 time to create 1 rle with new method : 0.04673314094543457 length of segment : 555 time for calcul the mask position with numpy : 0.0010352134704589844 nb_pixel_total : 43689 time to create 1 rle with old method : 0.04867863655090332 length of segment : 160 time for calcul the mask position with numpy : 0.0037839412689208984 nb_pixel_total : 157702 time to create 1 rle with new method : 0.038312673568725586 length of segment : 439 time for calcul the mask position with numpy : 0.0010867118835449219 nb_pixel_total : 34496 time to create 1 rle with old method : 0.057416439056396484 length of segment : 367 time for calcul the mask position with numpy : 0.0038170814514160156 nb_pixel_total : 201944 time to create 1 rle with new method : 0.009102821350097656 length of segment : 502 time for calcul the mask position with numpy : 0.017673969268798828 nb_pixel_total : 684409 time to create 1 rle with new method : 0.11064481735229492 length of segment : 845 time for calcul the mask position with numpy : 0.007101774215698242 nb_pixel_total : 391150 time to create 1 rle with new method : 0.018296003341674805 length of segment : 519 time for calcul the mask position with numpy : 0.0017588138580322266 nb_pixel_total : 86014 time to create 1 rle with old method : 0.1053156852722168 length of segment : 272 time for calcul the mask position with numpy : 0.00455784797668457 nb_pixel_total : 250928 time to create 1 rle with new method : 0.01184535026550293 length of segment : 657 time for calcul the mask position with numpy : 0.0012493133544921875 nb_pixel_total : 63070 time to create 1 rle with old method : 0.06868815422058105 length of segment : 232 time for calcul the mask position with numpy : 0.01330876350402832 nb_pixel_total : 651753 time to create 1 rle with new method : 0.029649734497070312 length of segment : 1089 time for calcul the mask position with numpy : 0.0017387866973876953 nb_pixel_total : 73952 time to create 1 rle with old method : 0.08057165145874023 length of segment : 376 time for calcul the mask position with numpy : 0.0011861324310302734 nb_pixel_total : 45228 time to create 1 rle with old method : 0.05104517936706543 length of segment : 324 time for calcul the mask position with numpy : 0.0031113624572753906 nb_pixel_total : 54639 time to create 1 rle with old method : 0.060825347900390625 length of segment : 256 time for calcul the mask position with numpy : 0.02311563491821289 nb_pixel_total : 453037 time to create 1 rle with new method : 0.032094478607177734 length of segment : 969 time for calcul the mask position with numpy : 0.0008213520050048828 nb_pixel_total : 41336 time to create 1 rle with old method : 0.04486441612243652 length of segment : 284 time for calcul the mask position with numpy : 0.006377696990966797 nb_pixel_total : 206394 time to create 1 rle with new method : 0.013756990432739258 length of segment : 1012 time for calcul the mask position with numpy : 0.04498887062072754 nb_pixel_total : 789615 time to create 1 rle with new method : 0.13086438179016113 length of segment : 1045 time for calcul the mask position with numpy : 0.0041234493255615234 nb_pixel_total : 239254 time to create 1 rle with new method : 0.010194063186645508 length of segment : 508 time for calcul the mask position with numpy : 0.003881692886352539 nb_pixel_total : 131437 time to create 1 rle with old method : 0.16439390182495117 length of segment : 379 time for calcul the mask position with numpy : 0.0024809837341308594 nb_pixel_total : 135258 time to create 1 rle with old method : 0.19362306594848633 length of segment : 388 time for calcul the mask position with numpy : 0.005401134490966797 nb_pixel_total : 275611 time to create 1 rle with new method : 0.013016462326049805 length of segment : 534 time for calcul the mask position with numpy : 0.003511667251586914 nb_pixel_total : 156714 time to create 1 rle with new method : 0.010814666748046875 length of segment : 539 time for calcul the mask position with numpy : 0.0011792182922363281 nb_pixel_total : 46185 time to create 1 rle with old method : 0.0522310733795166 length of segment : 349 time for calcul the mask position with numpy : 0.001157999038696289 nb_pixel_total : 50942 time to create 1 rle with old method : 0.05911421775817871 length of segment : 253 time for calcul the mask position with numpy : 0.004323244094848633 nb_pixel_total : 130713 time to create 1 rle with old method : 0.16349220275878906 length of segment : 504 time for calcul the mask position with numpy : 0.002081632614135742 nb_pixel_total : 107509 time to create 1 rle with old method : 0.1254420280456543 length of segment : 394 time for calcul the mask position with numpy : 0.0025641918182373047 nb_pixel_total : 132035 time to create 1 rle with old method : 0.14402031898498535 length of segment : 335 time for calcul the mask position with numpy : 0.00232696533203125 nb_pixel_total : 102010 time to create 1 rle with old method : 0.12802982330322266 length of segment : 408 time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 17176 time to create 1 rle with old method : 0.03999662399291992 length of segment : 140 time for calcul the mask position with numpy : 0.011109352111816406 nb_pixel_total : 276261 time to create 1 rle with new method : 0.06952190399169922 length of segment : 931 time for calcul the mask position with numpy : 0.00448918342590332 nb_pixel_total : 113914 time to create 1 rle with old method : 0.14287972450256348 length of segment : 701 time for calcul the mask position with numpy : 0.0011856555938720703 nb_pixel_total : 35709 time to create 1 rle with old method : 0.044811248779296875 length of segment : 298 time for calcul the mask position with numpy : 0.0016622543334960938 nb_pixel_total : 69522 time to create 1 rle with old method : 0.09445309638977051 length of segment : 404 time for calcul the mask position with numpy : 0.00177764892578125 nb_pixel_total : 47783 time to create 1 rle with old method : 0.05545949935913086 length of segment : 276 time for calcul the mask position with numpy : 0.0014233589172363281 nb_pixel_total : 42861 time to create 1 rle with old method : 0.06906461715698242 length of segment : 385 time for calcul the mask position with numpy : 0.0028786659240722656 nb_pixel_total : 152301 time to create 1 rle with new method : 0.009244918823242188 length of segment : 948 time for calcul the mask position with numpy : 0.015093564987182617 nb_pixel_total : 447339 time to create 1 rle with new method : 0.7043070793151855 length of segment : 704 time for calcul the mask position with numpy : 0.006388664245605469 nb_pixel_total : 336750 time to create 1 rle with new method : 0.016839027404785156 length of segment : 620 time for calcul the mask position with numpy : 0.0008306503295898438 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0018868446350097656 length of segment : 124 time for calcul the mask position with numpy : 0.002870321273803711 nb_pixel_total : 105601 time to create 1 rle with old method : 0.1384894847869873 length of segment : 620 time for calcul the mask position with numpy : 0.0009148120880126953 nb_pixel_total : 45969 time to create 1 rle with old method : 0.050692081451416016 length of segment : 211 time for calcul the mask position with numpy : 0.0026984214782714844 nb_pixel_total : 100482 time to create 1 rle with old method : 0.111419677734375 length of segment : 493 time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 9823 time to create 1 rle with old method : 0.011191368103027344 length of segment : 125 time for calcul the mask position with numpy : 0.009095191955566406 nb_pixel_total : 543947 time to create 1 rle with new method : 0.02085566520690918 length of segment : 928 time for calcul the mask position with numpy : 0.014612436294555664 nb_pixel_total : 636161 time to create 1 rle with new method : 0.0922691822052002 length of segment : 1638 time for calcul the mask position with numpy : 0.007745981216430664 nb_pixel_total : 527670 time to create 1 rle with new method : 0.02721691131591797 length of segment : 904 time for calcul the mask position with numpy : 0.0028367042541503906 nb_pixel_total : 97486 time to create 1 rle with old method : 0.10663223266601562 length of segment : 428 time for calcul the mask position with numpy : 0.00916433334350586 nb_pixel_total : 298874 time to create 1 rle with new method : 0.01374506950378418 length of segment : 593 time for calcul the mask position with numpy : 0.0019750595092773438 nb_pixel_total : 80262 time to create 1 rle with old method : 0.08590435981750488 length of segment : 440 time for calcul the mask position with numpy : 0.0007040500640869141 nb_pixel_total : 25868 time to create 1 rle with old method : 0.027844905853271484 length of segment : 169 time for calcul the mask position with numpy : 0.008046627044677734 nb_pixel_total : 225738 time to create 1 rle with new method : 0.011645317077636719 length of segment : 652 time for calcul the mask position with numpy : 0.0026192665100097656 nb_pixel_total : 111454 time to create 1 rle with old method : 0.1180884838104248 length of segment : 391 time for calcul the mask position with numpy : 0.001577615737915039 nb_pixel_total : 73499 time to create 1 rle with old method : 0.07680106163024902 length of segment : 385 time for calcul the mask position with numpy : 0.006233692169189453 nb_pixel_total : 284553 time to create 1 rle with new method : 0.018395423889160156 length of segment : 674 time for calcul the mask position with numpy : 0.003349781036376953 nb_pixel_total : 161605 time to create 1 rle with new method : 0.009779930114746094 length of segment : 684 time for calcul the mask position with numpy : 0.0010437965393066406 nb_pixel_total : 36576 time to create 1 rle with old method : 0.04023313522338867 length of segment : 233 time for calcul the mask position with numpy : 0.0016193389892578125 nb_pixel_total : 76906 time to create 1 rle with old method : 0.08427953720092773 length of segment : 256 time for calcul the mask position with numpy : 0.002722501754760742 nb_pixel_total : 137647 time to create 1 rle with old method : 0.15126371383666992 length of segment : 552 time for calcul the mask position with numpy : 0.0040645599365234375 nb_pixel_total : 211391 time to create 1 rle with new method : 0.010715723037719727 length of segment : 496 time for calcul the mask position with numpy : 0.003689289093017578 nb_pixel_total : 213993 time to create 1 rle with new method : 0.010129690170288086 length of segment : 500 time for calcul the mask position with numpy : 0.003244161605834961 nb_pixel_total : 161628 time to create 1 rle with new method : 0.009181737899780273 length of segment : 622 time for calcul the mask position with numpy : 0.003392457962036133 nb_pixel_total : 155138 time to create 1 rle with new method : 0.008786678314208984 length of segment : 439 time for calcul the mask position with numpy : 0.003902435302734375 nb_pixel_total : 228983 time to create 1 rle with new method : 0.010471105575561523 length of segment : 722 time for calcul the mask position with numpy : 0.0031538009643554688 nb_pixel_total : 89058 time to create 1 rle with old method : 0.09459352493286133 length of segment : 531 time for calcul the mask position with numpy : 0.0010094642639160156 nb_pixel_total : 38710 time to create 1 rle with old method : 0.04108071327209473 length of segment : 285 time for calcul the mask position with numpy : 0.0007808208465576172 nb_pixel_total : 35869 time to create 1 rle with old method : 0.03985261917114258 length of segment : 183 time for calcul the mask position with numpy : 0.0007421970367431641 nb_pixel_total : 40752 time to create 1 rle with old method : 0.04370856285095215 length of segment : 216 time for calcul the mask position with numpy : 0.017838239669799805 nb_pixel_total : 819113 time to create 1 rle with new method : 0.11764144897460938 length of segment : 1006 time for calcul the mask position with numpy : 0.0008747577667236328 nb_pixel_total : 30679 time to create 1 rle with old method : 0.03340435028076172 length of segment : 274 time for calcul the mask position with numpy : 0.012293338775634766 nb_pixel_total : 551695 time to create 1 rle with new method : 0.0650930404663086 length of segment : 1100 time for calcul the mask position with numpy : 0.0008296966552734375 nb_pixel_total : 41868 time to create 1 rle with old method : 0.04534912109375 length of segment : 415 time for calcul the mask position with numpy : 0.0030820369720458984 nb_pixel_total : 120124 time to create 1 rle with old method : 0.13301634788513184 length of segment : 546 time for calcul the mask position with numpy : 0.002877950668334961 nb_pixel_total : 156723 time to create 1 rle with new method : 0.008562564849853516 length of segment : 365 time for calcul the mask position with numpy : 0.01192474365234375 nb_pixel_total : 500795 time to create 1 rle with new method : 0.027032136917114258 length of segment : 929 time for calcul the mask position with numpy : 0.02118849754333496 nb_pixel_total : 804273 time to create 1 rle with new method : 0.2760186195373535 length of segment : 1322 time for calcul the mask position with numpy : 0.0008068084716796875 nb_pixel_total : 33798 time to create 1 rle with old method : 0.037714242935180664 length of segment : 186 time for calcul the mask position with numpy : 0.010164976119995117 nb_pixel_total : 484869 time to create 1 rle with new method : 0.0442507266998291 length of segment : 1349 time for calcul the mask position with numpy : 0.004335641860961914 nb_pixel_total : 127134 time to create 1 rle with old method : 0.13815712928771973 length of segment : 455 time for calcul the mask position with numpy : 0.0009386539459228516 nb_pixel_total : 38679 time to create 1 rle with old method : 0.04220724105834961 length of segment : 194 time for calcul the mask position with numpy : 0.0027320384979248047 nb_pixel_total : 166070 time to create 1 rle with new method : 0.007284641265869141 length of segment : 533 time for calcul the mask position with numpy : 0.002260923385620117 nb_pixel_total : 106406 time to create 1 rle with old method : 0.12676358222961426 length of segment : 328 time for calcul the mask position with numpy : 0.0058782100677490234 nb_pixel_total : 296620 time to create 1 rle with new method : 0.015311717987060547 length of segment : 634 time for calcul the mask position with numpy : 0.001264333724975586 nb_pixel_total : 44332 time to create 1 rle with old method : 0.04978585243225098 length of segment : 166 time for calcul the mask position with numpy : 0.0017576217651367188 nb_pixel_total : 79949 time to create 1 rle with old method : 0.08646440505981445 length of segment : 370 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 16705 time to create 1 rle with old method : 0.01799154281616211 length of segment : 137 time for calcul the mask position with numpy : 0.0014994144439697266 nb_pixel_total : 80600 time to create 1 rle with old method : 0.08699679374694824 length of segment : 496 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 40855 time to create 1 rle with old method : 0.04325437545776367 length of segment : 275 time for calcul the mask position with numpy : 0.013648033142089844 nb_pixel_total : 343796 time to create 1 rle with new method : 0.07857394218444824 length of segment : 1148 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 18083 time to create 1 rle with old method : 0.020435333251953125 length of segment : 114 time for calcul the mask position with numpy : 0.0026519298553466797 nb_pixel_total : 158435 time to create 1 rle with new method : 0.006697177886962891 length of segment : 518 time for calcul the mask position with numpy : 0.0026171207427978516 nb_pixel_total : 74547 time to create 1 rle with old method : 0.08183646202087402 length of segment : 535 time for calcul the mask position with numpy : 0.0024747848510742188 nb_pixel_total : 77579 time to create 1 rle with old method : 0.08466196060180664 length of segment : 437 time for calcul the mask position with numpy : 0.002897024154663086 nb_pixel_total : 157408 time to create 1 rle with new method : 0.007669925689697266 length of segment : 375 time for calcul the mask position with numpy : 0.004286289215087891 nb_pixel_total : 221734 time to create 1 rle with new method : 0.011204004287719727 length of segment : 514 time for calcul the mask position with numpy : 0.0022008419036865234 nb_pixel_total : 121894 time to create 1 rle with old method : 0.13252615928649902 length of segment : 445 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 26744 time to create 1 rle with old method : 0.030894041061401367 length of segment : 249 time for calcul the mask position with numpy : 0.0020728111267089844 nb_pixel_total : 123021 time to create 1 rle with old method : 0.1330585479736328 length of segment : 541 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 36594 time to create 1 rle with old method : 0.050141334533691406 length of segment : 199 time for calcul the mask position with numpy : 0.0011150836944580078 nb_pixel_total : 23826 time to create 1 rle with old method : 0.026538848876953125 length of segment : 220 time for calcul the mask position with numpy : 0.0007646083831787109 nb_pixel_total : 37270 time to create 1 rle with old method : 0.04040384292602539 length of segment : 210 time for calcul the mask position with numpy : 0.0010466575622558594 nb_pixel_total : 34276 time to create 1 rle with old method : 0.038116455078125 length of segment : 237 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 22741 time to create 1 rle with old method : 0.025023460388183594 length of segment : 242 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 16114 time to create 1 rle with old method : 0.017906665802001953 length of segment : 236 time for calcul the mask position with numpy : 0.0022988319396972656 nb_pixel_total : 113538 time to create 1 rle with old method : 0.12232375144958496 length of segment : 407 time for calcul the mask position with numpy : 0.010365724563598633 nb_pixel_total : 307975 time to create 1 rle with new method : 0.03374004364013672 length of segment : 1192 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 46661 time to create 1 rle with old method : 0.04920148849487305 length of segment : 206 time for calcul the mask position with numpy : 0.0026268959045410156 nb_pixel_total : 147397 time to create 1 rle with old method : 0.1545865535736084 length of segment : 432 time for calcul the mask position with numpy : 0.0006470680236816406 nb_pixel_total : 11390 time to create 1 rle with old method : 0.012960195541381836 length of segment : 161 time for calcul the mask position with numpy : 0.0024051666259765625 nb_pixel_total : 101217 time to create 1 rle with old method : 0.10940408706665039 length of segment : 422 time for calcul the mask position with numpy : 0.0017211437225341797 nb_pixel_total : 102102 time to create 1 rle with old method : 0.11184310913085938 length of segment : 345 time for calcul the mask position with numpy : 0.002722024917602539 nb_pixel_total : 158724 time to create 1 rle with new method : 0.007430315017700195 length of segment : 463 time for calcul the mask position with numpy : 0.005128145217895508 nb_pixel_total : 178633 time to create 1 rle with new method : 0.015541553497314453 length of segment : 629 time for calcul the mask position with numpy : 0.003980875015258789 nb_pixel_total : 189404 time to create 1 rle with new method : 0.010757207870483398 length of segment : 454 time for calcul the mask position with numpy : 0.0006365776062011719 nb_pixel_total : 13781 time to create 1 rle with old method : 0.015203237533569336 length of segment : 141 time for calcul the mask position with numpy : 0.0008554458618164062 nb_pixel_total : 39635 time to create 1 rle with old method : 0.04336881637573242 length of segment : 268 time for calcul the mask position with numpy : 0.0013890266418457031 nb_pixel_total : 48602 time to create 1 rle with old method : 0.05458402633666992 length of segment : 371 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 36297 time to create 1 rle with old method : 0.038771867752075195 length of segment : 276 time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 19188 time to create 1 rle with old method : 0.021152496337890625 length of segment : 126 time for calcul the mask position with numpy : 0.0043430328369140625 nb_pixel_total : 237882 time to create 1 rle with new method : 0.013021707534790039 length of segment : 589 time for calcul the mask position with numpy : 0.0011448860168457031 nb_pixel_total : 50337 time to create 1 rle with old method : 0.05386948585510254 length of segment : 334 time for calcul the mask position with numpy : 0.0014317035675048828 nb_pixel_total : 62692 time to create 1 rle with old method : 0.06747174263000488 length of segment : 219 time for calcul the mask position with numpy : 0.004700183868408203 nb_pixel_total : 251888 time to create 1 rle with new method : 0.013444662094116211 length of segment : 838 time for calcul the mask position with numpy : 0.0007081031799316406 nb_pixel_total : 31710 time to create 1 rle with old method : 0.03473806381225586 length of segment : 196 time for calcul the mask position with numpy : 0.004568338394165039 nb_pixel_total : 178826 time to create 1 rle with new method : 0.01539158821105957 length of segment : 896 time for calcul the mask position with numpy : 0.0024080276489257812 nb_pixel_total : 145794 time to create 1 rle with old method : 0.1543419361114502 length of segment : 454 time for calcul the mask position with numpy : 0.0036020278930664062 nb_pixel_total : 187273 time to create 1 rle with new method : 0.010476112365722656 length of segment : 452 time for calcul the mask position with numpy : 0.0014140605926513672 nb_pixel_total : 93376 time to create 1 rle with old method : 0.10458707809448242 length of segment : 299 time for calcul the mask position with numpy : 0.004250526428222656 nb_pixel_total : 157787 time to create 1 rle with new method : 0.012563705444335938 length of segment : 786 time for calcul the mask position with numpy : 0.0006618499755859375 nb_pixel_total : 33250 time to create 1 rle with old method : 0.05134749412536621 length of segment : 120 time for calcul the mask position with numpy : 0.0145721435546875 nb_pixel_total : 688489 time to create 1 rle with new method : 0.04613852500915527 length of segment : 1839 time for calcul the mask position with numpy : 0.0016808509826660156 nb_pixel_total : 58803 time to create 1 rle with old method : 0.06661701202392578 length of segment : 417 time for calcul the mask position with numpy : 0.0016126632690429688 nb_pixel_total : 76836 time to create 1 rle with old method : 0.08363938331604004 length of segment : 375 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 47120 time to create 1 rle with old method : 0.05070614814758301 length of segment : 313 time for calcul the mask position with numpy : 0.00478363037109375 nb_pixel_total : 201933 time to create 1 rle with new method : 0.015100479125976562 length of segment : 693 time for calcul the mask position with numpy : 0.0005977153778076172 nb_pixel_total : 24813 time to create 1 rle with old method : 0.026737689971923828 length of segment : 186 time for calcul the mask position with numpy : 0.0013022422790527344 nb_pixel_total : 54017 time to create 1 rle with old method : 0.058959007263183594 length of segment : 308 time for calcul the mask position with numpy : 0.0012099742889404297 nb_pixel_total : 49826 time to create 1 rle with old method : 0.05342888832092285 length of segment : 271 time for calcul the mask position with numpy : 0.0012240409851074219 nb_pixel_total : 61284 time to create 1 rle with old method : 0.06681942939758301 length of segment : 235 time for calcul the mask position with numpy : 0.0010843276977539062 nb_pixel_total : 37746 time to create 1 rle with old method : 0.0410006046295166 length of segment : 367 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 37767 time to create 1 rle with old method : 0.04296302795410156 length of segment : 254 time for calcul the mask position with numpy : 0.0023140907287597656 nb_pixel_total : 50757 time to create 1 rle with old method : 0.057279348373413086 length of segment : 331 time for calcul the mask position with numpy : 0.0009059906005859375 nb_pixel_total : 46900 time to create 1 rle with old method : 0.05125260353088379 length of segment : 257 time for calcul the mask position with numpy : 0.0016374588012695312 nb_pixel_total : 58440 time to create 1 rle with old method : 0.06576228141784668 length of segment : 303 time for calcul the mask position with numpy : 0.0012407302856445312 nb_pixel_total : 49442 time to create 1 rle with old method : 0.056375980377197266 length of segment : 236 time for calcul the mask position with numpy : 0.006808280944824219 nb_pixel_total : 359880 time to create 1 rle with new method : 0.01806783676147461 length of segment : 636 time for calcul the mask position with numpy : 0.004270076751708984 nb_pixel_total : 170202 time to create 1 rle with new method : 0.012354135513305664 length of segment : 434 time for calcul the mask position with numpy : 0.005257368087768555 nb_pixel_total : 186024 time to create 1 rle with new method : 0.018078088760375977 length of segment : 753 time for calcul the mask position with numpy : 0.0023381710052490234 nb_pixel_total : 105742 time to create 1 rle with old method : 0.1136007308959961 length of segment : 286 time for calcul the mask position with numpy : 0.0008647441864013672 nb_pixel_total : 33725 time to create 1 rle with old method : 0.03737044334411621 length of segment : 272 time for calcul the mask position with numpy : 0.009171485900878906 nb_pixel_total : 433071 time to create 1 rle with new method : 0.024421215057373047 length of segment : 1095 time for calcul the mask position with numpy : 0.0012319087982177734 nb_pixel_total : 67376 time to create 1 rle with old method : 0.07383155822753906 length of segment : 219 time for calcul the mask position with numpy : 0.002354860305786133 nb_pixel_total : 112675 time to create 1 rle with old method : 0.12299847602844238 length of segment : 589 time for calcul the mask position with numpy : 0.008489847183227539 nb_pixel_total : 332353 time to create 1 rle with new method : 0.026216745376586914 length of segment : 809 time for calcul the mask position with numpy : 0.0020787715911865234 nb_pixel_total : 77394 time to create 1 rle with old method : 0.08889651298522949 length of segment : 250 time for calcul the mask position with numpy : 0.010982990264892578 nb_pixel_total : 277638 time to create 1 rle with new method : 0.026297569274902344 length of segment : 890 time for calcul the mask position with numpy : 0.013083457946777344 nb_pixel_total : 464794 time to create 1 rle with new method : 0.03148841857910156 length of segment : 964 time for calcul the mask position with numpy : 0.002331972122192383 nb_pixel_total : 112083 time to create 1 rle with old method : 0.12090802192687988 length of segment : 615 time for calcul the mask position with numpy : 0.0009849071502685547 nb_pixel_total : 43438 time to create 1 rle with old method : 0.04817056655883789 length of segment : 265 time for calcul the mask position with numpy : 0.002155780792236328 nb_pixel_total : 102018 time to create 1 rle with old method : 0.11113357543945312 length of segment : 362 time for calcul the mask position with numpy : 0.004338979721069336 nb_pixel_total : 203404 time to create 1 rle with new method : 0.012366294860839844 length of segment : 550 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 30854 time to create 1 rle with old method : 0.034043312072753906 length of segment : 313 time for calcul the mask position with numpy : 0.00388336181640625 nb_pixel_total : 188080 time to create 1 rle with new method : 0.011308431625366211 length of segment : 538 time for calcul the mask position with numpy : 0.0008397102355957031 nb_pixel_total : 35512 time to create 1 rle with old method : 0.040313005447387695 length of segment : 195 time for calcul the mask position with numpy : 0.0018312931060791016 nb_pixel_total : 70532 time to create 1 rle with old method : 0.07738184928894043 length of segment : 292 time for calcul the mask position with numpy : 0.0025827884674072266 nb_pixel_total : 110703 time to create 1 rle with old method : 0.1259934902191162 length of segment : 525 time for calcul the mask position with numpy : 0.0013234615325927734 nb_pixel_total : 61285 time to create 1 rle with old method : 0.06551933288574219 length of segment : 291 time for calcul the mask position with numpy : 0.0007128715515136719 nb_pixel_total : 30458 time to create 1 rle with old method : 0.032869577407836914 length of segment : 185 time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 17622 time to create 1 rle with old method : 0.0197756290435791 length of segment : 138 time for calcul the mask position with numpy : 0.009371042251586914 nb_pixel_total : 290254 time to create 1 rle with new method : 0.03001546859741211 length of segment : 1398 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 331148 time to create 1 rle with new method : 0.015299081802368164 length of segment : 1057 time for calcul the mask position with numpy : 0.007605075836181641 nb_pixel_total : 272542 time to create 1 rle with new method : 0.02236652374267578 length of segment : 861 time for calcul the mask position with numpy : 0.004889249801635742 nb_pixel_total : 265516 time to create 1 rle with new method : 0.013535499572753906 length of segment : 686 time for calcul the mask position with numpy : 0.0011734962463378906 nb_pixel_total : 56168 time to create 1 rle with old method : 0.06124472618103027 length of segment : 207 time for calcul the mask position with numpy : 0.0015425682067871094 nb_pixel_total : 40753 time to create 1 rle with old method : 0.04536104202270508 length of segment : 319 time for calcul the mask position with numpy : 0.0005257129669189453 nb_pixel_total : 20626 time to create 1 rle with old method : 0.022576093673706055 length of segment : 184 time for calcul the mask position with numpy : 0.003063201904296875 nb_pixel_total : 150173 time to create 1 rle with new method : 0.00877237319946289 length of segment : 415 time for calcul the mask position with numpy : 0.002126455307006836 nb_pixel_total : 79055 time to create 1 rle with old method : 0.08497452735900879 length of segment : 404 time for calcul the mask position with numpy : 0.003094911575317383 nb_pixel_total : 116052 time to create 1 rle with old method : 0.15380120277404785 length of segment : 498 time for calcul the mask position with numpy : 0.0008218288421630859 nb_pixel_total : 36571 time to create 1 rle with old method : 0.04062366485595703 length of segment : 172 time for calcul the mask position with numpy : 0.0025484561920166016 nb_pixel_total : 155172 time to create 1 rle with new method : 0.006644010543823242 length of segment : 422 time for calcul the mask position with numpy : 0.004532337188720703 nb_pixel_total : 204031 time to create 1 rle with new method : 0.014448165893554688 length of segment : 603 time for calcul the mask position with numpy : 0.0014486312866210938 nb_pixel_total : 72552 time to create 1 rle with old method : 0.07980537414550781 length of segment : 239 time for calcul the mask position with numpy : 0.002326488494873047 nb_pixel_total : 127048 time to create 1 rle with old method : 0.138136625289917 length of segment : 559 time for calcul the mask position with numpy : 0.008594274520874023 nb_pixel_total : 373735 time to create 1 rle with new method : 0.02735304832458496 length of segment : 946 time for calcul the mask position with numpy : 0.011472702026367188 nb_pixel_total : 591465 time to create 1 rle with new method : 0.028227806091308594 length of segment : 1042 time for calcul the mask position with numpy : 0.0030639171600341797 nb_pixel_total : 89673 time to create 1 rle with old method : 0.10015010833740234 length of segment : 495 time for calcul the mask position with numpy : 0.0019850730895996094 nb_pixel_total : 101097 time to create 1 rle with old method : 0.11467742919921875 length of segment : 366 time for calcul the mask position with numpy : 0.0020973682403564453 nb_pixel_total : 90449 time to create 1 rle with old method : 0.10387396812438965 length of segment : 281 time for calcul the mask position with numpy : 0.0020873546600341797 nb_pixel_total : 99291 time to create 1 rle with old method : 0.11130952835083008 length of segment : 545 time for calcul the mask position with numpy : 0.0016646385192871094 nb_pixel_total : 76215 time to create 1 rle with old method : 0.08809232711791992 length of segment : 316 time for calcul the mask position with numpy : 0.0007312297821044922 nb_pixel_total : 25866 time to create 1 rle with old method : 0.030622243881225586 length of segment : 162 time for calcul the mask position with numpy : 0.0026788711547851562 nb_pixel_total : 128469 time to create 1 rle with old method : 0.1384117603302002 length of segment : 433 time for calcul the mask position with numpy : 0.0015180110931396484 nb_pixel_total : 70446 time to create 1 rle with old method : 0.0785071849822998 length of segment : 388 time for calcul the mask position with numpy : 0.00429987907409668 nb_pixel_total : 178267 time to create 1 rle with new method : 0.013204336166381836 length of segment : 589 time for calcul the mask position with numpy : 0.002368450164794922 nb_pixel_total : 21650 time to create 1 rle with old method : 0.024443864822387695 length of segment : 369 time for calcul the mask position with numpy : 0.00993657112121582 nb_pixel_total : 550455 time to create 1 rle with new method : 0.025420665740966797 length of segment : 1042 time for calcul the mask position with numpy : 0.0026116371154785156 nb_pixel_total : 124328 time to create 1 rle with old method : 0.13747119903564453 length of segment : 397 time for calcul the mask position with numpy : 0.0009801387786865234 nb_pixel_total : 31045 time to create 1 rle with old method : 0.034444332122802734 length of segment : 247 time for calcul the mask position with numpy : 0.0007710456848144531 nb_pixel_total : 31287 time to create 1 rle with old method : 0.03479146957397461 length of segment : 212 time for calcul the mask position with numpy : 0.0013370513916015625 nb_pixel_total : 69098 time to create 1 rle with old method : 0.07627248764038086 length of segment : 268 time for calcul the mask position with numpy : 0.002082347869873047 nb_pixel_total : 59627 time to create 1 rle with old method : 0.06787538528442383 length of segment : 261 time for calcul the mask position with numpy : 0.002232789993286133 nb_pixel_total : 95096 time to create 1 rle with old method : 0.10499215126037598 length of segment : 393 time for calcul the mask position with numpy : 0.002273082733154297 nb_pixel_total : 86807 time to create 1 rle with old method : 0.09568572044372559 length of segment : 367 time for calcul the mask position with numpy : 0.002700328826904297 nb_pixel_total : 113768 time to create 1 rle with old method : 0.12347936630249023 length of segment : 507 time for calcul the mask position with numpy : 0.004777669906616211 nb_pixel_total : 187061 time to create 1 rle with new method : 0.01455068588256836 length of segment : 610 time for calcul the mask position with numpy : 0.0021276473999023438 nb_pixel_total : 77067 time to create 1 rle with old method : 0.0856626033782959 length of segment : 339 time for calcul the mask position with numpy : 0.002304553985595703 nb_pixel_total : 105671 time to create 1 rle with old method : 0.1325545310974121 length of segment : 446 time for calcul the mask position with numpy : 0.0028715133666992188 nb_pixel_total : 110174 time to create 1 rle with old method : 0.11937999725341797 length of segment : 450 time for calcul the mask position with numpy : 0.001569986343383789 nb_pixel_total : 88583 time to create 1 rle with old method : 0.09662318229675293 length of segment : 360 time for calcul the mask position with numpy : 0.003228902816772461 nb_pixel_total : 159028 time to create 1 rle with new method : 0.010031700134277344 length of segment : 982 time for calcul the mask position with numpy : 0.0036983489990234375 nb_pixel_total : 129253 time to create 1 rle with old method : 0.17004156112670898 length of segment : 846 time for calcul the mask position with numpy : 0.00225067138671875 nb_pixel_total : 96277 time to create 1 rle with old method : 0.10596323013305664 length of segment : 313 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 65176 time to create 1 rle with old method : 0.07098197937011719 length of segment : 296 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 17179 time to create 1 rle with old method : 0.019368886947631836 length of segment : 165 time for calcul the mask position with numpy : 0.003544330596923828 nb_pixel_total : 154864 time to create 1 rle with new method : 0.01023101806640625 length of segment : 433 time for calcul the mask position with numpy : 0.011574029922485352 nb_pixel_total : 404105 time to create 1 rle with new method : 0.02081894874572754 length of segment : 1193 time for calcul the mask position with numpy : 0.0026688575744628906 nb_pixel_total : 87894 time to create 1 rle with old method : 0.09325885772705078 length of segment : 280 time for calcul the mask position with numpy : 0.004563093185424805 nb_pixel_total : 161885 time to create 1 rle with new method : 0.0075032711029052734 length of segment : 397 time for calcul the mask position with numpy : 0.00795125961303711 nb_pixel_total : 277733 time to create 1 rle with new method : 0.015092134475708008 length of segment : 668 time for calcul the mask position with numpy : 0.014494895935058594 nb_pixel_total : 248708 time to create 1 rle with new method : 0.021593809127807617 length of segment : 1252 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 11775 time to create 1 rle with old method : 0.013526439666748047 length of segment : 159 time for calcul the mask position with numpy : 0.00122833251953125 nb_pixel_total : 53623 time to create 1 rle with old method : 0.05941462516784668 length of segment : 293 time for calcul the mask position with numpy : 0.0024852752685546875 nb_pixel_total : 62101 time to create 1 rle with old method : 0.06657123565673828 length of segment : 348 time for calcul the mask position with numpy : 0.0033638477325439453 nb_pixel_total : 87466 time to create 1 rle with old method : 0.09206962585449219 length of segment : 464 time for calcul the mask position with numpy : 0.007147312164306641 nb_pixel_total : 318641 time to create 1 rle with new method : 0.021280288696289062 length of segment : 697 time for calcul the mask position with numpy : 0.015355587005615234 nb_pixel_total : 372926 time to create 1 rle with new method : 0.027378320693969727 length of segment : 1041 time for calcul the mask position with numpy : 0.003438711166381836 nb_pixel_total : 103119 time to create 1 rle with old method : 0.11232542991638184 length of segment : 472 time for calcul the mask position with numpy : 0.0014491081237792969 nb_pixel_total : 42078 time to create 1 rle with old method : 0.04649806022644043 length of segment : 249 time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 34589 time to create 1 rle with old method : 0.03893566131591797 length of segment : 245 time for calcul the mask position with numpy : 0.0014541149139404297 nb_pixel_total : 54692 time to create 1 rle with old method : 0.05888485908508301 length of segment : 216 time for calcul the mask position with numpy : 0.002240896224975586 nb_pixel_total : 39354 time to create 1 rle with old method : 0.042707204818725586 length of segment : 526 time for calcul the mask position with numpy : 0.005821704864501953 nb_pixel_total : 165994 time to create 1 rle with new method : 0.01036691665649414 length of segment : 504 time for calcul the mask position with numpy : 0.004198551177978516 nb_pixel_total : 125326 time to create 1 rle with old method : 0.13562273979187012 length of segment : 603 time for calcul the mask position with numpy : 0.0008072853088378906 nb_pixel_total : 26413 time to create 1 rle with old method : 0.02957916259765625 length of segment : 186 time for calcul the mask position with numpy : 0.0039021968841552734 nb_pixel_total : 58114 time to create 1 rle with old method : 0.06394720077514648 length of segment : 458 time for calcul the mask position with numpy : 0.0016050338745117188 nb_pixel_total : 26625 time to create 1 rle with old method : 0.029873132705688477 length of segment : 211 time for calcul the mask position with numpy : 0.0017147064208984375 nb_pixel_total : 60925 time to create 1 rle with old method : 0.06786656379699707 length of segment : 276 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 16391 time to create 1 rle with old method : 0.018522262573242188 length of segment : 118 time for calcul the mask position with numpy : 0.000545501708984375 nb_pixel_total : 16361 time to create 1 rle with old method : 0.018471717834472656 length of segment : 153 time for calcul the mask position with numpy : 0.0010628700256347656 nb_pixel_total : 21838 time to create 1 rle with old method : 0.024425506591796875 length of segment : 196 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 10833 time to create 1 rle with old method : 0.012549400329589844 length of segment : 203 time for calcul the mask position with numpy : 0.003827810287475586 nb_pixel_total : 100552 time to create 1 rle with old method : 0.10992622375488281 length of segment : 648 time for calcul the mask position with numpy : 0.007069826126098633 nb_pixel_total : 145983 time to create 1 rle with old method : 0.15916872024536133 length of segment : 563 time for calcul the mask position with numpy : 0.008775472640991211 nb_pixel_total : 209531 time to create 1 rle with new method : 0.018639087677001953 length of segment : 1245 time for calcul the mask position with numpy : 0.01787590980529785 nb_pixel_total : 448688 time to create 1 rle with new method : 0.037241220474243164 length of segment : 1599 time for calcul the mask position with numpy : 0.0015711784362792969 nb_pixel_total : 51344 time to create 1 rle with old method : 0.05448484420776367 length of segment : 276 time for calcul the mask position with numpy : 0.0006992816925048828 nb_pixel_total : 21510 time to create 1 rle with old method : 0.0234222412109375 length of segment : 285 time for calcul the mask position with numpy : 0.009298563003540039 nb_pixel_total : 434612 time to create 1 rle with new method : 0.0202481746673584 length of segment : 1237 time for calcul the mask position with numpy : 0.0025398731231689453 nb_pixel_total : 92229 time to create 1 rle with old method : 0.09870529174804688 length of segment : 440 time for calcul the mask position with numpy : 0.003133535385131836 nb_pixel_total : 74308 time to create 1 rle with old method : 0.07989811897277832 length of segment : 303 time for calcul the mask position with numpy : 0.00067901611328125 nb_pixel_total : 32035 time to create 1 rle with old method : 0.03545236587524414 length of segment : 266 time for calcul the mask position with numpy : 0.009492158889770508 nb_pixel_total : 194064 time to create 1 rle with new method : 0.016294240951538086 length of segment : 675 time for calcul the mask position with numpy : 0.002399444580078125 nb_pixel_total : 96913 time to create 1 rle with old method : 0.1040334701538086 length of segment : 261 time for calcul the mask position with numpy : 0.000682830810546875 nb_pixel_total : 26166 time to create 1 rle with old method : 0.029238462448120117 length of segment : 143 time for calcul the mask position with numpy : 0.006300449371337891 nb_pixel_total : 202745 time to create 1 rle with new method : 0.013459444046020508 length of segment : 1034 time for calcul the mask position with numpy : 0.0018525123596191406 nb_pixel_total : 91411 time to create 1 rle with old method : 0.09749317169189453 length of segment : 337 time for calcul the mask position with numpy : 0.003211498260498047 nb_pixel_total : 120499 time to create 1 rle with old method : 0.13132405281066895 length of segment : 481 time for calcul the mask position with numpy : 0.002682924270629883 nb_pixel_total : 64720 time to create 1 rle with old method : 0.07074666023254395 length of segment : 353 time for calcul the mask position with numpy : 0.010558128356933594 nb_pixel_total : 399627 time to create 1 rle with new method : 0.02834486961364746 length of segment : 1165 time for calcul the mask position with numpy : 0.001922607421875 nb_pixel_total : 79377 time to create 1 rle with old method : 0.08704948425292969 length of segment : 329 time for calcul the mask position with numpy : 0.006316661834716797 nb_pixel_total : 376220 time to create 1 rle with new method : 0.016899824142456055 length of segment : 652 time for calcul the mask position with numpy : 0.0013613700866699219 nb_pixel_total : 22983 time to create 1 rle with old method : 0.02469325065612793 length of segment : 230 time for calcul the mask position with numpy : 0.0013363361358642578 nb_pixel_total : 10949 time to create 1 rle with old method : 0.011980772018432617 length of segment : 199 time for calcul the mask position with numpy : 0.025719404220581055 nb_pixel_total : 676957 time to create 1 rle with new method : 0.10350537300109863 length of segment : 1935 time for calcul the mask position with numpy : 0.012075424194335938 nb_pixel_total : 576498 time to create 1 rle with new method : 0.05572867393493652 length of segment : 1213 time for calcul the mask position with numpy : 0.008348941802978516 nb_pixel_total : 185935 time to create 1 rle with new method : 0.020287513732910156 length of segment : 835 time for calcul the mask position with numpy : 0.006722450256347656 nb_pixel_total : 220830 time to create 1 rle with new method : 0.011354684829711914 length of segment : 374 time for calcul the mask position with numpy : 0.002665281295776367 nb_pixel_total : 112000 time to create 1 rle with old method : 0.12363958358764648 length of segment : 651 time for calcul the mask position with numpy : 0.010077238082885742 nb_pixel_total : 397609 time to create 1 rle with new method : 0.025593042373657227 length of segment : 1084 time for calcul the mask position with numpy : 0.0020225048065185547 nb_pixel_total : 83912 time to create 1 rle with old method : 0.09534263610839844 length of segment : 485 time for calcul the mask position with numpy : 0.0074274539947509766 nb_pixel_total : 354210 time to create 1 rle with new method : 0.015508413314819336 length of segment : 845 time for calcul the mask position with numpy : 0.005574703216552734 nb_pixel_total : 339994 time to create 1 rle with new method : 0.014966011047363281 length of segment : 825 time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 88182 time to create 1 rle with old method : 0.10061168670654297 length of segment : 389 time for calcul the mask position with numpy : 0.0034215450286865234 nb_pixel_total : 133133 time to create 1 rle with old method : 0.1463332176208496 length of segment : 563 time for calcul the mask position with numpy : 0.0017578601837158203 nb_pixel_total : 15618 time to create 1 rle with old method : 0.017198801040649414 length of segment : 170 time for calcul the mask position with numpy : 0.0013058185577392578 nb_pixel_total : 47777 time to create 1 rle with old method : 0.05349922180175781 length of segment : 296 time for calcul the mask position with numpy : 0.005857706069946289 nb_pixel_total : 294667 time to create 1 rle with new method : 0.015236377716064453 length of segment : 622 time for calcul the mask position with numpy : 0.0015861988067626953 nb_pixel_total : 88809 time to create 1 rle with old method : 0.09810924530029297 length of segment : 443 time for calcul the mask position with numpy : 0.00344085693359375 nb_pixel_total : 165275 time to create 1 rle with new method : 0.009814739227294922 length of segment : 507 time for calcul the mask position with numpy : 0.0031189918518066406 nb_pixel_total : 152860 time to create 1 rle with new method : 0.009223222732543945 length of segment : 701 time for calcul the mask position with numpy : 0.0019321441650390625 nb_pixel_total : 77653 time to create 1 rle with old method : 0.08750128746032715 length of segment : 288 time for calcul the mask position with numpy : 0.003133535385131836 nb_pixel_total : 132976 time to create 1 rle with old method : 0.14835762977600098 length of segment : 497 time for calcul the mask position with numpy : 0.0011255741119384766 nb_pixel_total : 56446 time to create 1 rle with old method : 0.0630033016204834 length of segment : 246 time for calcul the mask position with numpy : 0.0011622905731201172 nb_pixel_total : 62663 time to create 1 rle with old method : 0.07019186019897461 length of segment : 261 time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 53266 time to create 1 rle with old method : 0.05805611610412598 length of segment : 277 time for calcul the mask position with numpy : 0.005168437957763672 nb_pixel_total : 314441 time to create 1 rle with new method : 0.013516664505004883 length of segment : 519 time for calcul the mask position with numpy : 0.0024857521057128906 nb_pixel_total : 111848 time to create 1 rle with old method : 0.12128305435180664 length of segment : 554 time for calcul the mask position with numpy : 0.001676321029663086 nb_pixel_total : 76647 time to create 1 rle with old method : 0.10949301719665527 length of segment : 329 time for calcul the mask position with numpy : 0.0034322738647460938 nb_pixel_total : 146180 time to create 1 rle with old method : 0.1703052520751953 length of segment : 566 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 31017 time to create 1 rle with old method : 0.038065433502197266 length of segment : 192 time for calcul the mask position with numpy : 0.0037903785705566406 nb_pixel_total : 222721 time to create 1 rle with new method : 0.009502649307250977 length of segment : 569 time for calcul the mask position with numpy : 0.001211404800415039 nb_pixel_total : 64342 time to create 1 rle with old method : 0.07059025764465332 length of segment : 279 time for calcul the mask position with numpy : 0.0068149566650390625 nb_pixel_total : 344651 time to create 1 rle with new method : 0.01695728302001953 length of segment : 811 time for calcul the mask position with numpy : 0.003913164138793945 nb_pixel_total : 239302 time to create 1 rle with new method : 0.008977890014648438 length of segment : 639 time for calcul the mask position with numpy : 0.0014140605926513672 nb_pixel_total : 62432 time to create 1 rle with old method : 0.07449102401733398 length of segment : 327 time for calcul the mask position with numpy : 0.0015082359313964844 nb_pixel_total : 84365 time to create 1 rle with old method : 0.09421420097351074 length of segment : 253 time for calcul the mask position with numpy : 0.0007879734039306641 nb_pixel_total : 39375 time to create 1 rle with old method : 0.045961856842041016 length of segment : 229 time for calcul the mask position with numpy : 0.016037464141845703 nb_pixel_total : 393652 time to create 1 rle with new method : 0.33645153045654297 length of segment : 831 time for calcul the mask position with numpy : 0.0021262168884277344 nb_pixel_total : 116123 time to create 1 rle with old method : 0.14542317390441895 length of segment : 373 time for calcul the mask position with numpy : 0.006830930709838867 nb_pixel_total : 438606 time to create 1 rle with new method : 0.016198158264160156 length of segment : 904 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 30201 time to create 1 rle with old method : 0.033600807189941406 length of segment : 224 time for calcul the mask position with numpy : 0.011087656021118164 nb_pixel_total : 506495 time to create 1 rle with new method : 0.0633857250213623 length of segment : 723 time for calcul the mask position with numpy : 0.0003516674041748047 nb_pixel_total : 16927 time to create 1 rle with old method : 0.018188953399658203 length of segment : 119 time for calcul the mask position with numpy : 0.00838160514831543 nb_pixel_total : 502854 time to create 1 rle with new method : 0.019237279891967773 length of segment : 708 time for calcul the mask position with numpy : 0.0043985843658447266 nb_pixel_total : 186511 time to create 1 rle with new method : 0.013279199600219727 length of segment : 1002 time for calcul the mask position with numpy : 0.04123973846435547 nb_pixel_total : 1249655 time to create 1 rle with new method : 0.6870558261871338 length of segment : 2457 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 369515 time to create 1 rle with new method : 0.015868186950683594 length of segment : 1018 time for calcul the mask position with numpy : 0.0018758773803710938 nb_pixel_total : 79810 time to create 1 rle with old method : 0.0905768871307373 length of segment : 394 time for calcul the mask position with numpy : 0.0009126663208007812 nb_pixel_total : 46643 time to create 1 rle with old method : 0.05179405212402344 length of segment : 346 time for calcul the mask position with numpy : 0.0007143020629882812 nb_pixel_total : 39890 time to create 1 rle with old method : 0.04402875900268555 length of segment : 357 time for calcul the mask position with numpy : 0.0037889480590820312 nb_pixel_total : 221929 time to create 1 rle with new method : 0.009457826614379883 length of segment : 723 time for calcul the mask position with numpy : 0.0016002655029296875 nb_pixel_total : 74255 time to create 1 rle with old method : 0.07947635650634766 length of segment : 493 time for calcul the mask position with numpy : 0.016819238662719727 nb_pixel_total : 1019722 time to create 1 rle with new method : 0.25014209747314453 length of segment : 1310 time for calcul the mask position with numpy : 0.00419926643371582 nb_pixel_total : 199332 time to create 1 rle with new method : 0.011307239532470703 length of segment : 585 time for calcul the mask position with numpy : 0.000843048095703125 nb_pixel_total : 26315 time to create 1 rle with old method : 0.028461694717407227 length of segment : 285 time for calcul the mask position with numpy : 0.007789134979248047 nb_pixel_total : 426595 time to create 1 rle with new method : 0.03557562828063965 length of segment : 599 time for calcul the mask position with numpy : 0.0017852783203125 nb_pixel_total : 80201 time to create 1 rle with old method : 0.08950567245483398 length of segment : 327 time for calcul the mask position with numpy : 0.0005970001220703125 nb_pixel_total : 17360 time to create 1 rle with old method : 0.020131349563598633 length of segment : 167 time for calcul the mask position with numpy : 0.003998994827270508 nb_pixel_total : 218390 time to create 1 rle with new method : 0.010993003845214844 length of segment : 699 time for calcul the mask position with numpy : 0.0029380321502685547 nb_pixel_total : 131012 time to create 1 rle with old method : 0.14647459983825684 length of segment : 407 time for calcul the mask position with numpy : 0.0031371116638183594 nb_pixel_total : 174685 time to create 1 rle with new method : 0.008985042572021484 length of segment : 378 time for calcul the mask position with numpy : 0.0011522769927978516 nb_pixel_total : 68631 time to create 1 rle with old method : 0.07615971565246582 length of segment : 281 time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 44800 time to create 1 rle with old method : 0.04957866668701172 length of segment : 307 time for calcul the mask position with numpy : 0.0018887519836425781 nb_pixel_total : 105242 time to create 1 rle with old method : 0.11066937446594238 length of segment : 744 time for calcul the mask position with numpy : 0.0017948150634765625 nb_pixel_total : 95219 time to create 1 rle with old method : 0.10209202766418457 length of segment : 583 time for calcul the mask position with numpy : 0.0018658638000488281 nb_pixel_total : 79040 time to create 1 rle with old method : 0.1044168472290039 length of segment : 362 time for calcul the mask position with numpy : 0.0031387805938720703 nb_pixel_total : 151435 time to create 1 rle with new method : 0.009182453155517578 length of segment : 350 time for calcul the mask position with numpy : 0.001811981201171875 nb_pixel_total : 81928 time to create 1 rle with old method : 0.08990001678466797 length of segment : 353 time for calcul the mask position with numpy : 0.0033218860626220703 nb_pixel_total : 172679 time to create 1 rle with new method : 0.010040044784545898 length of segment : 514 time for calcul the mask position with numpy : 0.01546025276184082 nb_pixel_total : 985520 time to create 1 rle with new method : 0.21854138374328613 length of segment : 1196 time for calcul the mask position with numpy : 0.0027370452880859375 nb_pixel_total : 181914 time to create 1 rle with new method : 0.006980419158935547 length of segment : 341 time for calcul the mask position with numpy : 0.0023789405822753906 nb_pixel_total : 128213 time to create 1 rle with old method : 0.13826918601989746 length of segment : 405 time for calcul the mask position with numpy : 0.0027213096618652344 nb_pixel_total : 94545 time to create 1 rle with old method : 0.1039736270904541 length of segment : 1398 time for calcul the mask position with numpy : 0.0015146732330322266 nb_pixel_total : 78019 time to create 1 rle with old method : 0.08356928825378418 length of segment : 365 time for calcul the mask position with numpy : 0.0008533000946044922 nb_pixel_total : 36473 time to create 1 rle with old method : 0.040354013442993164 length of segment : 176 time for calcul the mask position with numpy : 0.0022826194763183594 nb_pixel_total : 87913 time to create 1 rle with old method : 0.09299826622009277 length of segment : 568 time for calcul the mask position with numpy : 0.6848547458648682 nb_pixel_total : 9210677 time to create 1 rle with new method : 1.3029415607452393 length of segment : 5333 time for calcul the mask position with numpy : 0.16125965118408203 nb_pixel_total : 2485801 time to create 1 rle with new method : 0.26663899421691895 length of segment : 2475 time for calcul the mask position with numpy : 0.02400946617126465 nb_pixel_total : 2248518 time to create 1 rle with new method : 0.13981890678405762 length of segment : 1325 time spent for convertir_results : 60.11130166053772 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 406 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 157.08045196533203 time spend to save output : 0.20451045036315918 total time spend for step 2 : 157.2849624156952 step3:blur_detection Tue May 13 03:05:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 2156.589021853531 (4160, 3120) 1485.945513666575 (4160, 3120) 1468.1180151174349 (4160, 3120) 1957.636341118384 (4160, 3120) 2419.718827301347 (4160, 3120) 229.45080935190535 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.01177072525024414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.01288747787475586 save missing photos in datou_result : time spend for datou_step_exec : 1.0898034572601318 time spend to save output : 0.029198169708251953 total time spend for step 3 : 1.1190016269683838 step4:brightness Tue May 13 03:05:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747098089_729003_1357513059_3823460c8618898f1a5a910dbde5a4d8.jpg treat image : temp/1747098089_729003_1357513048_a66d26e2dfd5b9414abcdf59cbb281a2.jpg treat image : temp/1747098089_729003_1357512878_594a4ba92166cf72f957cc87e900bdbc.jpg treat image : temp/1747098089_729003_1357512874_36b12aef6d86c8266e944e1c858977c2.jpg treat image : temp/1747098089_729003_1357512854_00ae557d80138ed57e1117ba1390597f.jpg treat image : temp/1747098089_729003_1357512832_73b58f498cc55875edf23222922b9122.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.012942790985107422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.012689590454101562 save missing photos in datou_result : time spend for datou_step_exec : 8.580811262130737 time spend to save output : 0.030977725982666016 total time spend for step 4 : 8.611788988113403 step5:rle_unique_nms_with_priority Tue May 13 03:05:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 406 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 75 nb_hashtags : 10 time to prepare the origin masks : 70.23907828330994 time for calcul the mask position with numpy : 0.9447603225708008 nb_pixel_total : 4140507 time to create 1 rle with new method : 1.8195874691009521 time for calcul the mask position with numpy : 0.06026029586791992 nb_pixel_total : 45918 time to create 1 rle with old method : 0.05259847640991211 time for calcul the mask position with numpy : 0.11213469505310059 nb_pixel_total : 284081 time to create 1 rle with new method : 2.46374773979187 time for calcul the mask position with numpy : 0.05444169044494629 nb_pixel_total : 130436 time to create 1 rle with old method : 0.14496946334838867 time for calcul the mask position with numpy : 0.05228233337402344 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007753372192382812 time for calcul the mask position with numpy : 0.05097699165344238 nb_pixel_total : 6397 time to create 1 rle with old method : 0.006875276565551758 time for calcul the mask position with numpy : 0.050782203674316406 nb_pixel_total : 38015 time to create 1 rle with old method : 0.04216313362121582 time for calcul the mask position with numpy : 0.06602859497070312 nb_pixel_total : 789048 time to create 1 rle with new method : 1.9539644718170166 time for calcul the mask position with numpy : 0.05245852470397949 nb_pixel_total : 158345 time to create 1 rle with new method : 1.7182531356811523 time for calcul the mask position with numpy : 0.055632829666137695 nb_pixel_total : 69139 time to create 1 rle with old method : 0.07469010353088379 time for calcul the mask position with numpy : 0.05436253547668457 nb_pixel_total : 297157 time to create 1 rle with new method : 2.110415458679199 time for calcul the mask position with numpy : 0.05350351333618164 nb_pixel_total : 72673 time to create 1 rle with old method : 0.08055996894836426 time for calcul the mask position with numpy : 0.053736209869384766 nb_pixel_total : 131641 time to create 1 rle with old method : 0.14556050300598145 time for calcul the mask position with numpy : 0.052706003189086914 nb_pixel_total : 3652 time to create 1 rle with old method : 0.004243612289428711 time for calcul the mask position with numpy : 0.052741050720214844 nb_pixel_total : 18033 time to create 1 rle with old method : 0.020201444625854492 time for calcul the mask position with numpy : 0.05385589599609375 nb_pixel_total : 204705 time to create 1 rle with new method : 0.9804320335388184 time for calcul the mask position with numpy : 0.0541534423828125 nb_pixel_total : 17109 time to create 1 rle with old method : 0.027860641479492188 time for calcul the mask position with numpy : 0.0589749813079834 nb_pixel_total : 30308 time to create 1 rle with old method : 0.034089088439941406 time for calcul the mask position with numpy : 0.0551300048828125 nb_pixel_total : 451824 time to create 1 rle with new method : 1.773667812347412 time for calcul the mask position with numpy : 0.05265092849731445 nb_pixel_total : 45632 time to create 1 rle with old method : 0.051366567611694336 time for calcul the mask position with numpy : 0.05335044860839844 nb_pixel_total : 54500 time to create 1 rle with old method : 0.0608515739440918 time for calcul the mask position with numpy : 0.05536818504333496 nb_pixel_total : 17496 time to create 1 rle with old method : 0.020006179809570312 time for calcul the mask position with numpy : 0.05336928367614746 nb_pixel_total : 90 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.0568387508392334 nb_pixel_total : 419956 time to create 1 rle with new method : 2.4088857173919678 time for calcul the mask position with numpy : 0.05530047416687012 nb_pixel_total : 5290 time to create 1 rle with old method : 0.006216526031494141 time for calcul the mask position with numpy : 0.05247616767883301 nb_pixel_total : 5187 time to create 1 rle with old method : 0.006274223327636719 time for calcul the mask position with numpy : 0.053333282470703125 nb_pixel_total : 16468 time to create 1 rle with old method : 0.018757343292236328 time for calcul the mask position with numpy : 0.05375862121582031 nb_pixel_total : 114892 time to create 1 rle with old method : 0.13013219833374023 time for calcul the mask position with numpy : 0.05222821235656738 nb_pixel_total : 4303 time to create 1 rle with old method : 0.005071878433227539 time for calcul the mask position with numpy : 0.05347394943237305 nb_pixel_total : 23894 time to create 1 rle with old method : 0.02629685401916504 time for calcul the mask position with numpy : 0.05189108848571777 nb_pixel_total : 22897 time to create 1 rle with old method : 0.02507781982421875 time for calcul the mask position with numpy : 0.052391767501831055 nb_pixel_total : 5272 time to create 1 rle with old method : 0.006079912185668945 time for calcul the mask position with numpy : 0.05706286430358887 nb_pixel_total : 24959 time to create 1 rle with old method : 0.02704620361328125 time for calcul the mask position with numpy : 0.051184892654418945 nb_pixel_total : 34261 time to create 1 rle with old method : 0.038228750228881836 time for calcul the mask position with numpy : 0.053203582763671875 nb_pixel_total : 201463 time to create 1 rle with new method : 1.436166524887085 time for calcul the mask position with numpy : 0.05485653877258301 nb_pixel_total : 69543 time to create 1 rle with old method : 0.07923698425292969 time for calcul the mask position with numpy : 0.054018259048461914 nb_pixel_total : 32935 time to create 1 rle with old method : 0.038146257400512695 time for calcul the mask position with numpy : 0.0768582820892334 nb_pixel_total : 34984 time to create 1 rle with old method : 0.03925657272338867 time for calcul the mask position with numpy : 0.06210446357727051 nb_pixel_total : 250537 time to create 1 rle with new method : 1.705747365951538 time for calcul the mask position with numpy : 0.05371451377868652 nb_pixel_total : 62874 time to create 1 rle with old method : 0.07063937187194824 time for calcul the mask position with numpy : 0.05370903015136719 nb_pixel_total : 34426 time to create 1 rle with old method : 0.03849911689758301 time for calcul the mask position with numpy : 0.05647873878479004 nb_pixel_total : 682916 time to create 1 rle with new method : 1.3975791931152344 time for calcul the mask position with numpy : 0.05515861511230469 nb_pixel_total : 13359 time to create 1 rle with old method : 0.015301704406738281 time for calcul the mask position with numpy : 0.05404806137084961 nb_pixel_total : 107324 time to create 1 rle with old method : 0.11805844306945801 time for calcul the mask position with numpy : 0.05417060852050781 nb_pixel_total : 274550 time to create 1 rle with new method : 1.295048475265503 time for calcul the mask position with numpy : 0.06167173385620117 nb_pixel_total : 28748 time to create 1 rle with old method : 0.03774738311767578 time for calcul the mask position with numpy : 0.052556753158569336 nb_pixel_total : 8843 time to create 1 rle with old method : 0.010258674621582031 time for calcul the mask position with numpy : 0.05348920822143555 nb_pixel_total : 89658 time to create 1 rle with old method : 0.10049247741699219 time for calcul the mask position with numpy : 0.05348849296569824 nb_pixel_total : 40272 time to create 1 rle with old method : 0.04416990280151367 time for calcul the mask position with numpy : 0.05460095405578613 nb_pixel_total : 32503 time to create 1 rle with old method : 0.03600430488586426 time for calcul the mask position with numpy : 0.0522770881652832 nb_pixel_total : 36026 time to create 1 rle with old method : 0.050379037857055664 time for calcul the mask position with numpy : 0.060300350189208984 nb_pixel_total : 58009 time to create 1 rle with old method : 0.0654292106628418 time for calcul the mask position with numpy : 0.05199003219604492 nb_pixel_total : 869 time to create 1 rle with old method : 0.0014219284057617188 time for calcul the mask position with numpy : 0.05428028106689453 nb_pixel_total : 50751 time to create 1 rle with old method : 0.056337833404541016 time for calcul the mask position with numpy : 0.053418636322021484 nb_pixel_total : 13805 time to create 1 rle with old method : 0.01605224609375 time for calcul the mask position with numpy : 0.052741289138793945 nb_pixel_total : 22404 time to create 1 rle with old method : 0.0254364013671875 time for calcul the mask position with numpy : 0.056035518646240234 nb_pixel_total : 652723 time to create 1 rle with new method : 1.5238969326019287 time for calcul the mask position with numpy : 0.055541038513183594 nb_pixel_total : 489040 time to create 1 rle with new method : 1.9941041469573975 time for calcul the mask position with numpy : 0.05864906311035156 nb_pixel_total : 68707 time to create 1 rle with old method : 0.07478594779968262 time for calcul the mask position with numpy : 0.05141615867614746 nb_pixel_total : 4112 time to create 1 rle with old method : 0.005140066146850586 time for calcul the mask position with numpy : 0.05208325386047363 nb_pixel_total : 238586 time to create 1 rle with new method : 1.0792937278747559 time for calcul the mask position with numpy : 0.05438661575317383 nb_pixel_total : 142633 time to create 1 rle with old method : 0.15845775604248047 time for calcul the mask position with numpy : 0.054338693618774414 nb_pixel_total : 135072 time to create 1 rle with old method : 0.14931035041809082 time for calcul the mask position with numpy : 0.0527951717376709 nb_pixel_total : 245461 time to create 1 rle with new method : 1.5620696544647217 time for calcul the mask position with numpy : 0.05207014083862305 nb_pixel_total : 9117 time to create 1 rle with old method : 0.00986480712890625 time for calcul the mask position with numpy : 0.05311298370361328 nb_pixel_total : 271840 time to create 1 rle with new method : 1.310256004333496 time for calcul the mask position with numpy : 0.050515174865722656 nb_pixel_total : 25788 time to create 1 rle with old method : 0.027949094772338867 time for calcul the mask position with numpy : 0.05170440673828125 nb_pixel_total : 53346 time to create 1 rle with old method : 0.0577540397644043 time for calcul the mask position with numpy : 0.05190157890319824 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0013535022735595703 time for calcul the mask position with numpy : 0.057115793228149414 nb_pixel_total : 390176 time to create 1 rle with new method : 1.090242624282837 time for calcul the mask position with numpy : 0.05309414863586426 nb_pixel_total : 157527 time to create 1 rle with new method : 1.1209771633148193 time for calcul the mask position with numpy : 0.051939964294433594 nb_pixel_total : 24045 time to create 1 rle with old method : 0.026294946670532227 time for calcul the mask position with numpy : 0.05076146125793457 nb_pixel_total : 110141 time to create 1 rle with old method : 0.11665725708007812 time for calcul the mask position with numpy : 0.05251193046569824 nb_pixel_total : 81686 time to create 1 rle with old method : 0.08917760848999023 time for calcul the mask position with numpy : 0.051715850830078125 nb_pixel_total : 43623 time to create 1 rle with old method : 0.04824948310852051 time for calcul the mask position with numpy : 0.050573110580444336 nb_pixel_total : 2843 time to create 1 rle with old method : 0.003852367401123047 create new chi : 39.42540407180786 time to delete rle : 0.03545737266540527 batch 1 Loaded 76 chid ids of type : 4855 Number RLEs to save : 58924 TO DO : save crop sub photo not yet done ! save time : 3.288220167160034 nb_obj : 85 nb_hashtags : 9 time to prepare the origin masks : 53.5410361289978 time for calcul the mask position with numpy : 0.620854377746582 nb_pixel_total : 5025330 time to create 1 rle with new method : 1.34747314453125 time for calcul the mask position with numpy : 0.050666093826293945 nb_pixel_total : 10850 time to create 1 rle with old method : 0.011807441711425781 time for calcul the mask position with numpy : 0.055748701095581055 nb_pixel_total : 482668 time to create 1 rle with new method : 1.1024506092071533 time for calcul the mask position with numpy : 0.05650520324707031 nb_pixel_total : 201412 time to create 1 rle with new method : 1.1743946075439453 time for calcul the mask position with numpy : 0.053581953048706055 nb_pixel_total : 43237 time to create 1 rle with old method : 0.04865384101867676 time for calcul the mask position with numpy : 0.05548453330993652 nb_pixel_total : 40704 time to create 1 rle with old method : 0.04595947265625 time for calcul the mask position with numpy : 0.057862281799316406 nb_pixel_total : 252 time to create 1 rle with old method : 0.00067901611328125 time for calcul the mask position with numpy : 0.05447244644165039 nb_pixel_total : 228688 time to create 1 rle with new method : 1.172468662261963 time for calcul the mask position with numpy : 0.054147958755493164 nb_pixel_total : 340490 time to create 1 rle with new method : 1.1462733745574951 time for calcul the mask position with numpy : 0.05298018455505371 nb_pixel_total : 75964 time to create 1 rle with old method : 0.08099889755249023 time for calcul the mask position with numpy : 0.053496599197387695 nb_pixel_total : 1776 time to create 1 rle with old method : 0.002214670181274414 time for calcul the mask position with numpy : 0.09273695945739746 nb_pixel_total : 32294 time to create 1 rle with old method : 0.11204361915588379 time for calcul the mask position with numpy : 0.06032919883728027 nb_pixel_total : 124695 time to create 1 rle with old method : 0.16495227813720703 time for calcul the mask position with numpy : 0.054320335388183594 nb_pixel_total : 54114 time to create 1 rle with old method : 0.06065773963928223 time for calcul the mask position with numpy : 0.056798696517944336 nb_pixel_total : 33957 time to create 1 rle with old method : 0.03836464881896973 time for calcul the mask position with numpy : 0.05498647689819336 nb_pixel_total : 104768 time to create 1 rle with old method : 0.1167607307434082 time for calcul the mask position with numpy : 0.05413055419921875 nb_pixel_total : 43205 time to create 1 rle with old method : 0.05241727828979492 time for calcul the mask position with numpy : 0.05609416961669922 nb_pixel_total : 40574 time to create 1 rle with old method : 0.06206655502319336 time for calcul the mask position with numpy : 0.05481600761413574 nb_pixel_total : 19084 time to create 1 rle with old method : 0.021617889404296875 time for calcul the mask position with numpy : 0.05954766273498535 nb_pixel_total : 38253 time to create 1 rle with old method : 0.04384446144104004 time for calcul the mask position with numpy : 0.05408596992492676 nb_pixel_total : 80408 time to create 1 rle with old method : 0.0902705192565918 time for calcul the mask position with numpy : 0.05326724052429199 nb_pixel_total : 188778 time to create 1 rle with new method : 1.5964839458465576 time for calcul the mask position with numpy : 0.052069664001464844 nb_pixel_total : 903 time to create 1 rle with old method : 0.0015795230865478516 time for calcul the mask position with numpy : 0.0543971061706543 nb_pixel_total : 120070 time to create 1 rle with old method : 0.13248181343078613 time for calcul the mask position with numpy : 0.052532196044921875 nb_pixel_total : 170292 time to create 1 rle with new method : 1.3224453926086426 time for calcul the mask position with numpy : 0.052178382873535156 nb_pixel_total : 19313 time to create 1 rle with old method : 0.021105051040649414 time for calcul the mask position with numpy : 0.051174163818359375 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006799697875976562 time for calcul the mask position with numpy : 0.05079960823059082 nb_pixel_total : 40791 time to create 1 rle with old method : 0.043953657150268555 time for calcul the mask position with numpy : 0.05118703842163086 nb_pixel_total : 16072 time to create 1 rle with old method : 0.017130374908447266 time for calcul the mask position with numpy : 0.05062747001647949 nb_pixel_total : 1026 time to create 1 rle with old method : 0.0012736320495605469 time for calcul the mask position with numpy : 0.050353050231933594 nb_pixel_total : 31634 time to create 1 rle with old method : 0.03428339958190918 time for calcul the mask position with numpy : 0.049810171127319336 nb_pixel_total : 36532 time to create 1 rle with old method : 0.03885507583618164 time for calcul the mask position with numpy : 0.05081486701965332 nb_pixel_total : 33626 time to create 1 rle with old method : 0.0354461669921875 time for calcul the mask position with numpy : 0.05080056190490723 nb_pixel_total : 37116 time to create 1 rle with old method : 0.04153871536254883 time for calcul the mask position with numpy : 0.050304412841796875 nb_pixel_total : 62315 time to create 1 rle with old method : 0.06510400772094727 time for calcul the mask position with numpy : 0.05133938789367676 nb_pixel_total : 3134 time to create 1 rle with old method : 0.003754854202270508 time for calcul the mask position with numpy : 0.051126956939697266 nb_pixel_total : 172295 time to create 1 rle with new method : 1.237353801727295 time for calcul the mask position with numpy : 0.05162477493286133 nb_pixel_total : 159543 time to create 1 rle with new method : 1.000298023223877 time for calcul the mask position with numpy : 0.05155205726623535 nb_pixel_total : 7033 time to create 1 rle with old method : 0.008230924606323242 time for calcul the mask position with numpy : 0.05296754837036133 nb_pixel_total : 38624 time to create 1 rle with old method : 0.043723106384277344 time for calcul the mask position with numpy : 0.06033897399902344 nb_pixel_total : 501516 time to create 1 rle with new method : 1.2801530361175537 time for calcul the mask position with numpy : 0.05190873146057129 nb_pixel_total : 34284 time to create 1 rle with old method : 0.03625130653381348 time for calcul the mask position with numpy : 0.051746368408203125 nb_pixel_total : 77503 time to create 1 rle with old method : 0.08281064033508301 time for calcul the mask position with numpy : 0.05080747604370117 nb_pixel_total : 830 time to create 1 rle with old method : 0.0011014938354492188 time for calcul the mask position with numpy : 0.04974699020385742 nb_pixel_total : 6367 time to create 1 rle with old method : 0.006814241409301758 time for calcul the mask position with numpy : 0.050923824310302734 nb_pixel_total : 40522 time to create 1 rle with old method : 0.04387331008911133 time for calcul the mask position with numpy : 0.051466941833496094 nb_pixel_total : 31 time to create 1 rle with old method : 8.7738037109375e-05 time for calcul the mask position with numpy : 0.052345991134643555 nb_pixel_total : 126786 time to create 1 rle with old method : 0.13751006126403809 time for calcul the mask position with numpy : 0.05840158462524414 nb_pixel_total : 863 time to create 1 rle with old method : 0.0010399818420410156 time for calcul the mask position with numpy : 0.058641672134399414 nb_pixel_total : 48090 time to create 1 rle with old method : 0.050444602966308594 time for calcul the mask position with numpy : 0.05971932411193848 nb_pixel_total : 219416 time to create 1 rle with new method : 1.019054651260376 time for calcul the mask position with numpy : 0.05192852020263672 nb_pixel_total : 23162 time to create 1 rle with old method : 0.02492499351501465 time for calcul the mask position with numpy : 0.05187845230102539 nb_pixel_total : 16657 time to create 1 rle with old method : 0.017849445343017578 time for calcul the mask position with numpy : 0.051403045654296875 nb_pixel_total : 68652 time to create 1 rle with old method : 0.07512831687927246 time for calcul the mask position with numpy : 0.05269050598144531 nb_pixel_total : 88796 time to create 1 rle with old method : 0.0960540771484375 time for calcul the mask position with numpy : 0.055634260177612305 nb_pixel_total : 551294 time to create 1 rle with new method : 1.2420670986175537 time for calcul the mask position with numpy : 0.05090022087097168 nb_pixel_total : 43998 time to create 1 rle with old method : 0.04543304443359375 time for calcul the mask position with numpy : 0.0509037971496582 nb_pixel_total : 25252 time to create 1 rle with old method : 0.027673721313476562 time for calcul the mask position with numpy : 0.05169796943664551 nb_pixel_total : 39301 time to create 1 rle with old method : 0.04212069511413574 time for calcul the mask position with numpy : 0.05218219757080078 nb_pixel_total : 39572 time to create 1 rle with old method : 0.041672706604003906 time for calcul the mask position with numpy : 0.05029916763305664 nb_pixel_total : 13730 time to create 1 rle with old method : 0.014871835708618164 time for calcul the mask position with numpy : 0.050612688064575195 nb_pixel_total : 3503 time to create 1 rle with old method : 0.0039997100830078125 time for calcul the mask position with numpy : 0.05054903030395508 nb_pixel_total : 163459 time to create 1 rle with new method : 1.026071310043335 time for calcul the mask position with numpy : 0.05091524124145508 nb_pixel_total : 30535 time to create 1 rle with old method : 0.03252387046813965 time for calcul the mask position with numpy : 0.052594900131225586 nb_pixel_total : 154761 time to create 1 rle with new method : 1.1486995220184326 time for calcul the mask position with numpy : 0.051367998123168945 nb_pixel_total : 147048 time to create 1 rle with old method : 0.15445661544799805 time for calcul the mask position with numpy : 0.05095076560974121 nb_pixel_total : 24679 time to create 1 rle with old method : 0.025908946990966797 time for calcul the mask position with numpy : 0.05048418045043945 nb_pixel_total : 31853 time to create 1 rle with old method : 0.03394961357116699 time for calcul the mask position with numpy : 0.0518641471862793 nb_pixel_total : 44369 time to create 1 rle with old method : 0.04761791229248047 time for calcul the mask position with numpy : 0.05718708038330078 nb_pixel_total : 817512 time to create 1 rle with new method : 0.9712643623352051 time for calcul the mask position with numpy : 0.057187795639038086 nb_pixel_total : 790773 time to create 1 rle with new method : 1.1197924613952637 time for calcul the mask position with numpy : 0.05197954177856445 nb_pixel_total : 114013 time to create 1 rle with old method : 0.12087464332580566 time for calcul the mask position with numpy : 0.051999807357788086 nb_pixel_total : 50191 time to create 1 rle with old method : 0.054090023040771484 time for calcul the mask position with numpy : 0.05218172073364258 nb_pixel_total : 33855 time to create 1 rle with old method : 0.03603506088256836 time for calcul the mask position with numpy : 0.051883697509765625 nb_pixel_total : 2321 time to create 1 rle with old method : 0.0026786327362060547 time for calcul the mask position with numpy : 0.05162644386291504 nb_pixel_total : 601 time to create 1 rle with old method : 0.001001596450805664 time for calcul the mask position with numpy : 0.05308079719543457 nb_pixel_total : 122878 time to create 1 rle with old method : 0.13420820236206055 time for calcul the mask position with numpy : 0.05337858200073242 nb_pixel_total : 165879 time to create 1 rle with new method : 1.0402746200561523 time for calcul the mask position with numpy : 0.05056262016296387 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002328157424926758 time for calcul the mask position with numpy : 0.05223965644836426 nb_pixel_total : 6322 time to create 1 rle with old method : 0.006970882415771484 time for calcul the mask position with numpy : 0.05072736740112305 nb_pixel_total : 610 time to create 1 rle with old method : 0.0010657310485839844 time for calcul the mask position with numpy : 0.05064821243286133 nb_pixel_total : 89883 time to create 1 rle with old method : 0.09467363357543945 time for calcul the mask position with numpy : 0.05076289176940918 nb_pixel_total : 35830 time to create 1 rle with old method : 0.03894853591918945 time for calcul the mask position with numpy : 0.051024436950683594 nb_pixel_total : 2480 time to create 1 rle with old method : 0.0030083656311035156 time for calcul the mask position with numpy : 0.051493167877197266 nb_pixel_total : 14753 time to create 1 rle with old method : 0.016140222549438477 time for calcul the mask position with numpy : 0.05123162269592285 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001704692840576172 create new chi : 28.812409162521362 time to delete rle : 0.004860401153564453 batch 1 Loaded 86 chid ids of type : 4855 Number RLEs to save : 58587 TO DO : save crop sub photo not yet done ! save time : 3.2848355770111084 nb_obj : 90 nb_hashtags : 9 time to prepare the origin masks : 67.37865543365479 time for calcul the mask position with numpy : 0.6265561580657959 nb_pixel_total : 4784879 time to create 1 rle with new method : 1.3684625625610352 time for calcul the mask position with numpy : 0.05365443229675293 nb_pixel_total : 190784 time to create 1 rle with new method : 1.8840770721435547 time for calcul the mask position with numpy : 0.054453134536743164 nb_pixel_total : 77884 time to create 1 rle with old method : 0.0849146842956543 time for calcul the mask position with numpy : 0.05355501174926758 nb_pixel_total : 78086 time to create 1 rle with old method : 0.08179593086242676 time for calcul the mask position with numpy : 0.05069470405578613 nb_pixel_total : 105452 time to create 1 rle with old method : 0.10918378829956055 time for calcul the mask position with numpy : 0.0778968334197998 nb_pixel_total : 756407 time to create 1 rle with new method : 1.7266929149627686 time for calcul the mask position with numpy : 0.05241703987121582 nb_pixel_total : 9797 time to create 1 rle with old method : 0.011110782623291016 time for calcul the mask position with numpy : 0.05306839942932129 nb_pixel_total : 6364 time to create 1 rle with old method : 0.007144927978515625 time for calcul the mask position with numpy : 0.054139137268066406 nb_pixel_total : 169621 time to create 1 rle with new method : 2.1006672382354736 time for calcul the mask position with numpy : 0.0567474365234375 nb_pixel_total : 355797 time to create 1 rle with new method : 1.0794517993927002 time for calcul the mask position with numpy : 0.05073714256286621 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.0515742301940918 nb_pixel_total : 9403 time to create 1 rle with old method : 0.010480403900146484 time for calcul the mask position with numpy : 0.05187201499938965 nb_pixel_total : 373269 time to create 1 rle with new method : 1.3902466297149658 time for calcul the mask position with numpy : 0.0525660514831543 nb_pixel_total : 49045 time to create 1 rle with old method : 0.05402016639709473 time for calcul the mask position with numpy : 0.05167722702026367 nb_pixel_total : 9677 time to create 1 rle with old method : 0.010673761367797852 time for calcul the mask position with numpy : 0.05136418342590332 nb_pixel_total : 30738 time to create 1 rle with old method : 0.033428192138671875 time for calcul the mask position with numpy : 0.05146169662475586 nb_pixel_total : 50483 time to create 1 rle with old method : 0.05475163459777832 time for calcul the mask position with numpy : 0.051592350006103516 nb_pixel_total : 19887 time to create 1 rle with old method : 0.021536588668823242 time for calcul the mask position with numpy : 0.05056142807006836 nb_pixel_total : 114427 time to create 1 rle with old method : 0.12322878837585449 time for calcul the mask position with numpy : 0.054200172424316406 nb_pixel_total : 115629 time to create 1 rle with old method : 0.12566256523132324 time for calcul the mask position with numpy : 0.05217409133911133 nb_pixel_total : 61020 time to create 1 rle with old method : 0.06771039962768555 time for calcul the mask position with numpy : 0.052132368087768555 nb_pixel_total : 4790 time to create 1 rle with old method : 0.00561213493347168 time for calcul the mask position with numpy : 0.05162644386291504 nb_pixel_total : 61175 time to create 1 rle with old method : 0.0661935806274414 time for calcul the mask position with numpy : 0.05162239074707031 nb_pixel_total : 30734 time to create 1 rle with old method : 0.03311324119567871 time for calcul the mask position with numpy : 0.05147409439086914 nb_pixel_total : 46740 time to create 1 rle with old method : 0.05162358283996582 time for calcul the mask position with numpy : 0.05357480049133301 nb_pixel_total : 145114 time to create 1 rle with old method : 0.16666960716247559 time for calcul the mask position with numpy : 0.053621768951416016 nb_pixel_total : 272820 time to create 1 rle with new method : 1.3917460441589355 time for calcul the mask position with numpy : 0.05141854286193848 nb_pixel_total : 78303 time to create 1 rle with old method : 0.08431482315063477 time for calcul the mask position with numpy : 0.052904605865478516 nb_pixel_total : 20678 time to create 1 rle with old method : 0.022714853286743164 time for calcul the mask position with numpy : 0.05312919616699219 nb_pixel_total : 57756 time to create 1 rle with old method : 0.0633704662322998 time for calcul the mask position with numpy : 0.052082061767578125 nb_pixel_total : 71364 time to create 1 rle with old method : 0.10133099555969238 time for calcul the mask position with numpy : 0.054825782775878906 nb_pixel_total : 49680 time to create 1 rle with old method : 0.05228257179260254 time for calcul the mask position with numpy : 0.05129384994506836 nb_pixel_total : 101756 time to create 1 rle with old method : 0.11054778099060059 time for calcul the mask position with numpy : 0.05318474769592285 nb_pixel_total : 22036 time to create 1 rle with old method : 0.024133682250976562 time for calcul the mask position with numpy : 0.056234121322631836 nb_pixel_total : 463680 time to create 1 rle with new method : 1.1730494499206543 time for calcul the mask position with numpy : 0.0497281551361084 nb_pixel_total : 9275 time to create 1 rle with old method : 0.010293960571289062 time for calcul the mask position with numpy : 0.051581621170043945 nb_pixel_total : 35427 time to create 1 rle with old method : 0.03932952880859375 time for calcul the mask position with numpy : 0.051897525787353516 nb_pixel_total : 90141 time to create 1 rle with old method : 0.10347175598144531 time for calcul the mask position with numpy : 0.05251312255859375 nb_pixel_total : 102243 time to create 1 rle with old method : 0.11100649833679199 time for calcul the mask position with numpy : 0.053456783294677734 nb_pixel_total : 237033 time to create 1 rle with new method : 1.2350189685821533 time for calcul the mask position with numpy : 0.051688432693481445 nb_pixel_total : 58191 time to create 1 rle with old method : 0.06640505790710449 time for calcul the mask position with numpy : 0.05279994010925293 nb_pixel_total : 43330 time to create 1 rle with old method : 0.04738330841064453 time for calcul the mask position with numpy : 0.05207419395446777 nb_pixel_total : 277264 time to create 1 rle with new method : 1.4255218505859375 time for calcul the mask position with numpy : 0.05218243598937988 nb_pixel_total : 37690 time to create 1 rle with old method : 0.04496026039123535 time for calcul the mask position with numpy : 0.06123948097229004 nb_pixel_total : 126983 time to create 1 rle with old method : 0.1376476287841797 time for calcul the mask position with numpy : 0.0525050163269043 nb_pixel_total : 48890 time to create 1 rle with old method : 0.05104875564575195 time for calcul the mask position with numpy : 0.05022144317626953 nb_pixel_total : 75995 time to create 1 rle with old method : 0.08036684989929199 time for calcul the mask position with numpy : 0.05044412612915039 nb_pixel_total : 31249 time to create 1 rle with old method : 0.03267836570739746 time for calcul the mask position with numpy : 0.05057787895202637 nb_pixel_total : 1884 time to create 1 rle with old method : 0.0021538734436035156 time for calcul the mask position with numpy : 0.05154991149902344 nb_pixel_total : 29431 time to create 1 rle with old method : 0.03252387046813965 time for calcul the mask position with numpy : 0.05380964279174805 nb_pixel_total : 33579 time to create 1 rle with old method : 0.036521196365356445 time for calcul the mask position with numpy : 0.05171036720275879 nb_pixel_total : 14642 time to create 1 rle with old method : 0.01581096649169922 time for calcul the mask position with numpy : 0.053316354751586914 nb_pixel_total : 185897 time to create 1 rle with new method : 1.087590217590332 time for calcul the mask position with numpy : 0.053331613540649414 nb_pixel_total : 188527 time to create 1 rle with new method : 1.469965934753418 time for calcul the mask position with numpy : 0.05536699295043945 nb_pixel_total : 353 time to create 1 rle with old method : 0.0008080005645751953 time for calcul the mask position with numpy : 0.051606178283691406 nb_pixel_total : 134284 time to create 1 rle with old method : 0.14702820777893066 time for calcul the mask position with numpy : 0.05196571350097656 nb_pixel_total : 907 time to create 1 rle with old method : 0.0014069080352783203 time for calcul the mask position with numpy : 0.05312490463256836 nb_pixel_total : 4322 time to create 1 rle with old method : 0.005311012268066406 time for calcul the mask position with numpy : 0.054587364196777344 nb_pixel_total : 203165 time to create 1 rle with new method : 1.3885729312896729 time for calcul the mask position with numpy : 0.057600975036621094 nb_pixel_total : 432562 time to create 1 rle with new method : 1.393082857131958 time for calcul the mask position with numpy : 0.05111360549926758 nb_pixel_total : 1996 time to create 1 rle with old method : 0.0025811195373535156 time for calcul the mask position with numpy : 0.05125880241394043 nb_pixel_total : 615 time to create 1 rle with old method : 0.000946044921875 time for calcul the mask position with numpy : 0.053197622299194336 nb_pixel_total : 131197 time to create 1 rle with old method : 0.39797282218933105 time for calcul the mask position with numpy : 0.08965849876403809 nb_pixel_total : 4284 time to create 1 rle with old method : 0.007999420166015625 time for calcul the mask position with numpy : 0.12579798698425293 nb_pixel_total : 273054 time to create 1 rle with new method : 2.5817792415618896 time for calcul the mask position with numpy : 0.060700178146362305 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0015835762023925781 time for calcul the mask position with numpy : 0.05312991142272949 nb_pixel_total : 78626 time to create 1 rle with old method : 0.08929610252380371 time for calcul the mask position with numpy : 0.05788540840148926 nb_pixel_total : 35740 time to create 1 rle with old method : 0.04172539710998535 time for calcul the mask position with numpy : 0.05258059501647949 nb_pixel_total : 53890 time to create 1 rle with old method : 0.05988645553588867 time for calcul the mask position with numpy : 0.05485343933105469 nb_pixel_total : 87185 time to create 1 rle with old method : 0.0968027114868164 time for calcul the mask position with numpy : 0.05585670471191406 nb_pixel_total : 6251 time to create 1 rle with old method : 0.007528543472290039 time for calcul the mask position with numpy : 0.061107635498046875 nb_pixel_total : 18803 time to create 1 rle with old method : 0.02269458770751953 time for calcul the mask position with numpy : 0.053632497787475586 nb_pixel_total : 640 time to create 1 rle with old method : 0.0009207725524902344 time for calcul the mask position with numpy : 0.053904056549072266 nb_pixel_total : 35275 time to create 1 rle with old method : 0.03946089744567871 time for calcul the mask position with numpy : 0.05773735046386719 nb_pixel_total : 335448 time to create 1 rle with new method : 1.4913570880889893 time for calcul the mask position with numpy : 0.052895545959472656 nb_pixel_total : 68276 time to create 1 rle with old method : 0.07503819465637207 time for calcul the mask position with numpy : 0.05380868911743164 nb_pixel_total : 2070 time to create 1 rle with old method : 0.0025081634521484375 time for calcul the mask position with numpy : 0.05847811698913574 nb_pixel_total : 112406 time to create 1 rle with old method : 0.12028717994689941 time for calcul the mask position with numpy : 0.052095651626586914 nb_pixel_total : 112047 time to create 1 rle with old method : 0.12186241149902344 time for calcul the mask position with numpy : 0.05107760429382324 nb_pixel_total : 17617 time to create 1 rle with old method : 0.019231319427490234 time for calcul the mask position with numpy : 0.05104660987854004 nb_pixel_total : 37660 time to create 1 rle with old method : 0.04004263877868652 time for calcul the mask position with numpy : 0.05012226104736328 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0013897418975830078 time for calcul the mask position with numpy : 0.051558494567871094 nb_pixel_total : 30690 time to create 1 rle with old method : 0.03277730941772461 time for calcul the mask position with numpy : 0.05148458480834961 nb_pixel_total : 11641 time to create 1 rle with old method : 0.012543678283691406 time for calcul the mask position with numpy : 0.05245804786682129 nb_pixel_total : 111136 time to create 1 rle with old method : 0.15222573280334473 time for calcul the mask position with numpy : 0.05329585075378418 nb_pixel_total : 70340 time to create 1 rle with old method : 0.0744938850402832 time for calcul the mask position with numpy : 0.05024838447570801 nb_pixel_total : 6517 time to create 1 rle with old method : 0.007054567337036133 time for calcul the mask position with numpy : 0.05138707160949707 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0016598701477050781 time for calcul the mask position with numpy : 0.05174827575683594 nb_pixel_total : 77167 time to create 1 rle with old method : 0.08267474174499512 time for calcul the mask position with numpy : 0.051024436950683594 nb_pixel_total : 56050 time to create 1 rle with old method : 0.05819272994995117 time for calcul the mask position with numpy : 0.05092430114746094 nb_pixel_total : 231 time to create 1 rle with old method : 0.0004799365997314453 create new chi : 34.49868822097778 time to delete rle : 0.0076618194580078125 batch 1 Loaded 91 chid ids of type : 4855 Number RLEs to save : 65124 TO DO : save crop sub photo not yet done ! save time : 3.7628090381622314 nb_obj : 77 nb_hashtags : 8 time to prepare the origin masks : 55.34119248390198 time for calcul the mask position with numpy : 0.4398767948150635 nb_pixel_total : 4429653 time to create 1 rle with new method : 1.813173770904541 time for calcul the mask position with numpy : 0.056014060974121094 nb_pixel_total : 91283 time to create 1 rle with old method : 0.1172327995300293 time for calcul the mask position with numpy : 0.05178332328796387 nb_pixel_total : 33751 time to create 1 rle with old method : 0.03702735900878906 time for calcul the mask position with numpy : 0.05460476875305176 nb_pixel_total : 243740 time to create 1 rle with new method : 1.0768702030181885 time for calcul the mask position with numpy : 0.051275014877319336 nb_pixel_total : 46099 time to create 1 rle with old method : 0.05016303062438965 time for calcul the mask position with numpy : 0.05537676811218262 nb_pixel_total : 642400 time to create 1 rle with new method : 1.2253906726837158 time for calcul the mask position with numpy : 0.053836822509765625 nb_pixel_total : 154350 time to create 1 rle with new method : 1.62300443649292 time for calcul the mask position with numpy : 0.051184654235839844 nb_pixel_total : 176953 time to create 1 rle with new method : 1.4503116607666016 time for calcul the mask position with numpy : 0.05393171310424805 nb_pixel_total : 188684 time to create 1 rle with new method : 1.2968358993530273 time for calcul the mask position with numpy : 0.054245710372924805 nb_pixel_total : 7681 time to create 1 rle with old method : 0.009882688522338867 time for calcul the mask position with numpy : 0.05362105369567871 nb_pixel_total : 16352 time to create 1 rle with old method : 0.018365144729614258 time for calcul the mask position with numpy : 0.053510189056396484 nb_pixel_total : 43020 time to create 1 rle with old method : 0.04670834541320801 time for calcul the mask position with numpy : 0.05138373374938965 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0015802383422851562 time for calcul the mask position with numpy : 0.052358150482177734 nb_pixel_total : 26200 time to create 1 rle with old method : 0.029358863830566406 time for calcul the mask position with numpy : 0.057188987731933594 nb_pixel_total : 360440 time to create 1 rle with new method : 1.1937830448150635 time for calcul the mask position with numpy : 0.05446457862854004 nb_pixel_total : 220069 time to create 1 rle with new method : 1.1310124397277832 time for calcul the mask position with numpy : 0.052803993225097656 nb_pixel_total : 22949 time to create 1 rle with old method : 0.025236129760742188 time for calcul the mask position with numpy : 0.05312776565551758 nb_pixel_total : 21810 time to create 1 rle with old method : 0.024633407592773438 time for calcul the mask position with numpy : 0.05514335632324219 nb_pixel_total : 197492 time to create 1 rle with new method : 1.081467866897583 time for calcul the mask position with numpy : 0.05237150192260742 nb_pixel_total : 109011 time to create 1 rle with old method : 0.12175226211547852 time for calcul the mask position with numpy : 0.0623013973236084 nb_pixel_total : 145932 time to create 1 rle with old method : 0.16155219078063965 time for calcul the mask position with numpy : 0.05140089988708496 nb_pixel_total : 26592 time to create 1 rle with old method : 0.02902984619140625 time for calcul the mask position with numpy : 0.05234503746032715 nb_pixel_total : 10910 time to create 1 rle with old method : 0.012209653854370117 time for calcul the mask position with numpy : 0.053414344787597656 nb_pixel_total : 64582 time to create 1 rle with old method : 0.0721590518951416 time for calcul the mask position with numpy : 0.05391836166381836 nb_pixel_total : 58066 time to create 1 rle with old method : 0.0647430419921875 time for calcul the mask position with numpy : 0.05577683448791504 nb_pixel_total : 246540 time to create 1 rle with new method : 1.6217682361602783 time for calcul the mask position with numpy : 0.05264925956726074 nb_pixel_total : 74159 time to create 1 rle with old method : 0.08085298538208008 time for calcul the mask position with numpy : 0.05385184288024902 nb_pixel_total : 48931 time to create 1 rle with old method : 0.054909467697143555 time for calcul the mask position with numpy : 0.053392648696899414 nb_pixel_total : 558 time to create 1 rle with old method : 0.0008456707000732422 time for calcul the mask position with numpy : 0.05313849449157715 nb_pixel_total : 34428 time to create 1 rle with old method : 0.03769850730895996 time for calcul the mask position with numpy : 0.05384087562561035 nb_pixel_total : 208977 time to create 1 rle with new method : 1.4854493141174316 time for calcul the mask position with numpy : 0.054999589920043945 nb_pixel_total : 99822 time to create 1 rle with old method : 0.11024141311645508 time for calcul the mask position with numpy : 0.053199052810668945 nb_pixel_total : 132667 time to create 1 rle with old method : 0.14788436889648438 time for calcul the mask position with numpy : 0.05226945877075195 nb_pixel_total : 26291 time to create 1 rle with old method : 0.02898383140563965 time for calcul the mask position with numpy : 0.052820682525634766 nb_pixel_total : 88131 time to create 1 rle with old method : 0.09583020210266113 time for calcul the mask position with numpy : 0.05551958084106445 nb_pixel_total : 279869 time to create 1 rle with new method : 2.031926393508911 time for calcul the mask position with numpy : 0.05380129814147949 nb_pixel_total : 87700 time to create 1 rle with old method : 0.10491251945495605 time for calcul the mask position with numpy : 0.053672075271606445 nb_pixel_total : 51178 time to create 1 rle with old method : 0.055939435958862305 time for calcul the mask position with numpy : 0.05203104019165039 nb_pixel_total : 12094 time to create 1 rle with old method : 0.01363372802734375 time for calcul the mask position with numpy : 0.05318307876586914 nb_pixel_total : 92142 time to create 1 rle with old method : 0.10186147689819336 time for calcul the mask position with numpy : 0.05435323715209961 nb_pixel_total : 165622 time to create 1 rle with new method : 1.2232856750488281 time for calcul the mask position with numpy : 0.05244922637939453 nb_pixel_total : 4047 time to create 1 rle with old method : 0.0052337646484375 time for calcul the mask position with numpy : 0.05293011665344238 nb_pixel_total : 106395 time to create 1 rle with old method : 0.11513018608093262 time for calcul the mask position with numpy : 0.05395364761352539 nb_pixel_total : 21464 time to create 1 rle with old method : 0.034110307693481445 time for calcul the mask position with numpy : 0.06299591064453125 nb_pixel_total : 446591 time to create 1 rle with new method : 1.0542726516723633 time for calcul the mask position with numpy : 0.05219435691833496 nb_pixel_total : 41989 time to create 1 rle with old method : 0.04593038558959961 time for calcul the mask position with numpy : 0.05314898490905762 nb_pixel_total : 61948 time to create 1 rle with old method : 0.07057476043701172 time for calcul the mask position with numpy : 0.05416083335876465 nb_pixel_total : 56367 time to create 1 rle with old method : 0.06307291984558105 time for calcul the mask position with numpy : 0.0550084114074707 nb_pixel_total : 332386 time to create 1 rle with new method : 0.9586124420166016 time for calcul the mask position with numpy : 0.05450725555419922 nb_pixel_total : 83536 time to create 1 rle with old method : 0.0909419059753418 time for calcul the mask position with numpy : 0.05264854431152344 nb_pixel_total : 16308 time to create 1 rle with old method : 0.01755046844482422 time for calcul the mask position with numpy : 0.05401897430419922 nb_pixel_total : 403966 time to create 1 rle with new method : 1.0380275249481201 time for calcul the mask position with numpy : 0.057077884674072266 nb_pixel_total : 27858 time to create 1 rle with old method : 0.04445838928222656 time for calcul the mask position with numpy : 0.053563833236694336 nb_pixel_total : 54506 time to create 1 rle with old method : 0.058389902114868164 time for calcul the mask position with numpy : 0.05212545394897461 nb_pixel_total : 8953 time to create 1 rle with old method : 0.009909629821777344 time for calcul the mask position with numpy : 0.05293083190917969 nb_pixel_total : 102989 time to create 1 rle with old method : 0.1112518310546875 time for calcul the mask position with numpy : 0.05322599411010742 nb_pixel_total : 58489 time to create 1 rle with old method : 0.06436777114868164 time for calcul the mask position with numpy : 0.05537295341491699 nb_pixel_total : 240301 time to create 1 rle with new method : 1.3268640041351318 time for calcul the mask position with numpy : 0.05254077911376953 nb_pixel_total : 79835 time to create 1 rle with old method : 0.08604001998901367 time for calcul the mask position with numpy : 0.05236458778381348 nb_pixel_total : 39186 time to create 1 rle with old method : 0.04511404037475586 time for calcul the mask position with numpy : 0.053653717041015625 nb_pixel_total : 120381 time to create 1 rle with old method : 0.13437557220458984 time for calcul the mask position with numpy : 0.055529117584228516 nb_pixel_total : 333325 time to create 1 rle with new method : 0.8308172225952148 time for calcul the mask position with numpy : 0.05400347709655762 nb_pixel_total : 125144 time to create 1 rle with old method : 0.13509845733642578 time for calcul the mask position with numpy : 0.053878068923950195 nb_pixel_total : 339488 time to create 1 rle with new method : 0.9340922832489014 time for calcul the mask position with numpy : 0.05187249183654785 nb_pixel_total : 3338 time to create 1 rle with old method : 0.0040705204010009766 time for calcul the mask position with numpy : 0.05283498764038086 nb_pixel_total : 67242 time to create 1 rle with old method : 0.07303738594055176 time for calcul the mask position with numpy : 0.05501055717468262 nb_pixel_total : 277062 time to create 1 rle with new method : 0.8577103614807129 time for calcul the mask position with numpy : 0.05259561538696289 nb_pixel_total : 87306 time to create 1 rle with old method : 0.09700846672058105 time for calcul the mask position with numpy : 0.05376863479614258 nb_pixel_total : 47593 time to create 1 rle with old method : 0.055663108825683594 time for calcul the mask position with numpy : 0.055567264556884766 nb_pixel_total : 161583 time to create 1 rle with new method : 1.1231660842895508 time for calcul the mask position with numpy : 0.051657676696777344 nb_pixel_total : 26039 time to create 1 rle with old method : 0.02875041961669922 time for calcul the mask position with numpy : 0.052912235260009766 nb_pixel_total : 71818 time to create 1 rle with old method : 0.07724905014038086 time for calcul the mask position with numpy : 0.05276346206665039 nb_pixel_total : 60747 time to create 1 rle with old method : 0.0702059268951416 time for calcul the mask position with numpy : 0.05132865905761719 nb_pixel_total : 4573 time to create 1 rle with old method : 0.005021095275878906 time for calcul the mask position with numpy : 0.05240988731384277 nb_pixel_total : 17802 time to create 1 rle with old method : 0.019934654235839844 time for calcul the mask position with numpy : 0.05277609825134277 nb_pixel_total : 39828 time to create 1 rle with old method : 0.04372811317443848 time for calcul the mask position with numpy : 0.05178666114807129 nb_pixel_total : 8798 time to create 1 rle with old method : 0.009889841079711914 time for calcul the mask position with numpy : 0.0532841682434082 nb_pixel_total : 11565 time to create 1 rle with old method : 0.01262807846069336 create new chi : 35.1638343334198 time to delete rle : 0.00711369514465332 batch 1 Loaded 79 chid ids of type : 4855 Number RLEs to save : 68960 TO DO : save crop sub photo not yet done ! save time : 4.161077976226807 nb_obj : 67 nb_hashtags : 8 time to prepare the origin masks : 58.10970854759216 time for calcul the mask position with numpy : 0.3964388370513916 nb_pixel_total : 4147375 time to create 1 rle with new method : 1.191664457321167 time for calcul the mask position with numpy : 0.051149606704711914 nb_pixel_total : 3343 time to create 1 rle with old method : 0.004338741302490234 time for calcul the mask position with numpy : 0.17697882652282715 nb_pixel_total : 574237 time to create 1 rle with new method : 1.211272954940796 time for calcul the mask position with numpy : 0.05493426322937012 nb_pixel_total : 384294 time to create 1 rle with new method : 1.3823628425598145 time for calcul the mask position with numpy : 0.050679922103881836 nb_pixel_total : 53085 time to create 1 rle with old method : 0.05689430236816406 time for calcul the mask position with numpy : 0.05293393135070801 nb_pixel_total : 369044 time to create 1 rle with new method : 1.2952079772949219 time for calcul the mask position with numpy : 0.05335593223571777 nb_pixel_total : 313144 time to create 1 rle with new method : 1.2340118885040283 time for calcul the mask position with numpy : 0.04939985275268555 nb_pixel_total : 26147 time to create 1 rle with old method : 0.027478694915771484 time for calcul the mask position with numpy : 0.05117201805114746 nb_pixel_total : 79548 time to create 1 rle with old method : 0.08313393592834473 time for calcul the mask position with numpy : 0.05182242393493652 nb_pixel_total : 68468 time to create 1 rle with old method : 0.07276153564453125 time for calcul the mask position with numpy : 0.05127406120300293 nb_pixel_total : 47028 time to create 1 rle with old method : 0.050653696060180664 time for calcul the mask position with numpy : 0.05062413215637207 nb_pixel_total : 2928 time to create 1 rle with old method : 0.0035817623138427734 time for calcul the mask position with numpy : 0.05181527137756348 nb_pixel_total : 90170 time to create 1 rle with old method : 0.09499621391296387 time for calcul the mask position with numpy : 0.04985952377319336 nb_pixel_total : 28063 time to create 1 rle with old method : 0.029442787170410156 time for calcul the mask position with numpy : 0.05093026161193848 nb_pixel_total : 171476 time to create 1 rle with new method : 1.3239877223968506 time for calcul the mask position with numpy : 0.05223798751831055 nb_pixel_total : 53626 time to create 1 rle with old method : 0.058830976486206055 time for calcul the mask position with numpy : 0.05359816551208496 nb_pixel_total : 79163 time to create 1 rle with old method : 0.08613991737365723 time for calcul the mask position with numpy : 0.05211496353149414 nb_pixel_total : 698 time to create 1 rle with old method : 0.0010824203491210938 time for calcul the mask position with numpy : 0.0532221794128418 nb_pixel_total : 76510 time to create 1 rle with old method : 0.08382844924926758 time for calcul the mask position with numpy : 0.05296802520751953 nb_pixel_total : 84088 time to create 1 rle with old method : 0.0902719497680664 time for calcul the mask position with numpy : 0.05165839195251465 nb_pixel_total : 126877 time to create 1 rle with old method : 0.1625351905822754 time for calcul the mask position with numpy : 0.05131959915161133 nb_pixel_total : 392286 time to create 1 rle with new method : 0.8201980590820312 time for calcul the mask position with numpy : 0.05024600028991699 nb_pixel_total : 30738 time to create 1 rle with old method : 0.03258085250854492 time for calcul the mask position with numpy : 0.05481076240539551 nb_pixel_total : 448880 time to create 1 rle with new method : 1.2321438789367676 time for calcul the mask position with numpy : 0.05149531364440918 nb_pixel_total : 15688 time to create 1 rle with old method : 0.017298221588134766 time for calcul the mask position with numpy : 0.05230975151062012 nb_pixel_total : 62535 time to create 1 rle with old method : 0.06724119186401367 time for calcul the mask position with numpy : 0.07255744934082031 nb_pixel_total : 1112929 time to create 1 rle with new method : 1.3529095649719238 time for calcul the mask position with numpy : 0.059102773666381836 nb_pixel_total : 30085 time to create 1 rle with old method : 0.03347420692443848 time for calcul the mask position with numpy : 0.05182337760925293 nb_pixel_total : 222458 time to create 1 rle with new method : 1.1608710289001465 time for calcul the mask position with numpy : 0.052937984466552734 nb_pixel_total : 62393 time to create 1 rle with old method : 0.06938362121582031 time for calcul the mask position with numpy : 0.056426286697387695 nb_pixel_total : 988932 time to create 1 rle with new method : 1.2946128845214844 time for calcul the mask position with numpy : 0.053624629974365234 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006690025329589844 time for calcul the mask position with numpy : 0.053008317947387695 nb_pixel_total : 13173 time to create 1 rle with old method : 0.016315937042236328 time for calcul the mask position with numpy : 0.05399298667907715 nb_pixel_total : 3385 time to create 1 rle with old method : 0.005890846252441406 time for calcul the mask position with numpy : 0.061628103256225586 nb_pixel_total : 105336 time to create 1 rle with old method : 0.11746740341186523 time for calcul the mask position with numpy : 0.05351376533508301 nb_pixel_total : 30811 time to create 1 rle with old method : 0.03390336036682129 time for calcul the mask position with numpy : 0.05475759506225586 nb_pixel_total : 111622 time to create 1 rle with old method : 0.11961126327514648 time for calcul the mask position with numpy : 0.051201820373535156 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0019049644470214844 time for calcul the mask position with numpy : 0.052118539810180664 nb_pixel_total : 21873 time to create 1 rle with old method : 0.024065017700195312 time for calcul the mask position with numpy : 0.054468393325805664 nb_pixel_total : 110368 time to create 1 rle with old method : 0.13604450225830078 time for calcul the mask position with numpy : 0.04991507530212402 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010714530944824219 time for calcul the mask position with numpy : 0.05109214782714844 nb_pixel_total : 11841 time to create 1 rle with old method : 0.012802362442016602 time for calcul the mask position with numpy : 0.050096988677978516 nb_pixel_total : 80715 time to create 1 rle with old method : 0.0854029655456543 time for calcul the mask position with numpy : 0.05033230781555176 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008265972137451172 time for calcul the mask position with numpy : 0.05102729797363281 nb_pixel_total : 78855 time to create 1 rle with old method : 0.08213567733764648 time for calcul the mask position with numpy : 0.05363345146179199 nb_pixel_total : 66951 time to create 1 rle with old method : 0.07658123970031738 time for calcul the mask position with numpy : 0.05501604080200195 nb_pixel_total : 279978 time to create 1 rle with new method : 1.2596063613891602 time for calcul the mask position with numpy : 0.049349069595336914 nb_pixel_total : 22124 time to create 1 rle with old method : 0.023197650909423828 time for calcul the mask position with numpy : 0.05018162727355957 nb_pixel_total : 17251 time to create 1 rle with old method : 0.01799488067626953 time for calcul the mask position with numpy : 0.05177450180053711 nb_pixel_total : 124125 time to create 1 rle with old method : 0.1312398910522461 time for calcul the mask position with numpy : 0.05048084259033203 nb_pixel_total : 39860 time to create 1 rle with old method : 0.042586326599121094 time for calcul the mask position with numpy : 0.051619529724121094 nb_pixel_total : 239076 time to create 1 rle with new method : 1.4773924350738525 time for calcul the mask position with numpy : 0.05416679382324219 nb_pixel_total : 221408 time to create 1 rle with new method : 1.6202442646026611 time for calcul the mask position with numpy : 0.05353188514709473 nb_pixel_total : 2925 time to create 1 rle with old method : 0.00370025634765625 time for calcul the mask position with numpy : 0.05783724784851074 nb_pixel_total : 437124 time to create 1 rle with new method : 1.5986905097961426 time for calcul the mask position with numpy : 0.05222272872924805 nb_pixel_total : 148 time to create 1 rle with old method : 0.00040340423583984375 time for calcul the mask position with numpy : 0.051482439041137695 nb_pixel_total : 9743 time to create 1 rle with old method : 0.01116490364074707 time for calcul the mask position with numpy : 0.054416656494140625 nb_pixel_total : 115808 time to create 1 rle with old method : 0.1265549659729004 time for calcul the mask position with numpy : 0.0527801513671875 nb_pixel_total : 24988 time to create 1 rle with old method : 0.029193878173828125 time for calcul the mask position with numpy : 0.05440974235534668 nb_pixel_total : 143110 time to create 1 rle with old method : 0.15761733055114746 time for calcul the mask position with numpy : 0.05362105369567871 nb_pixel_total : 146137 time to create 1 rle with old method : 0.15986967086791992 time for calcul the mask position with numpy : 0.052240610122680664 nb_pixel_total : 70196 time to create 1 rle with old method : 0.07727885246276855 time for calcul the mask position with numpy : 0.05313754081726074 nb_pixel_total : 4158 time to create 1 rle with old method : 0.004961729049682617 time for calcul the mask position with numpy : 0.054543495178222656 nb_pixel_total : 198612 time to create 1 rle with new method : 1.0628747940063477 time for calcul the mask position with numpy : 0.052362918853759766 nb_pixel_total : 64122 time to create 1 rle with old method : 0.0679008960723877 time for calcul the mask position with numpy : 0.05018043518066406 nb_pixel_total : 54 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.055034637451171875 nb_pixel_total : 33368 time to create 1 rle with old method : 0.05193352699279785 time for calcul the mask position with numpy : 0.051027774810791016 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006291866302490234 create new chi : 28.001646041870117 time to delete rle : 0.007338523864746094 batch 1 Loaded 72 chid ids of type : 4855 Number RLEs to save : 55550 TO DO : save crop sub photo not yet done ! save time : 6.545821189880371 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 25.312019109725952 time for calcul the mask position with numpy : 0.052855491638183594 nb_pixel_total : 1230983 time to create 1 rle with new method : 0.9505956172943115 time for calcul the mask position with numpy : 0.04058265686035156 nb_pixel_total : 9662 time to create 1 rle with old method : 0.013163566589355469 time for calcul the mask position with numpy : 0.06302928924560547 nb_pixel_total : 71312 time to create 1 rle with old method : 0.07887959480285645 time for calcul the mask position with numpy : 0.06209254264831543 nb_pixel_total : 37559 time to create 1 rle with old method : 0.04141426086425781 time for calcul the mask position with numpy : 0.06434822082519531 nb_pixel_total : 81477 time to create 1 rle with old method : 0.09009170532226562 time for calcul the mask position with numpy : 0.061956167221069336 nb_pixel_total : 207234 time to create 1 rle with new method : 1.314568281173706 time for calcul the mask position with numpy : 0.060506582260131836 nb_pixel_total : 3828 time to create 1 rle with old method : 0.00429534912109375 time for calcul the mask position with numpy : 0.06183290481567383 nb_pixel_total : 526239 time to create 1 rle with new method : 1.088573932647705 time for calcul the mask position with numpy : 0.06046009063720703 nb_pixel_total : 13441 time to create 1 rle with old method : 0.014777898788452148 time for calcul the mask position with numpy : 0.05191946029663086 nb_pixel_total : 1593041 time to create 1 rle with new method : 1.502612829208374 time for calcul the mask position with numpy : 0.9854903221130371 nb_pixel_total : 9204424 time to create 1 rle with new method : 1.0503325462341309 create new chi : 7.950877666473389 time to delete rle : 0.0024995803833007812 batch 1 Loaded 12 chid ids of type : 4855 Number RLEs to save : 24090 TO DO : save crop sub photo not yet done ! save time : 2.230358123779297 map_output_result : {1357513059: (0.5019106643276242, 'Should be the crop_list due to order', 0.49902634600241635), 1357513048: (0.5019106643276242, 'Should be the crop_list due to order', 0.48816999772760167), 1357512878: (0.5019106643276242, 'Should be the crop_list due to order', 0.41350245481221476), 1357512874: (0.5019106643276242, 'Should be the crop_list due to order', 0.36605188845746556), 1357512854: (0.5019106643276242, 'Should be the crop_list due to order', 0.24471329896604724), 1357512832: (0.5019106643276242, 'Should be the crop_list due to order', 1.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 6 /1357513059.Didn't retrieve data . /1357513048.Didn't retrieve data . /1357512878.Didn't retrieve data . /1357512874.Didn't retrieve data . /1357512854.Didn't retrieve data . /1357512832.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.016212940216064453 save_final save missing photos in datou_result : time spend for datou_step_exec : 529.604113817215 time spend to save output : 0.02073812484741211 total time spend for step 5 : 529.6248519420624 step6:crop_condition Tue May 13 03:14:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 416 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747098886_729003 we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.532506704330444 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 89 About to insert : list_path_to_insert length 89 new photo from crops ! About to upload 89 photos upload in portfolio : 3015255 init cache_photo without model_param we have 89 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747098954_729003 we have uploaded 89 photos in the portfolio 3015255 time of upload the photos Elapsed time : 24.507860898971558 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747098990_729003 we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.099582433700562 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3015255 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099006_729003 we have uploaded 8 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.0635790824890137 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099014_729003 we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.0227148532867432 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3015255 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099026_729003 we have uploaded 13 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.040116548538208 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099033_729003 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8158957958221436 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 3015255 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099082_729003 we have uploaded 53 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.801369905471802 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099107_729003 we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.190420389175415 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3015255 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099270_729003 we have uploaded 56 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.227590084075928 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 299 /1357762203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357762736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 903 time used for this insertion : 0.09436893463134766 save_final save missing photos in datou_result : time spend for datou_step_exec : 426.53111505508423 time spend to save output : 0.10061049461364746 total time spend for step 6 : 426.6317255496979 step7:ventilate_hashtags_in_portfolio Tue May 13 03:21:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22902875 get user id for portfolio 22902875 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22905023,22905024,22905025,22905026,22905027,22905032,22905034,22905035,22905036,22905037,22905038,22905039,22905041,22905042,22905043,22905044,22905045,22905046,22905047,22905048?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22902875 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 1 /22902875. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015899658203125 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.200258016586304 time spend to save output : 0.016370296478271484 total time spend for step 7 : 4.216628313064575 step8:final Tue May 13 03:21:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357513059: ('0.40074268083807946',), 1357513048: ('0.40074268083807946',), 1357512878: ('0.40074268083807946',), 1357512874: ('0.40074268083807946',), 1357512854: ('0.40074268083807946',), 1357512832: ('0.40074268083807946',)} new output for save of step final : {1357513059: ('0.40074268083807946',), 1357513048: ('0.40074268083807946',), 1357512878: ('0.40074268083807946',), 1357512874: ('0.40074268083807946',), 1357512854: ('0.40074268083807946',), 1357512832: ('0.40074268083807946',)} [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 6 /1357513059.Didn't retrieve data . /1357513048.Didn't retrieve data . /1357512878.Didn't retrieve data . /1357512874.Didn't retrieve data . /1357512854.Didn't retrieve data . /1357512832.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.012761116027832031 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10935068130493164 time spend to save output : 0.013125181198120117 total time spend for step 8 : 0.12247586250305176 step9:velours_tree Tue May 13 03:21:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.6000492572784424 time spend to save output : 4.9591064453125e-05 total time spend for step 9 : 1.6000988483428955 step10:send_mail_cod Tue May 13 03:21:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22902875_13-05-2025_03_21_33.pdf 22904996 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229049961747099293 22904997 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229049971747099295 22904998 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229049981747099297 22904999 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229049991747099298 22905000 change filename to text .change filename to text .change filename to text .imagette229050001747099299 22905001 imagette229050011747099299 22905002 imagette229050021747099299 22905003 imagette229050031747099299 22905004 imagette229050041747099299 22905005 imagette229050051747099299 22905006 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229050061747099299 22905007 change filename to text .change filename to text .imagette229050071747099300 22905008 imagette229050081747099300 22905009 imagette229050091747099300 22905010 imagette229050101747099300 22905011 imagette229050111747099300 22905012 imagette229050121747099300 22905013 imagette229050131747099300 22905014 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229050141747099300 22905016 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229050161747099301 22905017 imagette229050171747099303 22905018 imagette229050181747099303 22905019 imagette229050191747099303 22905020 imagette229050201747099303 22905021 imagette229050211747099303 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22902875 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22905023,22905024,22905025,22905026,22905027,22905032,22905034,22905035,22905036,22905037,22905038,22905039,22905041,22905042,22905043,22905044,22905045,22905046,22905047,22905048?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22902875 your option no_mail is active, we will not send the real mail to your client args[1357513059] : ((1357513059, 2156.589021853531, 492609224), (1357513059, -0.45648793340695687, 496442774), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357513048] : ((1357513048, 1485.945513666575, 2107751945), (1357513048, -0.59374370010278, 501862349), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357512878] : ((1357512878, 1468.1180151174349, 2107751945), (1357512878, -0.4004769615597169, 496442774), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357512874] : ((1357512874, 1957.636341118384, 2107751945), (1357512874, -0.2880904576892666, 496442774), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357512854] : ((1357512854, 2419.718827301347, 492609224), (1357512854, -0.2056867218017021, 496442774), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357512832] : ((1357512832, 229.45080935190535, 492688767), (1357512832, -0.7757684524136305, 501862349), '0.40074268083807946') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.40074268083807946 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902875_13-05-2025_03_21_33.pdf results_Auto_P22902875_13-05-2025_03_21_33.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902875_13-05-2025_03_21_33.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22902875','results_Auto_P22902875_13-05-2025_03_21_33.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902875_13-05-2025_03_21_33.pdf','pdf','','2.54','0.40074268083807946') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013381242752075195 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.778241395950317 time spend to save output : 0.013694047927856445 total time spend for step 10 : 13.791935443878174 step11:split_time_score Tue May 13 03:21:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('42', 1), ('43', 5)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10052025 22902875 Nombre de photos uploadées : 6 / 23040 (0%) 10052025 22902875 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 10052025 22902875 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0004744529724121094 elapsed_time : insert_dashboard_record_day_entry 0.02228689193725586 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2280055167718577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862238_10-05-2025_15_49_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862238 AND mptpi.`type`=4855 To do Qualite : 0.39773799115774777 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862239 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4855 To do Qualite : 0.40074268083807946 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902875_13-05-2025_03_21_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902875 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4855 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P22902876_13-05-2025_02_13_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902876 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902877 order by id desc limit 1 Qualite : 0.43946735457882824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902878_13-05-2025_02_31_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902878 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10052025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357513059, 1357513048, 1357512878, 1357512874, 1357512854, 1357512832] Looping around the photos to save general results len do output : 1 /22902875Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513059', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357513048', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512878', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512874', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512854', None, None, None, None, None, '2833131') ('4741', None, None, None, None, None, None, None, '2833131') ('4741', '22902875', '1357512832', None, None, None, None, None, '2833131') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012129545211791992 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7422900199890137 time spend to save output : 0.012363672256469727 total time spend for step 11 : 1.7546536922454834 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 760.34user 372.19system 20:24.41elapsed 92%CPU (0avgtext+0avgdata 8307124maxresident)k 2026488inputs+848968outputs (52828major+61639672minor)pagefaults 0swaps