python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 206975 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2817442'] with mtr_portfolio_ids : ['22862239'] and first list_photo_ids : [] new path : /proc/206975/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.8505167961120605 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat May 10 15:41:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4109 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-10 15:41:31.498131: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-10 15:41:31.527151: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-10 15:41:31.529416: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb348000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-10 15:41:31.529472: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-10 15:41:31.534004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-10 15:41:31.785209: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1be8c3c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-10 15:41:31.785276: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-10 15:41:31.786890: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:41:31.787374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:41:31.790609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:41:31.799959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:41:31.800376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:41:31.809902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:41:31.813378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:41:31.835474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:41:31.836894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:41:31.837490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:41:31.838236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-10 15:41:31.838257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-10 15:41:31.838270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-10 15:41:31.839766: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3657 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-10 15:41:32.150191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:41:32.150324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:41:32.150353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:41:32.150380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:41:32.150405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:41:32.150431: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:41:32.150455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:41:32.150481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:41:32.152019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:41:32.153129: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:41:32.153163: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:41:32.153179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:41:32.153192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:41:32.153221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:41:32.153236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:41:32.153249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:41:32.153262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:41:32.154116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:41:32.154151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-10 15:41:32.154160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-10 15:41:32.154167: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-10 15:41:32.155062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3657 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-10 15:41:44.466639: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:41:44.652987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:41:46.353733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.07G (3299737600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-10 15:41:47.152112: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-10 15:41:47.152179: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 207162 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 82 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4109 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.040293216705322266 nb_pixel_total : 991616 time to create 1 rle with new method : 0.07565546035766602 length of segment : 1314 time for calcul the mask position with numpy : 0.0002751350402832031 nb_pixel_total : 12963 time to create 1 rle with old method : 0.01476144790649414 length of segment : 122 time for calcul the mask position with numpy : 0.05098724365234375 nb_pixel_total : 1207282 time to create 1 rle with new method : 0.22571492195129395 length of segment : 1315 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 21657 time to create 1 rle with old method : 0.024743080139160156 length of segment : 183 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 28987 time to create 1 rle with old method : 0.03241777420043945 length of segment : 184 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 4898 time to create 1 rle with old method : 0.005734682083129883 length of segment : 69 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 14231 time to create 1 rle with old method : 0.016176700592041016 length of segment : 102 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 24557 time to create 1 rle with old method : 0.027725696563720703 length of segment : 176 time for calcul the mask position with numpy : 0.0002434253692626953 nb_pixel_total : 12118 time to create 1 rle with old method : 0.01390981674194336 length of segment : 95 time for calcul the mask position with numpy : 0.0008141994476318359 nb_pixel_total : 59215 time to create 1 rle with old method : 0.06740641593933105 length of segment : 264 time for calcul the mask position with numpy : 0.1570746898651123 nb_pixel_total : 2774569 time to create 1 rle with new method : 0.428173303604126 length of segment : 1216 time for calcul the mask position with numpy : 0.0007967948913574219 nb_pixel_total : 41175 time to create 1 rle with old method : 0.04499363899230957 length of segment : 252 time for calcul the mask position with numpy : 0.022950410842895508 nb_pixel_total : 1336021 time to create 1 rle with new method : 0.295788049697876 length of segment : 1103 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 27869 time to create 1 rle with old method : 0.03217816352844238 length of segment : 158 time for calcul the mask position with numpy : 0.0003452301025390625 nb_pixel_total : 22335 time to create 1 rle with old method : 0.0256040096282959 length of segment : 126 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 18902 time to create 1 rle with old method : 0.022674083709716797 length of segment : 198 time for calcul the mask position with numpy : 0.0004889965057373047 nb_pixel_total : 24601 time to create 1 rle with old method : 0.02761054039001465 length of segment : 145 time for calcul the mask position with numpy : 0.0007510185241699219 nb_pixel_total : 43861 time to create 1 rle with old method : 0.05163121223449707 length of segment : 262 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 12344 time to create 1 rle with old method : 0.014693021774291992 length of segment : 235 time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 19900 time to create 1 rle with old method : 0.02237081527709961 length of segment : 179 time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 24668 time to create 1 rle with old method : 0.02774810791015625 length of segment : 159 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 17075 time to create 1 rle with old method : 0.01921868324279785 length of segment : 190 time for calcul the mask position with numpy : 0.004270792007446289 nb_pixel_total : 188954 time to create 1 rle with new method : 0.007396221160888672 length of segment : 365 time for calcul the mask position with numpy : 0.0031766891479492188 nb_pixel_total : 146907 time to create 1 rle with old method : 0.16155529022216797 length of segment : 383 time for calcul the mask position with numpy : 0.0029594898223876953 nb_pixel_total : 156268 time to create 1 rle with new method : 0.004339456558227539 length of segment : 312 time for calcul the mask position with numpy : 0.0008871555328369141 nb_pixel_total : 22502 time to create 1 rle with old method : 0.024981021881103516 length of segment : 244 time for calcul the mask position with numpy : 0.0012867450714111328 nb_pixel_total : 54980 time to create 1 rle with old method : 0.0629587173461914 length of segment : 266 time for calcul the mask position with numpy : 0.000823974609375 nb_pixel_total : 36035 time to create 1 rle with old method : 0.04180788993835449 length of segment : 158 time for calcul the mask position with numpy : 0.0017690658569335938 nb_pixel_total : 43959 time to create 1 rle with old method : 0.05032682418823242 length of segment : 297 time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 2671 time to create 1 rle with old method : 0.003379344940185547 length of segment : 105 time for calcul the mask position with numpy : 0.001957416534423828 nb_pixel_total : 23251 time to create 1 rle with old method : 0.027585744857788086 length of segment : 186 time for calcul the mask position with numpy : 0.0005140304565429688 nb_pixel_total : 26235 time to create 1 rle with old method : 0.03105449676513672 length of segment : 109 time for calcul the mask position with numpy : 0.0004947185516357422 nb_pixel_total : 14547 time to create 1 rle with old method : 0.017125844955444336 length of segment : 169 time for calcul the mask position with numpy : 0.0036902427673339844 nb_pixel_total : 71707 time to create 1 rle with old method : 0.09274411201477051 length of segment : 268 time for calcul the mask position with numpy : 0.18013310432434082 nb_pixel_total : 1808698 time to create 1 rle with new method : 0.15524840354919434 length of segment : 1227 time for calcul the mask position with numpy : 0.017332792282104492 nb_pixel_total : 844057 time to create 1 rle with new method : 0.055583953857421875 length of segment : 1146 time for calcul the mask position with numpy : 0.0007853507995605469 nb_pixel_total : 24247 time to create 1 rle with old method : 0.02925562858581543 length of segment : 168 time for calcul the mask position with numpy : 0.0005948543548583984 nb_pixel_total : 10469 time to create 1 rle with old method : 0.012775421142578125 length of segment : 158 time for calcul the mask position with numpy : 0.0017924308776855469 nb_pixel_total : 37492 time to create 1 rle with old method : 0.04601907730102539 length of segment : 208 time for calcul the mask position with numpy : 0.0008587837219238281 nb_pixel_total : 20354 time to create 1 rle with old method : 0.024625778198242188 length of segment : 122 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 9689 time to create 1 rle with old method : 0.011829614639282227 length of segment : 128 time for calcul the mask position with numpy : 0.0010061264038085938 nb_pixel_total : 47905 time to create 1 rle with old method : 0.055382728576660156 length of segment : 278 time for calcul the mask position with numpy : 0.0004942417144775391 nb_pixel_total : 9458 time to create 1 rle with old method : 0.011174678802490234 length of segment : 160 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 27661 time to create 1 rle with old method : 0.03284883499145508 length of segment : 163 time for calcul the mask position with numpy : 0.00035834312438964844 nb_pixel_total : 11996 time to create 1 rle with old method : 0.014709949493408203 length of segment : 93 time for calcul the mask position with numpy : 0.00038743019104003906 nb_pixel_total : 13830 time to create 1 rle with old method : 0.016339778900146484 length of segment : 103 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 8108 time to create 1 rle with old method : 0.009675741195678711 length of segment : 159 time for calcul the mask position with numpy : 0.0012695789337158203 nb_pixel_total : 69149 time to create 1 rle with old method : 0.0828390121459961 length of segment : 311 time for calcul the mask position with numpy : 0.044954538345336914 nb_pixel_total : 2565810 time to create 1 rle with new method : 1.3188533782958984 length of segment : 1307 time for calcul the mask position with numpy : 0.031133413314819336 nb_pixel_total : 1694437 time to create 1 rle with new method : 0.28873610496520996 length of segment : 2495 time for calcul the mask position with numpy : 0.0005822181701660156 nb_pixel_total : 17206 time to create 1 rle with old method : 0.020663976669311523 length of segment : 138 time for calcul the mask position with numpy : 0.00047206878662109375 nb_pixel_total : 13363 time to create 1 rle with old method : 0.016474246978759766 length of segment : 140 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 16193 time to create 1 rle with old method : 0.019793033599853516 length of segment : 151 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 6922 time to create 1 rle with old method : 0.008579254150390625 length of segment : 84 time for calcul the mask position with numpy : 0.005608797073364258 nb_pixel_total : 327129 time to create 1 rle with new method : 0.010028839111328125 length of segment : 651 time for calcul the mask position with numpy : 0.004647254943847656 nb_pixel_total : 200690 time to create 1 rle with new method : 0.007308244705200195 length of segment : 525 time for calcul the mask position with numpy : 0.0034270286560058594 nb_pixel_total : 128128 time to create 1 rle with old method : 0.15151166915893555 length of segment : 331 time for calcul the mask position with numpy : 0.13435053825378418 nb_pixel_total : 2092093 time to create 1 rle with new method : 0.39325523376464844 length of segment : 927 time for calcul the mask position with numpy : 0.0012886524200439453 nb_pixel_total : 50593 time to create 1 rle with old method : 0.06073331832885742 length of segment : 259 time for calcul the mask position with numpy : 0.01744842529296875 nb_pixel_total : 791827 time to create 1 rle with new method : 0.04536747932434082 length of segment : 759 time for calcul the mask position with numpy : 0.0013053417205810547 nb_pixel_total : 71521 time to create 1 rle with old method : 0.09131050109863281 length of segment : 382 time for calcul the mask position with numpy : 0.0005695819854736328 nb_pixel_total : 16864 time to create 1 rle with old method : 0.020560026168823242 length of segment : 175 time for calcul the mask position with numpy : 0.002193927764892578 nb_pixel_total : 91811 time to create 1 rle with old method : 0.11140704154968262 length of segment : 382 time for calcul the mask position with numpy : 0.001018524169921875 nb_pixel_total : 31157 time to create 1 rle with old method : 0.039010047912597656 length of segment : 168 time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 5378 time to create 1 rle with old method : 0.006893157958984375 length of segment : 127 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 22159 time to create 1 rle with old method : 0.027072906494140625 length of segment : 111 time for calcul the mask position with numpy : 0.0009951591491699219 nb_pixel_total : 34350 time to create 1 rle with old method : 0.042044878005981445 length of segment : 207 time for calcul the mask position with numpy : 0.0013930797576904297 nb_pixel_total : 57909 time to create 1 rle with old method : 0.06937098503112793 length of segment : 300 time for calcul the mask position with numpy : 0.002070188522338867 nb_pixel_total : 80060 time to create 1 rle with old method : 0.09566402435302734 length of segment : 218 time for calcul the mask position with numpy : 0.05201840400695801 nb_pixel_total : 2143188 time to create 1 rle with new method : 0.19832396507263184 length of segment : 1947 time for calcul the mask position with numpy : 0.0009093284606933594 nb_pixel_total : 21735 time to create 1 rle with old method : 0.026349306106567383 length of segment : 172 time for calcul the mask position with numpy : 0.001428365707397461 nb_pixel_total : 40027 time to create 1 rle with old method : 0.048264503479003906 length of segment : 214 time for calcul the mask position with numpy : 0.014068603515625 nb_pixel_total : 1076683 time to create 1 rle with new method : 0.031960487365722656 length of segment : 1052 time for calcul the mask position with numpy : 0.03510594367980957 nb_pixel_total : 1887782 time to create 1 rle with new method : 0.13279175758361816 length of segment : 1408 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 7681 time to create 1 rle with old method : 0.00968623161315918 length of segment : 86 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 21624 time to create 1 rle with old method : 0.026366472244262695 length of segment : 179 time for calcul the mask position with numpy : 0.0011594295501708984 nb_pixel_total : 47218 time to create 1 rle with old method : 0.056612491607666016 length of segment : 192 time for calcul the mask position with numpy : 0.0005803108215332031 nb_pixel_total : 19155 time to create 1 rle with old method : 0.023032188415527344 length of segment : 171 time for calcul the mask position with numpy : 0.00020837783813476562 nb_pixel_total : 10108 time to create 1 rle with old method : 0.012210369110107422 length of segment : 148 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 2547 time to create 1 rle with old method : 0.003415346145629883 length of segment : 34 time for calcul the mask position with numpy : 0.0013420581817626953 nb_pixel_total : 56528 time to create 1 rle with old method : 0.06726765632629395 length of segment : 241 time for calcul the mask position with numpy : 0.01863861083984375 nb_pixel_total : 1572104 time to create 1 rle with new method : 0.07599472999572754 length of segment : 1243 time for calcul the mask position with numpy : 0.0009219646453857422 nb_pixel_total : 59861 time to create 1 rle with old method : 0.07111716270446777 length of segment : 234 time for calcul the mask position with numpy : 0.014853239059448242 nb_pixel_total : 907544 time to create 1 rle with new method : 0.2556149959564209 length of segment : 1400 time for calcul the mask position with numpy : 0.26447200775146484 nb_pixel_total : 4359881 time to create 1 rle with new method : 0.2906985282897949 length of segment : 1455 time for calcul the mask position with numpy : 0.17006754875183105 nb_pixel_total : 4293992 time to create 1 rle with new method : 0.29947543144226074 length of segment : 1473 time spent for convertir_results : 20.060933589935303 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 86 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 69.63244843482971 time spend to save output : 0.10488319396972656 total time spend for step 1 : 69.73733162879944 step2:mask_detect Sat May 10 15:42:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4109 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-10 15:42:41.056204: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-10 15:42:41.083312: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-10 15:42:41.084904: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb334000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-10 15:42:41.084958: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-10 15:42:41.091977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-10 15:42:41.323738: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1d2cc380 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-10 15:42:41.323780: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-10 15:42:41.324542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:42:41.324837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:42:41.327240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:42:41.329637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:42:41.329976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:42:41.336619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:42:41.338137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:42:41.344374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:42:41.345513: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:42:41.345597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:42:41.346242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-10 15:42:41.346259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-10 15:42:41.346268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-10 15:42:41.347262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3657 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-10 15:42:41.457968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:42:41.458098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:42:41.458135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:42:41.458154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:42:41.458171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:42:41.458189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:42:41.458205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:42:41.458223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:42:41.459101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:42:41.460172: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-10 15:42:41.460212: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-10 15:42:41.460230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:42:41.460250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-10 15:42:41.460266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-10 15:42:41.460282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-10 15:42:41.460298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-10 15:42:41.460322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:42:41.461162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-10 15:42:41.461198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-10 15:42:41.461206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-10 15:42:41.461213: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-10 15:42:41.462083: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3657 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-10 15:42:54.123740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-10 15:42:54.313269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-10 15:42:56.024729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.07G (3299737600 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-10 15:42:56.830107: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-10 15:42:56.830176: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 66 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 209717 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 82 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4109 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0031032562255859375 nb_pixel_total : 83062 time to create 1 rle with old method : 0.09728813171386719 length of segment : 402 time for calcul the mask position with numpy : 0.0011627674102783203 nb_pixel_total : 72099 time to create 1 rle with old method : 0.08285689353942871 length of segment : 295 time for calcul the mask position with numpy : 0.0026328563690185547 nb_pixel_total : 147910 time to create 1 rle with old method : 0.18369102478027344 length of segment : 311 time for calcul the mask position with numpy : 0.0016617774963378906 nb_pixel_total : 84383 time to create 1 rle with old method : 0.09702944755554199 length of segment : 365 time for calcul the mask position with numpy : 0.002599000930786133 nb_pixel_total : 104069 time to create 1 rle with old method : 0.12150883674621582 length of segment : 436 time for calcul the mask position with numpy : 0.0018384456634521484 nb_pixel_total : 116733 time to create 1 rle with old method : 0.13120079040527344 length of segment : 339 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 45629 time to create 1 rle with old method : 0.05534052848815918 length of segment : 321 time for calcul the mask position with numpy : 0.0004947185516357422 nb_pixel_total : 26445 time to create 1 rle with old method : 0.032407283782958984 length of segment : 135 time for calcul the mask position with numpy : 0.0015714168548583984 nb_pixel_total : 95061 time to create 1 rle with old method : 0.11352109909057617 length of segment : 370 time for calcul the mask position with numpy : 0.0005519390106201172 nb_pixel_total : 33012 time to create 1 rle with old method : 0.038907766342163086 length of segment : 182 time for calcul the mask position with numpy : 0.0018532276153564453 nb_pixel_total : 94818 time to create 1 rle with old method : 0.10952281951904297 length of segment : 303 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 53258 time to create 1 rle with old method : 0.06270337104797363 length of segment : 247 time for calcul the mask position with numpy : 0.02935934066772461 nb_pixel_total : 1177580 time to create 1 rle with new method : 0.35856080055236816 length of segment : 1413 time for calcul the mask position with numpy : 0.0015904903411865234 nb_pixel_total : 99156 time to create 1 rle with old method : 0.11760234832763672 length of segment : 290 time for calcul the mask position with numpy : 0.0052356719970703125 nb_pixel_total : 318921 time to create 1 rle with new method : 0.01239323616027832 length of segment : 1504 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 37140 time to create 1 rle with old method : 0.043161630630493164 length of segment : 262 time for calcul the mask position with numpy : 0.0009725093841552734 nb_pixel_total : 61536 time to create 1 rle with old method : 0.0715799331665039 length of segment : 267 time for calcul the mask position with numpy : 0.0007541179656982422 nb_pixel_total : 43656 time to create 1 rle with old method : 0.05044674873352051 length of segment : 164 time for calcul the mask position with numpy : 0.0008158683776855469 nb_pixel_total : 61486 time to create 1 rle with old method : 0.06990718841552734 length of segment : 222 time for calcul the mask position with numpy : 0.0008184909820556641 nb_pixel_total : 35837 time to create 1 rle with old method : 0.04280424118041992 length of segment : 138 time for calcul the mask position with numpy : 0.0014107227325439453 nb_pixel_total : 87369 time to create 1 rle with old method : 0.10167956352233887 length of segment : 268 time for calcul the mask position with numpy : 0.0009326934814453125 nb_pixel_total : 54807 time to create 1 rle with old method : 0.06364703178405762 length of segment : 314 time for calcul the mask position with numpy : 0.0038390159606933594 nb_pixel_total : 226211 time to create 1 rle with new method : 0.010268688201904297 length of segment : 560 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 343671 time to create 1 rle with new method : 0.016901731491088867 length of segment : 706 time for calcul the mask position with numpy : 0.0003097057342529297 nb_pixel_total : 15385 time to create 1 rle with old method : 0.017675161361694336 length of segment : 127 time for calcul the mask position with numpy : 0.0004642009735107422 nb_pixel_total : 28086 time to create 1 rle with old method : 0.0325319766998291 length of segment : 145 time for calcul the mask position with numpy : 0.0038154125213623047 nb_pixel_total : 317333 time to create 1 rle with new method : 0.008792400360107422 length of segment : 539 time for calcul the mask position with numpy : 0.0015025138854980469 nb_pixel_total : 88878 time to create 1 rle with old method : 0.10047769546508789 length of segment : 235 time for calcul the mask position with numpy : 0.0013968944549560547 nb_pixel_total : 88522 time to create 1 rle with old method : 0.1011049747467041 length of segment : 288 time for calcul the mask position with numpy : 0.0012052059173583984 nb_pixel_total : 71418 time to create 1 rle with old method : 0.09822583198547363 length of segment : 280 time for calcul the mask position with numpy : 0.0011746883392333984 nb_pixel_total : 77969 time to create 1 rle with old method : 0.09060859680175781 length of segment : 230 time for calcul the mask position with numpy : 0.004049539566040039 nb_pixel_total : 164505 time to create 1 rle with new method : 0.013882875442504883 length of segment : 482 time for calcul the mask position with numpy : 0.2784268856048584 nb_pixel_total : 3098183 time to create 1 rle with new method : 0.5377912521362305 length of segment : 1292 time for calcul the mask position with numpy : 0.0013213157653808594 nb_pixel_total : 60718 time to create 1 rle with old method : 0.07004857063293457 length of segment : 264 time for calcul the mask position with numpy : 0.001909494400024414 nb_pixel_total : 97660 time to create 1 rle with old method : 0.13384056091308594 length of segment : 382 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 38798 time to create 1 rle with old method : 0.04438138008117676 length of segment : 219 time for calcul the mask position with numpy : 0.0014767646789550781 nb_pixel_total : 61737 time to create 1 rle with old method : 0.07335686683654785 length of segment : 274 time for calcul the mask position with numpy : 0.0013320446014404297 nb_pixel_total : 69282 time to create 1 rle with old method : 0.07960200309753418 length of segment : 272 time for calcul the mask position with numpy : 0.0012173652648925781 nb_pixel_total : 67243 time to create 1 rle with old method : 0.07620620727539062 length of segment : 307 time for calcul the mask position with numpy : 0.000553131103515625 nb_pixel_total : 20220 time to create 1 rle with old method : 0.023412704467773438 length of segment : 137 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 40770 time to create 1 rle with old method : 0.04812359809875488 length of segment : 199 time for calcul the mask position with numpy : 0.0005753040313720703 nb_pixel_total : 29215 time to create 1 rle with old method : 0.03378868103027344 length of segment : 211 time for calcul the mask position with numpy : 0.0396573543548584 nb_pixel_total : 1566018 time to create 1 rle with new method : 0.340256929397583 length of segment : 1018 time for calcul the mask position with numpy : 0.00038623809814453125 nb_pixel_total : 24692 time to create 1 rle with old method : 0.028461456298828125 length of segment : 160 time for calcul the mask position with numpy : 0.0005173683166503906 nb_pixel_total : 28282 time to create 1 rle with old method : 0.03243279457092285 length of segment : 255 time for calcul the mask position with numpy : 0.0008625984191894531 nb_pixel_total : 46230 time to create 1 rle with old method : 0.05254507064819336 length of segment : 288 time for calcul the mask position with numpy : 0.0006682872772216797 nb_pixel_total : 47925 time to create 1 rle with old method : 0.05762672424316406 length of segment : 125 time for calcul the mask position with numpy : 0.0007128715515136719 nb_pixel_total : 30247 time to create 1 rle with old method : 0.0363316535949707 length of segment : 193 time for calcul the mask position with numpy : 0.0013113021850585938 nb_pixel_total : 71799 time to create 1 rle with old method : 0.08072757720947266 length of segment : 280 time for calcul the mask position with numpy : 0.0016312599182128906 nb_pixel_total : 106157 time to create 1 rle with old method : 0.11985468864440918 length of segment : 338 time for calcul the mask position with numpy : 0.0007042884826660156 nb_pixel_total : 44439 time to create 1 rle with old method : 0.051004648208618164 length of segment : 182 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 24337 time to create 1 rle with old method : 0.02806878089904785 length of segment : 162 time for calcul the mask position with numpy : 0.0008001327514648438 nb_pixel_total : 52871 time to create 1 rle with old method : 0.05996274948120117 length of segment : 228 time for calcul the mask position with numpy : 0.0282135009765625 nb_pixel_total : 1403852 time to create 1 rle with new method : 0.23366260528564453 length of segment : 1029 time for calcul the mask position with numpy : 0.030993223190307617 nb_pixel_total : 1715500 time to create 1 rle with new method : 0.34933018684387207 length of segment : 1225 time for calcul the mask position with numpy : 0.006821393966674805 nb_pixel_total : 336120 time to create 1 rle with new method : 0.019924402236938477 length of segment : 876 time for calcul the mask position with numpy : 0.0005545616149902344 nb_pixel_total : 29556 time to create 1 rle with old method : 0.03384971618652344 length of segment : 204 time for calcul the mask position with numpy : 0.0033915042877197266 nb_pixel_total : 179752 time to create 1 rle with new method : 0.010596513748168945 length of segment : 522 time for calcul the mask position with numpy : 0.0018167495727539062 nb_pixel_total : 118050 time to create 1 rle with old method : 0.13320589065551758 length of segment : 354 time for calcul the mask position with numpy : 0.0005471706390380859 nb_pixel_total : 5487 time to create 1 rle with old method : 0.008122444152832031 length of segment : 103 time for calcul the mask position with numpy : 0.0020759105682373047 nb_pixel_total : 110424 time to create 1 rle with old method : 0.13434624671936035 length of segment : 348 time for calcul the mask position with numpy : 0.0019333362579345703 nb_pixel_total : 119913 time to create 1 rle with old method : 0.14540362358093262 length of segment : 336 time for calcul the mask position with numpy : 0.00421452522277832 nb_pixel_total : 99676 time to create 1 rle with old method : 0.11394596099853516 length of segment : 736 time for calcul the mask position with numpy : 0.0010857582092285156 nb_pixel_total : 14807 time to create 1 rle with old method : 0.017850637435913086 length of segment : 303 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 81412 time to create 1 rle with old method : 0.11773133277893066 length of segment : 289 time for calcul the mask position with numpy : 0.005621671676635742 nb_pixel_total : 278085 time to create 1 rle with new method : 0.01757502555847168 length of segment : 598 time for calcul the mask position with numpy : 0.0007164478302001953 nb_pixel_total : 44020 time to create 1 rle with old method : 0.05104470252990723 length of segment : 175 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 25377 time to create 1 rle with old method : 0.03954958915710449 length of segment : 183 time for calcul the mask position with numpy : 0.001285552978515625 nb_pixel_total : 60124 time to create 1 rle with old method : 0.06893253326416016 length of segment : 298 time for calcul the mask position with numpy : 0.0014698505401611328 nb_pixel_total : 67033 time to create 1 rle with old method : 0.07470583915710449 length of segment : 263 time for calcul the mask position with numpy : 0.004217386245727539 nb_pixel_total : 76253 time to create 1 rle with old method : 0.08750414848327637 length of segment : 521 time for calcul the mask position with numpy : 0.0005450248718261719 nb_pixel_total : 26488 time to create 1 rle with old method : 0.03127646446228027 length of segment : 168 time for calcul the mask position with numpy : 0.0022478103637695312 nb_pixel_total : 96785 time to create 1 rle with old method : 0.1160736083984375 length of segment : 349 time for calcul the mask position with numpy : 0.0005526542663574219 nb_pixel_total : 21106 time to create 1 rle with old method : 0.02468419075012207 length of segment : 186 time for calcul the mask position with numpy : 0.0018947124481201172 nb_pixel_total : 54967 time to create 1 rle with old method : 0.06511998176574707 length of segment : 259 time for calcul the mask position with numpy : 0.005696773529052734 nb_pixel_total : 311917 time to create 1 rle with new method : 0.015450239181518555 length of segment : 597 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 25926 time to create 1 rle with old method : 0.0303800106048584 length of segment : 160 time for calcul the mask position with numpy : 0.00162506103515625 nb_pixel_total : 55098 time to create 1 rle with old method : 0.066619873046875 length of segment : 257 time for calcul the mask position with numpy : 0.0015711784362792969 nb_pixel_total : 52487 time to create 1 rle with old method : 0.061882972717285156 length of segment : 287 time for calcul the mask position with numpy : 0.003512859344482422 nb_pixel_total : 167688 time to create 1 rle with new method : 0.009302139282226562 length of segment : 340 time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 58881 time to create 1 rle with old method : 0.06926584243774414 length of segment : 274 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 27816 time to create 1 rle with old method : 0.03253459930419922 length of segment : 132 time for calcul the mask position with numpy : 0.001535177230834961 nb_pixel_total : 43531 time to create 1 rle with old method : 0.05058622360229492 length of segment : 256 time for calcul the mask position with numpy : 0.0006163120269775391 nb_pixel_total : 19647 time to create 1 rle with old method : 0.022635221481323242 length of segment : 221 time for calcul the mask position with numpy : 0.00060272216796875 nb_pixel_total : 17310 time to create 1 rle with old method : 0.02051568031311035 length of segment : 177 time for calcul the mask position with numpy : 0.0011899471282958984 nb_pixel_total : 38005 time to create 1 rle with old method : 0.044426918029785156 length of segment : 294 time for calcul the mask position with numpy : 0.00026535987854003906 nb_pixel_total : 8277 time to create 1 rle with old method : 0.009935617446899414 length of segment : 162 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 46191 time to create 1 rle with old method : 0.05370783805847168 length of segment : 309 time for calcul the mask position with numpy : 0.0011744499206542969 nb_pixel_total : 56992 time to create 1 rle with old method : 0.06398439407348633 length of segment : 281 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 21378 time to create 1 rle with old method : 0.025883197784423828 length of segment : 202 time for calcul the mask position with numpy : 0.00045180320739746094 nb_pixel_total : 21720 time to create 1 rle with old method : 0.025862693786621094 length of segment : 122 time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 16398 time to create 1 rle with old method : 0.01998138427734375 length of segment : 192 time for calcul the mask position with numpy : 0.010731220245361328 nb_pixel_total : 475617 time to create 1 rle with new method : 0.026947021484375 length of segment : 819 time for calcul the mask position with numpy : 0.0023183822631835938 nb_pixel_total : 135863 time to create 1 rle with old method : 0.15407729148864746 length of segment : 468 time for calcul the mask position with numpy : 0.017450332641601562 nb_pixel_total : 564165 time to create 1 rle with new method : 0.037554264068603516 length of segment : 769 time for calcul the mask position with numpy : 0.0024261474609375 nb_pixel_total : 71504 time to create 1 rle with old method : 0.08445882797241211 length of segment : 263 time for calcul the mask position with numpy : 0.0033860206604003906 nb_pixel_total : 117392 time to create 1 rle with old method : 0.16881871223449707 length of segment : 546 time for calcul the mask position with numpy : 0.0015840530395507812 nb_pixel_total : 61966 time to create 1 rle with old method : 0.08214616775512695 length of segment : 300 time for calcul the mask position with numpy : 0.0018470287322998047 nb_pixel_total : 92622 time to create 1 rle with old method : 0.11026763916015625 length of segment : 332 time for calcul the mask position with numpy : 0.002538919448852539 nb_pixel_total : 64019 time to create 1 rle with old method : 0.07685375213623047 length of segment : 359 time for calcul the mask position with numpy : 0.00809621810913086 nb_pixel_total : 294864 time to create 1 rle with new method : 0.02562546730041504 length of segment : 957 time for calcul the mask position with numpy : 0.013978958129882812 nb_pixel_total : 392804 time to create 1 rle with new method : 0.08921575546264648 length of segment : 800 time for calcul the mask position with numpy : 0.0009925365447998047 nb_pixel_total : 36204 time to create 1 rle with old method : 0.04513287544250488 length of segment : 184 time for calcul the mask position with numpy : 0.0014567375183105469 nb_pixel_total : 44228 time to create 1 rle with old method : 0.0597231388092041 length of segment : 290 time for calcul the mask position with numpy : 0.0025968551635742188 nb_pixel_total : 89517 time to create 1 rle with old method : 0.1246037483215332 length of segment : 321 time for calcul the mask position with numpy : 0.006987333297729492 nb_pixel_total : 233022 time to create 1 rle with new method : 0.02256608009338379 length of segment : 751 time for calcul the mask position with numpy : 0.0033757686614990234 nb_pixel_total : 154451 time to create 1 rle with new method : 0.009003877639770508 length of segment : 480 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 21039 time to create 1 rle with old method : 0.02528524398803711 length of segment : 215 time for calcul the mask position with numpy : 0.02234935760498047 nb_pixel_total : 722609 time to create 1 rle with new method : 0.1374979019165039 length of segment : 1080 time for calcul the mask position with numpy : 0.001497507095336914 nb_pixel_total : 38759 time to create 1 rle with old method : 0.04726719856262207 length of segment : 234 time for calcul the mask position with numpy : 0.0009684562683105469 nb_pixel_total : 21299 time to create 1 rle with old method : 0.027132034301757812 length of segment : 177 time for calcul the mask position with numpy : 0.0008592605590820312 nb_pixel_total : 35392 time to create 1 rle with old method : 0.04642534255981445 length of segment : 349 time for calcul the mask position with numpy : 0.011911153793334961 nb_pixel_total : 426678 time to create 1 rle with new method : 0.03527975082397461 length of segment : 724 time for calcul the mask position with numpy : 0.0010428428649902344 nb_pixel_total : 38968 time to create 1 rle with old method : 0.04957723617553711 length of segment : 174 time for calcul the mask position with numpy : 0.003093242645263672 nb_pixel_total : 144426 time to create 1 rle with old method : 0.19849443435668945 length of segment : 473 time for calcul the mask position with numpy : 0.005320072174072266 nb_pixel_total : 249599 time to create 1 rle with new method : 0.01949906349182129 length of segment : 512 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 21186 time to create 1 rle with old method : 0.024742603302001953 length of segment : 193 time for calcul the mask position with numpy : 0.001806020736694336 nb_pixel_total : 88017 time to create 1 rle with old method : 0.1059119701385498 length of segment : 399 time for calcul the mask position with numpy : 0.0016796588897705078 nb_pixel_total : 84412 time to create 1 rle with old method : 0.09465217590332031 length of segment : 275 time for calcul the mask position with numpy : 0.00310516357421875 nb_pixel_total : 155067 time to create 1 rle with new method : 0.008748531341552734 length of segment : 407 time for calcul the mask position with numpy : 0.0026984214782714844 nb_pixel_total : 120402 time to create 1 rle with old method : 0.13584327697753906 length of segment : 490 time for calcul the mask position with numpy : 0.003051280975341797 nb_pixel_total : 182928 time to create 1 rle with new method : 0.00894784927368164 length of segment : 449 time for calcul the mask position with numpy : 0.003216266632080078 nb_pixel_total : 185564 time to create 1 rle with new method : 0.009805917739868164 length of segment : 629 time for calcul the mask position with numpy : 0.0046825408935546875 nb_pixel_total : 236614 time to create 1 rle with new method : 0.012324094772338867 length of segment : 1104 time for calcul the mask position with numpy : 0.002031564712524414 nb_pixel_total : 109564 time to create 1 rle with old method : 0.12350034713745117 length of segment : 339 time for calcul the mask position with numpy : 0.0009479522705078125 nb_pixel_total : 47758 time to create 1 rle with old method : 0.05744028091430664 length of segment : 229 time for calcul the mask position with numpy : 0.0029511451721191406 nb_pixel_total : 161383 time to create 1 rle with new method : 0.00856781005859375 length of segment : 394 time for calcul the mask position with numpy : 0.003188610076904297 nb_pixel_total : 117306 time to create 1 rle with old method : 0.13271856307983398 length of segment : 329 time for calcul the mask position with numpy : 0.0029821395874023438 nb_pixel_total : 116932 time to create 1 rle with old method : 0.13582301139831543 length of segment : 356 time for calcul the mask position with numpy : 0.0033714771270751953 nb_pixel_total : 161082 time to create 1 rle with new method : 0.009938478469848633 length of segment : 390 time for calcul the mask position with numpy : 0.002637624740600586 nb_pixel_total : 109976 time to create 1 rle with old method : 0.1264052391052246 length of segment : 464 time for calcul the mask position with numpy : 0.0017538070678710938 nb_pixel_total : 70485 time to create 1 rle with old method : 0.08259844779968262 length of segment : 275 time for calcul the mask position with numpy : 0.0031812191009521484 nb_pixel_total : 131400 time to create 1 rle with old method : 0.1689751148223877 length of segment : 495 time for calcul the mask position with numpy : 0.0020241737365722656 nb_pixel_total : 101256 time to create 1 rle with old method : 0.11892151832580566 length of segment : 296 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 30207 time to create 1 rle with old method : 0.03564143180847168 length of segment : 166 time for calcul the mask position with numpy : 0.0011169910430908203 nb_pixel_total : 44007 time to create 1 rle with old method : 0.05229449272155762 length of segment : 447 time for calcul the mask position with numpy : 0.00417780876159668 nb_pixel_total : 216266 time to create 1 rle with new method : 0.012996196746826172 length of segment : 440 time for calcul the mask position with numpy : 0.0011267662048339844 nb_pixel_total : 62530 time to create 1 rle with old method : 0.07267522811889648 length of segment : 213 time for calcul the mask position with numpy : 0.002565145492553711 nb_pixel_total : 74794 time to create 1 rle with old method : 0.09893965721130371 length of segment : 420 time for calcul the mask position with numpy : 0.0033364295959472656 nb_pixel_total : 161700 time to create 1 rle with new method : 0.008730649948120117 length of segment : 426 time for calcul the mask position with numpy : 0.0035185813903808594 nb_pixel_total : 184397 time to create 1 rle with new method : 0.00987696647644043 length of segment : 440 time for calcul the mask position with numpy : 0.0004944801330566406 nb_pixel_total : 20750 time to create 1 rle with old method : 0.024648189544677734 length of segment : 150 time for calcul the mask position with numpy : 0.0009090900421142578 nb_pixel_total : 39608 time to create 1 rle with old method : 0.04803586006164551 length of segment : 230 time for calcul the mask position with numpy : 0.02053999900817871 nb_pixel_total : 858821 time to create 1 rle with new method : 0.09649348258972168 length of segment : 1644 time for calcul the mask position with numpy : 0.0007543563842773438 nb_pixel_total : 29497 time to create 1 rle with old method : 0.03496575355529785 length of segment : 244 time for calcul the mask position with numpy : 0.009728670120239258 nb_pixel_total : 446821 time to create 1 rle with new method : 0.02867293357849121 length of segment : 670 time for calcul the mask position with numpy : 0.0007801055908203125 nb_pixel_total : 23983 time to create 1 rle with old method : 0.02818584442138672 length of segment : 371 time for calcul the mask position with numpy : 0.0008826255798339844 nb_pixel_total : 41230 time to create 1 rle with old method : 0.048119544982910156 length of segment : 248 time for calcul the mask position with numpy : 0.0009453296661376953 nb_pixel_total : 51185 time to create 1 rle with old method : 0.05832481384277344 length of segment : 340 time for calcul the mask position with numpy : 0.0006799697875976562 nb_pixel_total : 32310 time to create 1 rle with old method : 0.03771185874938965 length of segment : 180 time for calcul the mask position with numpy : 0.0011110305786132812 nb_pixel_total : 71377 time to create 1 rle with old method : 0.0825042724609375 length of segment : 238 time for calcul the mask position with numpy : 0.0022912025451660156 nb_pixel_total : 125102 time to create 1 rle with old method : 0.14329862594604492 length of segment : 362 time for calcul the mask position with numpy : 0.004515171051025391 nb_pixel_total : 218598 time to create 1 rle with new method : 0.012575387954711914 length of segment : 419 time for calcul the mask position with numpy : 0.009949445724487305 nb_pixel_total : 422488 time to create 1 rle with new method : 0.1715540885925293 length of segment : 1370 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 80754 time to create 1 rle with old method : 0.09599637985229492 length of segment : 117 time for calcul the mask position with numpy : 0.004427433013916016 nb_pixel_total : 292212 time to create 1 rle with new method : 0.011851310729980469 length of segment : 632 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 44511 time to create 1 rle with old method : 0.051537275314331055 length of segment : 226 time for calcul the mask position with numpy : 0.0007555484771728516 nb_pixel_total : 32365 time to create 1 rle with old method : 0.038863182067871094 length of segment : 212 time for calcul the mask position with numpy : 0.0033795833587646484 nb_pixel_total : 148109 time to create 1 rle with old method : 0.16863226890563965 length of segment : 495 time for calcul the mask position with numpy : 0.020508289337158203 nb_pixel_total : 777228 time to create 1 rle with new method : 0.27680325508117676 length of segment : 957 time for calcul the mask position with numpy : 0.001865386962890625 nb_pixel_total : 71454 time to create 1 rle with old method : 0.09898257255554199 length of segment : 561 time for calcul the mask position with numpy : 0.0016124248504638672 nb_pixel_total : 76254 time to create 1 rle with old method : 0.08885693550109863 length of segment : 282 time for calcul the mask position with numpy : 0.0012924671173095703 nb_pixel_total : 61264 time to create 1 rle with old method : 0.07361531257629395 length of segment : 145 time for calcul the mask position with numpy : 0.003381967544555664 nb_pixel_total : 86004 time to create 1 rle with old method : 0.1186666488647461 length of segment : 429 time for calcul the mask position with numpy : 0.0018475055694580078 nb_pixel_total : 105442 time to create 1 rle with old method : 0.12239527702331543 length of segment : 343 time for calcul the mask position with numpy : 0.0023279190063476562 nb_pixel_total : 121521 time to create 1 rle with old method : 0.1635286808013916 length of segment : 376 time for calcul the mask position with numpy : 0.0017843246459960938 nb_pixel_total : 89529 time to create 1 rle with old method : 0.104034423828125 length of segment : 525 time for calcul the mask position with numpy : 0.0017895698547363281 nb_pixel_total : 112942 time to create 1 rle with old method : 0.13325166702270508 length of segment : 284 time for calcul the mask position with numpy : 0.0332183837890625 nb_pixel_total : 1717417 time to create 1 rle with new method : 0.40682196617126465 length of segment : 1685 time for calcul the mask position with numpy : 0.001314401626586914 nb_pixel_total : 63303 time to create 1 rle with old method : 0.07481646537780762 length of segment : 386 time for calcul the mask position with numpy : 0.0027806758880615234 nb_pixel_total : 194842 time to create 1 rle with new method : 0.007500171661376953 length of segment : 612 time for calcul the mask position with numpy : 0.002050161361694336 nb_pixel_total : 122906 time to create 1 rle with old method : 0.14184117317199707 length of segment : 347 time for calcul the mask position with numpy : 0.0011959075927734375 nb_pixel_total : 47895 time to create 1 rle with old method : 0.05534100532531738 length of segment : 409 time for calcul the mask position with numpy : 0.0009698867797851562 nb_pixel_total : 52980 time to create 1 rle with old method : 0.06330156326293945 length of segment : 213 time for calcul the mask position with numpy : 0.0010619163513183594 nb_pixel_total : 56218 time to create 1 rle with old method : 0.06597518920898438 length of segment : 475 time for calcul the mask position with numpy : 0.0035173892974853516 nb_pixel_total : 164557 time to create 1 rle with new method : 0.010394096374511719 length of segment : 492 time for calcul the mask position with numpy : 0.0035126209259033203 nb_pixel_total : 176032 time to create 1 rle with new method : 0.009939432144165039 length of segment : 594 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 45475 time to create 1 rle with old method : 0.053560733795166016 length of segment : 198 time for calcul the mask position with numpy : 0.24671292304992676 nb_pixel_total : 2891097 time to create 1 rle with new method : 1.1582562923431396 length of segment : 2520 time for calcul the mask position with numpy : 0.018950223922729492 nb_pixel_total : 1021468 time to create 1 rle with new method : 0.2314307689666748 length of segment : 2023 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 34902 time to create 1 rle with old method : 0.04089021682739258 length of segment : 148 time for calcul the mask position with numpy : 0.0016150474548339844 nb_pixel_total : 78206 time to create 1 rle with old method : 0.09056305885314941 length of segment : 294 time for calcul the mask position with numpy : 0.0007152557373046875 nb_pixel_total : 30371 time to create 1 rle with old method : 0.03610730171203613 length of segment : 320 time for calcul the mask position with numpy : 0.0006282329559326172 nb_pixel_total : 35864 time to create 1 rle with old method : 0.05532979965209961 length of segment : 272 time for calcul the mask position with numpy : 0.001005411148071289 nb_pixel_total : 38716 time to create 1 rle with old method : 0.045394182205200195 length of segment : 328 time for calcul the mask position with numpy : 0.0012264251708984375 nb_pixel_total : 77035 time to create 1 rle with old method : 0.08989787101745605 length of segment : 278 time for calcul the mask position with numpy : 0.0022275447845458984 nb_pixel_total : 136052 time to create 1 rle with old method : 0.1581277847290039 length of segment : 305 time for calcul the mask position with numpy : 0.004764080047607422 nb_pixel_total : 267273 time to create 1 rle with new method : 0.013000249862670898 length of segment : 690 time for calcul the mask position with numpy : 0.0012140274047851562 nb_pixel_total : 55907 time to create 1 rle with old method : 0.06560182571411133 length of segment : 317 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 41512 time to create 1 rle with old method : 0.04774951934814453 length of segment : 181 time for calcul the mask position with numpy : 0.0007128715515136719 nb_pixel_total : 32181 time to create 1 rle with old method : 0.03769063949584961 length of segment : 238 time for calcul the mask position with numpy : 0.0003247261047363281 nb_pixel_total : 13986 time to create 1 rle with old method : 0.01666259765625 length of segment : 149 time for calcul the mask position with numpy : 0.0012516975402832031 nb_pixel_total : 77714 time to create 1 rle with old method : 0.09189128875732422 length of segment : 217 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 12949 time to create 1 rle with old method : 0.01595330238342285 length of segment : 117 time for calcul the mask position with numpy : 0.0021882057189941406 nb_pixel_total : 13330 time to create 1 rle with old method : 0.018543004989624023 length of segment : 244 time for calcul the mask position with numpy : 0.003692150115966797 nb_pixel_total : 174822 time to create 1 rle with new method : 0.010057926177978516 length of segment : 324 time for calcul the mask position with numpy : 0.02499532699584961 nb_pixel_total : 73015 time to create 1 rle with old method : 0.08908438682556152 length of segment : 529 time for calcul the mask position with numpy : 0.0002143383026123047 nb_pixel_total : 10648 time to create 1 rle with old method : 0.012572050094604492 length of segment : 96 time for calcul the mask position with numpy : 0.009682893753051758 nb_pixel_total : 538753 time to create 1 rle with new method : 0.024906635284423828 length of segment : 1138 time for calcul the mask position with numpy : 0.0019032955169677734 nb_pixel_total : 87750 time to create 1 rle with old method : 0.12600135803222656 length of segment : 383 time for calcul the mask position with numpy : 0.0030257701873779297 nb_pixel_total : 209714 time to create 1 rle with new method : 0.0072820186614990234 length of segment : 439 time for calcul the mask position with numpy : 0.0007522106170654297 nb_pixel_total : 33706 time to create 1 rle with old method : 0.05542707443237305 length of segment : 194 time for calcul the mask position with numpy : 0.0027837753295898438 nb_pixel_total : 154032 time to create 1 rle with new method : 0.00782632827758789 length of segment : 329 time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 23879 time to create 1 rle with old method : 0.027714252471923828 length of segment : 145 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 23019 time to create 1 rle with old method : 0.027608633041381836 length of segment : 169 time for calcul the mask position with numpy : 0.0028934478759765625 nb_pixel_total : 168370 time to create 1 rle with new method : 0.008533477783203125 length of segment : 456 time for calcul the mask position with numpy : 0.003058195114135742 nb_pixel_total : 142453 time to create 1 rle with old method : 0.1666545867919922 length of segment : 380 time for calcul the mask position with numpy : 0.0006270408630371094 nb_pixel_total : 19324 time to create 1 rle with old method : 0.02327132225036621 length of segment : 177 time for calcul the mask position with numpy : 0.0012726783752441406 nb_pixel_total : 73821 time to create 1 rle with old method : 0.08592963218688965 length of segment : 254 time for calcul the mask position with numpy : 0.002804994583129883 nb_pixel_total : 154658 time to create 1 rle with new method : 0.008860111236572266 length of segment : 776 time for calcul the mask position with numpy : 0.027608633041381836 nb_pixel_total : 1496889 time to create 1 rle with new method : 0.22829771041870117 length of segment : 1298 time for calcul the mask position with numpy : 0.002494335174560547 nb_pixel_total : 122106 time to create 1 rle with old method : 0.14020442962646484 length of segment : 397 time for calcul the mask position with numpy : 0.001253366470336914 nb_pixel_total : 53915 time to create 1 rle with old method : 0.07552576065063477 length of segment : 243 time for calcul the mask position with numpy : 0.0025844573974609375 nb_pixel_total : 146360 time to create 1 rle with old method : 0.17165780067443848 length of segment : 308 time for calcul the mask position with numpy : 0.0008172988891601562 nb_pixel_total : 52263 time to create 1 rle with old method : 0.06225728988647461 length of segment : 138 time for calcul the mask position with numpy : 0.0023033618927001953 nb_pixel_total : 156596 time to create 1 rle with new method : 0.005585670471191406 length of segment : 431 time for calcul the mask position with numpy : 0.0032792091369628906 nb_pixel_total : 237138 time to create 1 rle with new method : 0.009086370468139648 length of segment : 282 time for calcul the mask position with numpy : 0.002082347869873047 nb_pixel_total : 88289 time to create 1 rle with old method : 0.10632610321044922 length of segment : 324 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 57231 time to create 1 rle with old method : 0.0675499439239502 length of segment : 275 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 76712 time to create 1 rle with old method : 0.11484932899475098 length of segment : 345 time for calcul the mask position with numpy : 0.005539417266845703 nb_pixel_total : 282106 time to create 1 rle with new method : 0.014267444610595703 length of segment : 696 time for calcul the mask position with numpy : 0.0010111331939697266 nb_pixel_total : 48411 time to create 1 rle with old method : 0.05771350860595703 length of segment : 231 time for calcul the mask position with numpy : 0.0024662017822265625 nb_pixel_total : 110712 time to create 1 rle with old method : 0.12947773933410645 length of segment : 363 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 252907 time to create 1 rle with new method : 0.016743183135986328 length of segment : 881 time for calcul the mask position with numpy : 0.0011034011840820312 nb_pixel_total : 49457 time to create 1 rle with old method : 0.057061195373535156 length of segment : 290 time for calcul the mask position with numpy : 0.0061185359954833984 nb_pixel_total : 326901 time to create 1 rle with new method : 0.017163753509521484 length of segment : 685 time for calcul the mask position with numpy : 0.0006477832794189453 nb_pixel_total : 27409 time to create 1 rle with old method : 0.03174018859863281 length of segment : 188 time for calcul the mask position with numpy : 0.0020685195922851562 nb_pixel_total : 89366 time to create 1 rle with old method : 0.12282252311706543 length of segment : 460 time for calcul the mask position with numpy : 0.013309001922607422 nb_pixel_total : 595743 time to create 1 rle with new method : 0.18954849243164062 length of segment : 1301 time for calcul the mask position with numpy : 0.0015006065368652344 nb_pixel_total : 48175 time to create 1 rle with old method : 0.055451154708862305 length of segment : 311 time for calcul the mask position with numpy : 0.0009341239929199219 nb_pixel_total : 33997 time to create 1 rle with old method : 0.040441274642944336 length of segment : 152 time for calcul the mask position with numpy : 0.002614736557006836 nb_pixel_total : 78317 time to create 1 rle with old method : 0.08974385261535645 length of segment : 333 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 72928 time to create 1 rle with old method : 0.09940838813781738 length of segment : 291 time for calcul the mask position with numpy : 0.0021140575408935547 nb_pixel_total : 95953 time to create 1 rle with old method : 0.11461091041564941 length of segment : 247 time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 16501 time to create 1 rle with old method : 0.025550365447998047 length of segment : 170 time for calcul the mask position with numpy : 0.0012006759643554688 nb_pixel_total : 30646 time to create 1 rle with old method : 0.042449235916137695 length of segment : 181 time for calcul the mask position with numpy : 0.0011022090911865234 nb_pixel_total : 47909 time to create 1 rle with old method : 0.0570065975189209 length of segment : 269 time for calcul the mask position with numpy : 0.001466512680053711 nb_pixel_total : 71451 time to create 1 rle with old method : 0.08371520042419434 length of segment : 300 time for calcul the mask position with numpy : 0.004058361053466797 nb_pixel_total : 148316 time to create 1 rle with old method : 0.171675443649292 length of segment : 1051 time for calcul the mask position with numpy : 0.0031404495239257812 nb_pixel_total : 68476 time to create 1 rle with old method : 0.09285879135131836 length of segment : 578 time for calcul the mask position with numpy : 0.0031473636627197266 nb_pixel_total : 140242 time to create 1 rle with old method : 0.16315388679504395 length of segment : 508 time for calcul the mask position with numpy : 0.0008325576782226562 nb_pixel_total : 20756 time to create 1 rle with old method : 0.02515554428100586 length of segment : 186 time for calcul the mask position with numpy : 0.0010983943939208984 nb_pixel_total : 45888 time to create 1 rle with old method : 0.05450439453125 length of segment : 254 time for calcul the mask position with numpy : 0.0003533363342285156 nb_pixel_total : 6614 time to create 1 rle with old method : 0.008112907409667969 length of segment : 308 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 13676 time to create 1 rle with old method : 0.016561031341552734 length of segment : 125 time for calcul the mask position with numpy : 0.0011570453643798828 nb_pixel_total : 52139 time to create 1 rle with old method : 0.0619962215423584 length of segment : 258 time for calcul the mask position with numpy : 0.0010905265808105469 nb_pixel_total : 56044 time to create 1 rle with old method : 0.06691217422485352 length of segment : 268 time for calcul the mask position with numpy : 0.0017535686492919922 nb_pixel_total : 83801 time to create 1 rle with old method : 0.09870672225952148 length of segment : 277 time for calcul the mask position with numpy : 0.0018815994262695312 nb_pixel_total : 90495 time to create 1 rle with old method : 0.10857486724853516 length of segment : 242 time for calcul the mask position with numpy : 0.002990245819091797 nb_pixel_total : 136052 time to create 1 rle with old method : 0.17888545989990234 length of segment : 340 time for calcul the mask position with numpy : 0.0021085739135742188 nb_pixel_total : 61172 time to create 1 rle with old method : 0.07502055168151855 length of segment : 485 time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 26665 time to create 1 rle with old method : 0.03127431869506836 length of segment : 239 time for calcul the mask position with numpy : 0.005930185317993164 nb_pixel_total : 297732 time to create 1 rle with new method : 0.017229318618774414 length of segment : 656 time for calcul the mask position with numpy : 0.005822658538818359 nb_pixel_total : 281749 time to create 1 rle with new method : 0.016319990158081055 length of segment : 556 time for calcul the mask position with numpy : 0.004256725311279297 nb_pixel_total : 229113 time to create 1 rle with new method : 0.011733055114746094 length of segment : 494 time for calcul the mask position with numpy : 0.0016021728515625 nb_pixel_total : 77849 time to create 1 rle with old method : 0.09000372886657715 length of segment : 521 time for calcul the mask position with numpy : 0.0005309581756591797 nb_pixel_total : 26823 time to create 1 rle with old method : 0.03187823295593262 length of segment : 159 time for calcul the mask position with numpy : 0.0042154788970947266 nb_pixel_total : 238242 time to create 1 rle with new method : 0.013945341110229492 length of segment : 713 time for calcul the mask position with numpy : 0.013085126876831055 nb_pixel_total : 368349 time to create 1 rle with new method : 0.05583071708679199 length of segment : 1012 time for calcul the mask position with numpy : 0.00842595100402832 nb_pixel_total : 490238 time to create 1 rle with new method : 0.020555973052978516 length of segment : 617 time for calcul the mask position with numpy : 0.004143714904785156 nb_pixel_total : 281178 time to create 1 rle with new method : 0.011963367462158203 length of segment : 557 time for calcul the mask position with numpy : 0.0048983097076416016 nb_pixel_total : 233428 time to create 1 rle with new method : 0.014780282974243164 length of segment : 621 time for calcul the mask position with numpy : 0.0010399818420410156 nb_pixel_total : 56213 time to create 1 rle with old method : 0.06697702407836914 length of segment : 261 time for calcul the mask position with numpy : 0.0004169940948486328 nb_pixel_total : 19250 time to create 1 rle with old method : 0.02310323715209961 length of segment : 235 time for calcul the mask position with numpy : 0.004171133041381836 nb_pixel_total : 59932 time to create 1 rle with old method : 0.07535862922668457 length of segment : 227 time for calcul the mask position with numpy : 0.0013785362243652344 nb_pixel_total : 62762 time to create 1 rle with old method : 0.07593894004821777 length of segment : 303 time for calcul the mask position with numpy : 0.0015704631805419922 nb_pixel_total : 72635 time to create 1 rle with old method : 0.08544754981994629 length of segment : 215 time for calcul the mask position with numpy : 0.0010943412780761719 nb_pixel_total : 60049 time to create 1 rle with old method : 0.07122015953063965 length of segment : 275 time for calcul the mask position with numpy : 0.0011284351348876953 nb_pixel_total : 63912 time to create 1 rle with old method : 0.0761110782623291 length of segment : 200 time for calcul the mask position with numpy : 0.0028524398803710938 nb_pixel_total : 152164 time to create 1 rle with new method : 0.009156942367553711 length of segment : 467 time for calcul the mask position with numpy : 0.0011360645294189453 nb_pixel_total : 36337 time to create 1 rle with old method : 0.05045032501220703 length of segment : 290 time for calcul the mask position with numpy : 0.043557167053222656 nb_pixel_total : 2008538 time to create 1 rle with new method : 0.4664785861968994 length of segment : 1301 time for calcul the mask position with numpy : 0.0013904571533203125 nb_pixel_total : 62449 time to create 1 rle with old method : 0.07563638687133789 length of segment : 210 time for calcul the mask position with numpy : 0.027071714401245117 nb_pixel_total : 1609110 time to create 1 rle with new method : 0.23769140243530273 length of segment : 2714 time for calcul the mask position with numpy : 0.0010194778442382812 nb_pixel_total : 61422 time to create 1 rle with old method : 0.08408212661743164 length of segment : 224 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 8322 time to create 1 rle with old method : 0.009581327438354492 length of segment : 105 time for calcul the mask position with numpy : 0.0008287429809570312 nb_pixel_total : 52859 time to create 1 rle with old method : 0.060975074768066406 length of segment : 226 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 22229 time to create 1 rle with old method : 0.026577234268188477 length of segment : 188 time for calcul the mask position with numpy : 0.002590179443359375 nb_pixel_total : 125611 time to create 1 rle with old method : 0.1425008773803711 length of segment : 361 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 65261 time to create 1 rle with old method : 0.07267570495605469 length of segment : 258 time for calcul the mask position with numpy : 0.0016241073608398438 nb_pixel_total : 85381 time to create 1 rle with old method : 0.0976555347442627 length of segment : 352 time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 46341 time to create 1 rle with old method : 0.05460190773010254 length of segment : 253 time for calcul the mask position with numpy : 0.0013794898986816406 nb_pixel_total : 66462 time to create 1 rle with old method : 0.08050417900085449 length of segment : 267 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 58430 time to create 1 rle with old method : 0.06807494163513184 length of segment : 211 time for calcul the mask position with numpy : 0.0033714771270751953 nb_pixel_total : 184244 time to create 1 rle with new method : 0.010615825653076172 length of segment : 500 time for calcul the mask position with numpy : 0.0015571117401123047 nb_pixel_total : 87090 time to create 1 rle with old method : 0.10246682167053223 length of segment : 327 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 25067 time to create 1 rle with old method : 0.029384374618530273 length of segment : 154 time for calcul the mask position with numpy : 0.0008327960968017578 nb_pixel_total : 49136 time to create 1 rle with old method : 0.05705547332763672 length of segment : 245 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 22689 time to create 1 rle with old method : 0.02612614631652832 length of segment : 117 time for calcul the mask position with numpy : 0.0009329319000244141 nb_pixel_total : 51680 time to create 1 rle with old method : 0.06100153923034668 length of segment : 241 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 80438 time to create 1 rle with old method : 0.09562063217163086 length of segment : 299 time for calcul the mask position with numpy : 0.002646207809448242 nb_pixel_total : 138885 time to create 1 rle with old method : 0.19831395149230957 length of segment : 731 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 46004 time to create 1 rle with old method : 0.054686784744262695 length of segment : 172 time for calcul the mask position with numpy : 0.0011065006256103516 nb_pixel_total : 50306 time to create 1 rle with old method : 0.05984902381896973 length of segment : 216 time for calcul the mask position with numpy : 0.0007269382476806641 nb_pixel_total : 44081 time to create 1 rle with old method : 0.051552772521972656 length of segment : 256 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 39421 time to create 1 rle with old method : 0.046628713607788086 length of segment : 260 time for calcul the mask position with numpy : 0.0013871192932128906 nb_pixel_total : 79527 time to create 1 rle with old method : 0.09175539016723633 length of segment : 360 time for calcul the mask position with numpy : 0.0023305416107177734 nb_pixel_total : 126280 time to create 1 rle with old method : 0.14477229118347168 length of segment : 733 time for calcul the mask position with numpy : 0.000965118408203125 nb_pixel_total : 69619 time to create 1 rle with old method : 0.08056879043579102 length of segment : 207 time for calcul the mask position with numpy : 0.22715306282043457 nb_pixel_total : 2636251 time to create 1 rle with new method : 1.1944122314453125 length of segment : 2397 time for calcul the mask position with numpy : 0.012615680694580078 nb_pixel_total : 1006222 time to create 1 rle with new method : 0.17515206336975098 length of segment : 800 time for calcul the mask position with numpy : 0.0032813549041748047 nb_pixel_total : 97756 time to create 1 rle with old method : 0.11568975448608398 length of segment : 924 time for calcul the mask position with numpy : 0.0056972503662109375 nb_pixel_total : 430150 time to create 1 rle with new method : 0.013376712799072266 length of segment : 552 time for calcul the mask position with numpy : 0.0007188320159912109 nb_pixel_total : 43534 time to create 1 rle with old method : 0.08721303939819336 length of segment : 260 time for calcul the mask position with numpy : 0.0016868114471435547 nb_pixel_total : 98853 time to create 1 rle with old method : 0.12034058570861816 length of segment : 738 time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 61921 time to create 1 rle with old method : 0.08710527420043945 length of segment : 281 time for calcul the mask position with numpy : 0.0002760887145996094 nb_pixel_total : 17969 time to create 1 rle with old method : 0.021002769470214844 length of segment : 100 time for calcul the mask position with numpy : 0.0011169910430908203 nb_pixel_total : 86515 time to create 1 rle with old method : 0.10646438598632812 length of segment : 161 time for calcul the mask position with numpy : 0.015921354293823242 nb_pixel_total : 836931 time to create 1 rle with new method : 0.2662849426269531 length of segment : 1429 time for calcul the mask position with numpy : 0.003710508346557617 nb_pixel_total : 244984 time to create 1 rle with new method : 0.009632110595703125 length of segment : 653 time spent for convertir_results : 58.546109437942505 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 396 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 151.05439376831055 time spend to save output : 0.22785043716430664 total time spend for step 2 : 151.28224420547485 step3:blur_detection Sat May 10 15:45:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 4160) 5778.486382188189 (3120, 4160) 3445.0903965308653 (3120, 4160) 2482.35324710808 (3120, 4160) 4617.151222151328 (3120, 4160) 6632.295719567364 (3120, 4160) 1829.8762900085183 (3120, 4160) 3291.768159970664 (3120, 4160) 1860.9160606408475 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.013518333435058594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.013353824615478516 save missing photos in datou_result : time spend for datou_step_exec : 3.627028703689575 time spend to save output : 0.0323948860168457 total time spend for step 3 : 3.659423589706421 step4:brightness Sat May 10 15:45:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746884486_206975_1357486095_09bfaf89ec53995b9d2c2802011bd636.jpg treat image : temp/1746884486_206975_1357486091_60c5c545bd41653f86fb36e2b81f1e0b.jpg treat image : temp/1746884486_206975_1357486076_14a3e821083a1eda03c63f0666f5f738.jpg treat image : temp/1746884486_206975_1357486070_07b9fd6fcc0cb8333db98571f738d362.jpg treat image : temp/1746884486_206975_1357486066_449dbbee789e8d544ff3de0810732775.jpg treat image : temp/1746884486_206975_1357486061_9e0b4d6c9851360184f7aa6cda513a23.jpg treat image : temp/1746884486_206975_1357486055_b168733e56133719e3568266592d62dc.jpg treat image : temp/1746884486_206975_1357486051_2a6a491fd221552bbf55f0b7a7e4f567.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.013739585876464844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.01574087142944336 save missing photos in datou_result : time spend for datou_step_exec : 12.573472499847412 time spend to save output : 0.03419923782348633 total time spend for step 4 : 12.607671737670898 step5:rle_unique_nms_with_priority Sat May 10 15:45:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 396 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 40 nb_hashtags : 8 time to prepare the origin masks : 32.749247312545776 time for calcul the mask position with numpy : 0.628406286239624 nb_pixel_total : 8259013 time to create 1 rle with new method : 1.274465560913086 time for calcul the mask position with numpy : 0.12046146392822266 nb_pixel_total : 846740 time to create 1 rle with new method : 1.3196516036987305 time for calcul the mask position with numpy : 0.05341076850891113 nb_pixel_total : 71884 time to create 1 rle with old method : 0.08124518394470215 time for calcul the mask position with numpy : 0.05305600166320801 nb_pixel_total : 187427 time to create 1 rle with new method : 1.106034517288208 time for calcul the mask position with numpy : 0.05051064491271973 nb_pixel_total : 3940 time to create 1 rle with old method : 0.004968166351318359 time for calcul the mask position with numpy : 0.05799722671508789 nb_pixel_total : 991068 time to create 1 rle with new method : 0.8880116939544678 time for calcul the mask position with numpy : 0.05520820617675781 nb_pixel_total : 370759 time to create 1 rle with new method : 1.1621246337890625 time for calcul the mask position with numpy : 0.05417060852050781 nb_pixel_total : 95219 time to create 1 rle with old method : 0.10660099983215332 time for calcul the mask position with numpy : 0.05213046073913574 nb_pixel_total : 14197 time to create 1 rle with old method : 0.016199588775634766 time for calcul the mask position with numpy : 0.05254840850830078 nb_pixel_total : 24317 time to create 1 rle with old method : 0.030293941497802734 time for calcul the mask position with numpy : 0.05351138114929199 nb_pixel_total : 94622 time to create 1 rle with old method : 0.10645675659179688 time for calcul the mask position with numpy : 0.0515894889831543 nb_pixel_total : 12053 time to create 1 rle with old method : 0.01403498649597168 time for calcul the mask position with numpy : 0.05352067947387695 nb_pixel_total : 12917 time to create 1 rle with old method : 0.014679908752441406 time for calcul the mask position with numpy : 0.05087137222290039 nb_pixel_total : 21579 time to create 1 rle with old method : 0.025582313537597656 time for calcul the mask position with numpy : 0.05156445503234863 nb_pixel_total : 147559 time to create 1 rle with old method : 0.1767287254333496 time for calcul the mask position with numpy : 0.051827192306518555 nb_pixel_total : 16766 time to create 1 rle with old method : 0.019727468490600586 time for calcul the mask position with numpy : 0.05364632606506348 nb_pixel_total : 225539 time to create 1 rle with new method : 1.0479416847229004 time for calcul the mask position with numpy : 0.05189323425292969 nb_pixel_total : 4889 time to create 1 rle with old method : 0.005450725555419922 time for calcul the mask position with numpy : 0.051723480224609375 nb_pixel_total : 84260 time to create 1 rle with old method : 0.09682989120483398 time for calcul the mask position with numpy : 0.05253338813781738 nb_pixel_total : 88375 time to create 1 rle with old method : 0.1041407585144043 time for calcul the mask position with numpy : 0.054628610610961914 nb_pixel_total : 35544 time to create 1 rle with old method : 0.0407557487487793 time for calcul the mask position with numpy : 0.05303215980529785 nb_pixel_total : 116504 time to create 1 rle with old method : 0.13318133354187012 time for calcul the mask position with numpy : 0.051959991455078125 nb_pixel_total : 55987 time to create 1 rle with old method : 0.06351280212402344 time for calcul the mask position with numpy : 0.05515480041503906 nb_pixel_total : 315271 time to create 1 rle with new method : 1.3419594764709473 time for calcul the mask position with numpy : 0.05228304862976074 nb_pixel_total : 51823 time to create 1 rle with old method : 0.059401512145996094 time for calcul the mask position with numpy : 0.054053544998168945 nb_pixel_total : 15027 time to create 1 rle with old method : 0.017686843872070312 time for calcul the mask position with numpy : 0.05434012413024902 nb_pixel_total : 98509 time to create 1 rle with old method : 0.11862897872924805 time for calcul the mask position with numpy : 0.05296444892883301 nb_pixel_total : 103826 time to create 1 rle with old method : 0.12037181854248047 time for calcul the mask position with numpy : 0.05389761924743652 nb_pixel_total : 83046 time to create 1 rle with old method : 0.10259461402893066 time for calcul the mask position with numpy : 0.05386519432067871 nb_pixel_total : 28902 time to create 1 rle with old method : 0.033376216888427734 time for calcul the mask position with numpy : 0.05353093147277832 nb_pixel_total : 45580 time to create 1 rle with old method : 0.05351591110229492 time for calcul the mask position with numpy : 0.05212235450744629 nb_pixel_total : 51417 time to create 1 rle with old method : 0.0603024959564209 time for calcul the mask position with numpy : 0.05347800254821777 nb_pixel_total : 87158 time to create 1 rle with old method : 0.10003328323364258 time for calcul the mask position with numpy : 0.053620100021362305 nb_pixel_total : 32936 time to create 1 rle with old method : 0.03708767890930176 time for calcul the mask position with numpy : 0.05224323272705078 nb_pixel_total : 43351 time to create 1 rle with old method : 0.049704790115356445 time for calcul the mask position with numpy : 0.05292987823486328 nb_pixel_total : 36645 time to create 1 rle with old method : 0.042020320892333984 time for calcul the mask position with numpy : 0.05320334434509277 nb_pixel_total : 26327 time to create 1 rle with old method : 0.03121638298034668 time for calcul the mask position with numpy : 0.05317497253417969 nb_pixel_total : 27938 time to create 1 rle with old method : 0.03148818016052246 time for calcul the mask position with numpy : 0.0518648624420166 nb_pixel_total : 429 time to create 1 rle with old method : 0.0008265972137451172 time for calcul the mask position with numpy : 0.05253291130065918 nb_pixel_total : 88419 time to create 1 rle with old method : 0.10054492950439453 time for calcul the mask position with numpy : 0.05251717567443848 nb_pixel_total : 61438 time to create 1 rle with old method : 0.06954360008239746 create new chi : 13.385130882263184 time to delete rle : 0.06815314292907715 batch 1 Loaded 41 chid ids of type : 4855 Number RLEs to save : 28167 TO DO : save crop sub photo not yet done ! save time : 1.6494786739349365 nb_obj : 45 nb_hashtags : 7 time to prepare the origin masks : 42.48863863945007 time for calcul the mask position with numpy : 0.379192590713501 nb_pixel_total : 4509628 time to create 1 rle with new method : 1.7255079746246338 time for calcul the mask position with numpy : 0.06586003303527832 nb_pixel_total : 424474 time to create 1 rle with new method : 1.3153738975524902 time for calcul the mask position with numpy : 0.2930142879486084 nb_pixel_total : 2771003 time to create 1 rle with new method : 1.9240880012512207 time for calcul the mask position with numpy : 0.18372488021850586 nb_pixel_total : 1385122 time to create 1 rle with new method : 1.3054890632629395 time for calcul the mask position with numpy : 0.05278968811035156 nb_pixel_total : 337321 time to create 1 rle with new method : 1.101133108139038 time for calcul the mask position with numpy : 0.054181575775146484 nb_pixel_total : 61452 time to create 1 rle with old method : 0.07085490226745605 time for calcul the mask position with numpy : 0.05386614799499512 nb_pixel_total : 49807 time to create 1 rle with old method : 0.05895543098449707 time for calcul the mask position with numpy : 0.05364656448364258 nb_pixel_total : 11017 time to create 1 rle with old method : 0.013799428939819336 time for calcul the mask position with numpy : 0.053624629974365234 nb_pixel_total : 67086 time to create 1 rle with old method : 0.07891583442687988 time for calcul the mask position with numpy : 0.0534663200378418 nb_pixel_total : 1974 time to create 1 rle with old method : 0.0026369094848632812 time for calcul the mask position with numpy : 0.053417205810546875 nb_pixel_total : 3835 time to create 1 rle with old method : 0.004665851593017578 time for calcul the mask position with numpy : 0.05621480941772461 nb_pixel_total : 19590 time to create 1 rle with old method : 0.03330659866333008 time for calcul the mask position with numpy : 0.0611119270324707 nb_pixel_total : 11254 time to create 1 rle with old method : 0.013637304306030273 time for calcul the mask position with numpy : 0.053308963775634766 nb_pixel_total : 2273 time to create 1 rle with old method : 0.003008604049682617 time for calcul the mask position with numpy : 0.05295300483703613 nb_pixel_total : 71120 time to create 1 rle with old method : 0.08294820785522461 time for calcul the mask position with numpy : 0.05359649658203125 nb_pixel_total : 46184 time to create 1 rle with old method : 0.055292367935180664 time for calcul the mask position with numpy : 0.05494093894958496 nb_pixel_total : 329215 time to create 1 rle with new method : 1.8546388149261475 time for calcul the mask position with numpy : 0.05388164520263672 nb_pixel_total : 30053 time to create 1 rle with old method : 0.035129547119140625 time for calcul the mask position with numpy : 0.05343770980834961 nb_pixel_total : 27760 time to create 1 rle with old method : 0.03239083290100098 time for calcul the mask position with numpy : 0.052782535552978516 nb_pixel_total : 164089 time to create 1 rle with new method : 1.5822813510894775 time for calcul the mask position with numpy : 0.05261802673339844 nb_pixel_total : 1077 time to create 1 rle with old method : 0.001519918441772461 time for calcul the mask position with numpy : 0.055436134338378906 nb_pixel_total : 5460 time to create 1 rle with old method : 0.0065135955810546875 time for calcul the mask position with numpy : 0.05500388145446777 nb_pixel_total : 97018 time to create 1 rle with old method : 0.10822129249572754 time for calcul the mask position with numpy : 0.05253720283508301 nb_pixel_total : 117769 time to create 1 rle with old method : 0.13190770149230957 time for calcul the mask position with numpy : 0.059793949127197266 nb_pixel_total : 4347 time to create 1 rle with old method : 0.005299568176269531 time for calcul the mask position with numpy : 0.0527491569519043 nb_pixel_total : 18922 time to create 1 rle with old method : 0.021314144134521484 time for calcul the mask position with numpy : 0.051898956298828125 nb_pixel_total : 10275 time to create 1 rle with old method : 0.01180410385131836 time for calcul the mask position with numpy : 0.05109143257141113 nb_pixel_total : 38659 time to create 1 rle with old method : 0.04359936714172363 time for calcul the mask position with numpy : 0.051783084869384766 nb_pixel_total : 97359 time to create 1 rle with old method : 0.10529327392578125 time for calcul the mask position with numpy : 0.051010847091674805 nb_pixel_total : 40522 time to create 1 rle with old method : 0.0451509952545166 time for calcul the mask position with numpy : 0.058916330337524414 nb_pixel_total : 174348 time to create 1 rle with new method : 0.9911277294158936 time for calcul the mask position with numpy : 0.05113101005554199 nb_pixel_total : 81179 time to create 1 rle with old method : 0.08774304389953613 time for calcul the mask position with numpy : 0.05019521713256836 nb_pixel_total : 21987 time to create 1 rle with old method : 0.024051666259765625 time for calcul the mask position with numpy : 0.0504145622253418 nb_pixel_total : 41034 time to create 1 rle with old method : 0.044296979904174805 time for calcul the mask position with numpy : 0.04958009719848633 nb_pixel_total : 3492 time to create 1 rle with old method : 0.00423121452331543 time for calcul the mask position with numpy : 0.06285643577575684 nb_pixel_total : 1560868 time to create 1 rle with new method : 0.965623140335083 time for calcul the mask position with numpy : 0.05084037780761719 nb_pixel_total : 17842 time to create 1 rle with old method : 0.019271373748779297 time for calcul the mask position with numpy : 0.051433563232421875 nb_pixel_total : 59031 time to create 1 rle with old method : 0.06367206573486328 time for calcul the mask position with numpy : 0.0504302978515625 nb_pixel_total : 8252 time to create 1 rle with old method : 0.009690999984741211 time for calcul the mask position with numpy : 0.050716400146484375 nb_pixel_total : 4949 time to create 1 rle with old method : 0.005384206771850586 time for calcul the mask position with numpy : 0.05051112174987793 nb_pixel_total : 45906 time to create 1 rle with old method : 0.04968428611755371 time for calcul the mask position with numpy : 0.05073809623718262 nb_pixel_total : 105675 time to create 1 rle with old method : 0.11459088325500488 time for calcul the mask position with numpy : 0.05048012733459473 nb_pixel_total : 10691 time to create 1 rle with old method : 0.011962890625 time for calcul the mask position with numpy : 0.05084061622619629 nb_pixel_total : 29140 time to create 1 rle with old method : 0.03221297264099121 time for calcul the mask position with numpy : 0.050891876220703125 nb_pixel_total : 47661 time to create 1 rle with old method : 0.05182790756225586 time for calcul the mask position with numpy : 0.04983067512512207 nb_pixel_total : 11480 time to create 1 rle with old method : 0.012444019317626953 create new chi : 17.834341764450073 time to delete rle : 0.0028142929077148438 batch 1 Loaded 46 chid ids of type : 4855 Number RLEs to save : 30369 TO DO : save crop sub photo not yet done ! save time : 1.7158141136169434 nb_obj : 75 nb_hashtags : 8 time to prepare the origin masks : 60.240511417388916 time for calcul the mask position with numpy : 0.3683350086212158 nb_pixel_total : 5918353 time to create 1 rle with new method : 1.3368160724639893 time for calcul the mask position with numpy : 0.0498661994934082 nb_pixel_total : 5372 time to create 1 rle with old method : 0.006040096282958984 time for calcul the mask position with numpy : 0.05113720893859863 nb_pixel_total : 35814 time to create 1 rle with old method : 0.04073619842529297 time for calcul the mask position with numpy : 0.053366661071777344 nb_pixel_total : 188277 time to create 1 rle with new method : 1.3280763626098633 time for calcul the mask position with numpy : 0.05457425117492676 nb_pixel_total : 182372 time to create 1 rle with new method : 1.0227165222167969 time for calcul the mask position with numpy : 0.1630392074584961 nb_pixel_total : 434166 time to create 1 rle with new method : 1.0042967796325684 time for calcul the mask position with numpy : 0.05182933807373047 nb_pixel_total : 362 time to create 1 rle with old method : 0.0006272792816162109 time for calcul the mask position with numpy : 0.0514678955078125 nb_pixel_total : 5331 time to create 1 rle with old method : 0.006029367446899414 time for calcul the mask position with numpy : 0.05191206932067871 nb_pixel_total : 38642 time to create 1 rle with old method : 0.04401850700378418 time for calcul the mask position with numpy : 0.05777239799499512 nb_pixel_total : 54785 time to create 1 rle with old method : 0.07590317726135254 time for calcul the mask position with numpy : 0.05336880683898926 nb_pixel_total : 43466 time to create 1 rle with old method : 0.049652099609375 time for calcul the mask position with numpy : 0.061441659927368164 nb_pixel_total : 722218 time to create 1 rle with new method : 1.299079179763794 time for calcul the mask position with numpy : 0.055135488510131836 nb_pixel_total : 36063 time to create 1 rle with old method : 0.04236245155334473 time for calcul the mask position with numpy : 0.06026816368103027 nb_pixel_total : 14518 time to create 1 rle with old method : 0.023327112197875977 time for calcul the mask position with numpy : 0.05917620658874512 nb_pixel_total : 13714 time to create 1 rle with old method : 0.07293176651000977 time for calcul the mask position with numpy : 0.07576656341552734 nb_pixel_total : 54893 time to create 1 rle with old method : 0.06585502624511719 time for calcul the mask position with numpy : 0.053873300552368164 nb_pixel_total : 21641 time to create 1 rle with old method : 0.028943300247192383 time for calcul the mask position with numpy : 0.05712246894836426 nb_pixel_total : 110517 time to create 1 rle with old method : 0.19916224479675293 time for calcul the mask position with numpy : 0.05388188362121582 nb_pixel_total : 22498 time to create 1 rle with old method : 0.0265347957611084 time for calcul the mask position with numpy : 0.05390763282775879 nb_pixel_total : 116503 time to create 1 rle with old method : 0.13568830490112305 time for calcul the mask position with numpy : 0.054440975189208984 nb_pixel_total : 2 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.06644392013549805 nb_pixel_total : 89322 time to create 1 rle with old method : 0.1042335033416748 time for calcul the mask position with numpy : 0.05743122100830078 nb_pixel_total : 232782 time to create 1 rle with new method : 2.287838935852051 time for calcul the mask position with numpy : 0.05743050575256348 nb_pixel_total : 46045 time to create 1 rle with old method : 0.05458998680114746 time for calcul the mask position with numpy : 0.05566978454589844 nb_pixel_total : 30098 time to create 1 rle with old method : 0.03489232063293457 time for calcul the mask position with numpy : 0.05142998695373535 nb_pixel_total : 54916 time to create 1 rle with old method : 0.061691999435424805 time for calcul the mask position with numpy : 0.05118918418884277 nb_pixel_total : 43360 time to create 1 rle with old method : 0.05217385292053223 time for calcul the mask position with numpy : 0.0588984489440918 nb_pixel_total : 20980 time to create 1 rle with old method : 0.02420330047607422 time for calcul the mask position with numpy : 0.05289721488952637 nb_pixel_total : 19260 time to create 1 rle with old method : 0.022803544998168945 time for calcul the mask position with numpy : 0.05590510368347168 nb_pixel_total : 289139 time to create 1 rle with new method : 0.9365439414978027 time for calcul the mask position with numpy : 0.050199270248413086 nb_pixel_total : 26443 time to create 1 rle with old method : 0.030080080032348633 time for calcul the mask position with numpy : 0.05083799362182617 nb_pixel_total : 35353 time to create 1 rle with old method : 0.03863668441772461 time for calcul the mask position with numpy : 0.04936647415161133 nb_pixel_total : 66897 time to create 1 rle with old method : 0.07514429092407227 time for calcul the mask position with numpy : 0.04903006553649902 nb_pixel_total : 23158 time to create 1 rle with old method : 0.025861024856567383 time for calcul the mask position with numpy : 0.051291704177856445 nb_pixel_total : 21727 time to create 1 rle with old method : 0.025467634201049805 time for calcul the mask position with numpy : 0.052559852600097656 nb_pixel_total : 146381 time to create 1 rle with old method : 0.16518807411193848 time for calcul the mask position with numpy : 0.05127859115600586 nb_pixel_total : 2292 time to create 1 rle with old method : 0.00310516357421875 time for calcul the mask position with numpy : 0.05043959617614746 nb_pixel_total : 19586 time to create 1 rle with old method : 0.02182936668395996 time for calcul the mask position with numpy : 0.04958343505859375 nb_pixel_total : 88 time to create 1 rle with old method : 0.00013327598571777344 time for calcul the mask position with numpy : 0.05132746696472168 nb_pixel_total : 90052 time to create 1 rle with old method : 0.10067272186279297 time for calcul the mask position with numpy : 0.05184006690979004 nb_pixel_total : 56882 time to create 1 rle with old method : 0.06612300872802734 time for calcul the mask position with numpy : 0.052899837493896484 nb_pixel_total : 25809 time to create 1 rle with old method : 0.029436349868774414 time for calcul the mask position with numpy : 0.05181765556335449 nb_pixel_total : 21123 time to create 1 rle with old method : 0.024129867553710938 time for calcul the mask position with numpy : 0.05221819877624512 nb_pixel_total : 3335 time to create 1 rle with old method : 0.003979206085205078 time for calcul the mask position with numpy : 0.05201292037963867 nb_pixel_total : 116972 time to create 1 rle with old method : 0.13409733772277832 time for calcul the mask position with numpy : 0.06448912620544434 nb_pixel_total : 562149 time to create 1 rle with new method : 1.1134929656982422 time for calcul the mask position with numpy : 0.05897665023803711 nb_pixel_total : 249270 time to create 1 rle with new method : 1.0601024627685547 time for calcul the mask position with numpy : 0.05549788475036621 nb_pixel_total : 61891 time to create 1 rle with old method : 0.07122087478637695 time for calcul the mask position with numpy : 0.05439925193786621 nb_pixel_total : 8259 time to create 1 rle with old method : 0.009769916534423828 time for calcul the mask position with numpy : 0.054730892181396484 nb_pixel_total : 22827 time to create 1 rle with old method : 0.027640104293823242 time for calcul the mask position with numpy : 0.05464982986450195 nb_pixel_total : 21266 time to create 1 rle with old method : 0.02509474754333496 time for calcul the mask position with numpy : 0.054862260818481445 nb_pixel_total : 37946 time to create 1 rle with old method : 0.04397153854370117 time for calcul the mask position with numpy : 0.05684804916381836 nb_pixel_total : 7284 time to create 1 rle with old method : 0.009023189544677734 time for calcul the mask position with numpy : 0.055880069732666016 nb_pixel_total : 70099 time to create 1 rle with old method : 0.09079670906066895 time for calcul the mask position with numpy : 0.053917646408081055 nb_pixel_total : 92546 time to create 1 rle with old method : 0.10820627212524414 time for calcul the mask position with numpy : 0.0539700984954834 nb_pixel_total : 57426 time to create 1 rle with old method : 0.06949830055236816 time for calcul the mask position with numpy : 0.05355429649353027 nb_pixel_total : 96435 time to create 1 rle with old method : 0.1108405590057373 time for calcul the mask position with numpy : 0.05288410186767578 nb_pixel_total : 377234 time to create 1 rle with new method : 1.301605463027954 time for calcul the mask position with numpy : 0.05041790008544922 nb_pixel_total : 17187 time to create 1 rle with old method : 0.019497394561767578 time for calcul the mask position with numpy : 0.05217146873474121 nb_pixel_total : 87438 time to create 1 rle with old method : 0.09768414497375488 time for calcul the mask position with numpy : 0.05206465721130371 nb_pixel_total : 52318 time to create 1 rle with old method : 0.058707475662231445 time for calcul the mask position with numpy : 0.052050113677978516 nb_pixel_total : 135633 time to create 1 rle with old method : 0.15278100967407227 time for calcul the mask position with numpy : 0.052709102630615234 nb_pixel_total : 100198 time to create 1 rle with old method : 0.11205434799194336 time for calcul the mask position with numpy : 0.053406715393066406 nb_pixel_total : 425884 time to create 1 rle with new method : 1.3731129169464111 time for calcul the mask position with numpy : 0.053609609603881836 nb_pixel_total : 311179 time to create 1 rle with new method : 1.3029084205627441 time for calcul the mask position with numpy : 0.0536653995513916 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0022351741790771484 time for calcul the mask position with numpy : 0.05458712577819824 nb_pixel_total : 154249 time to create 1 rle with new method : 0.9424357414245605 time for calcul the mask position with numpy : 0.05139493942260742 nb_pixel_total : 76166 time to create 1 rle with old method : 0.08809351921081543 time for calcul the mask position with numpy : 0.05189037322998047 nb_pixel_total : 9085 time to create 1 rle with old method : 0.010690450668334961 time for calcul the mask position with numpy : 0.053615570068359375 nb_pixel_total : 143039 time to create 1 rle with old method : 0.15941548347473145 time for calcul the mask position with numpy : 0.05390357971191406 nb_pixel_total : 156238 time to create 1 rle with new method : 1.1213304996490479 time for calcul the mask position with numpy : 0.05348968505859375 nb_pixel_total : 60063 time to create 1 rle with old method : 0.06894040107727051 time for calcul the mask position with numpy : 0.052094221115112305 nb_pixel_total : 58701 time to create 1 rle with old method : 0.06587576866149902 time for calcul the mask position with numpy : 0.051372528076171875 nb_pixel_total : 1 time to create 1 rle with old method : 2.193450927734375e-05 time for calcul the mask position with numpy : 0.05166339874267578 nb_pixel_total : 2515 time to create 1 rle with old method : 0.002956390380859375 time for calcul the mask position with numpy : 0.052007436752319336 nb_pixel_total : 21677 time to create 1 rle with old method : 0.025604248046875 create new chi : 25.940726280212402 time to delete rle : 0.007111787796020508 batch 1 Loaded 76 chid ids of type : 4855 Number RLEs to save : 48841 TO DO : save crop sub photo not yet done ! save time : 4.514724254608154 nb_obj : 57 nb_hashtags : 7 time to prepare the origin masks : 44.5284698009491 time for calcul the mask position with numpy : 0.49098968505859375 nb_pixel_total : 4855358 time to create 1 rle with new method : 1.64168119430542 time for calcul the mask position with numpy : 0.0524442195892334 nb_pixel_total : 33475 time to create 1 rle with old method : 0.03969883918762207 time for calcul the mask position with numpy : 0.07261848449707031 nb_pixel_total : 1804045 time to create 1 rle with new method : 1.3728349208831787 time for calcul the mask position with numpy : 0.05167436599731445 nb_pixel_total : 97457 time to create 1 rle with old method : 0.10890030860900879 time for calcul the mask position with numpy : 0.05091738700866699 nb_pixel_total : 263718 time to create 1 rle with new method : 1.0686335563659668 time for calcul the mask position with numpy : 0.05065107345581055 nb_pixel_total : 212242 time to create 1 rle with new method : 1.1777150630950928 time for calcul the mask position with numpy : 0.06557011604309082 nb_pixel_total : 1603289 time to create 1 rle with new method : 1.1643891334533691 time for calcul the mask position with numpy : 0.052248239517211914 nb_pixel_total : 9633 time to create 1 rle with old method : 0.011426210403442383 time for calcul the mask position with numpy : 0.051343441009521484 nb_pixel_total : 3497 time to create 1 rle with old method : 0.004148721694946289 time for calcul the mask position with numpy : 0.05108451843261719 nb_pixel_total : 20687 time to create 1 rle with old method : 0.023615121841430664 time for calcul the mask position with numpy : 0.05150771141052246 nb_pixel_total : 9420 time to create 1 rle with old method : 0.0106353759765625 time for calcul the mask position with numpy : 0.05000710487365723 nb_pixel_total : 39560 time to create 1 rle with old method : 0.04508042335510254 time for calcul the mask position with numpy : 0.05119013786315918 nb_pixel_total : 31709 time to create 1 rle with old method : 0.03530454635620117 time for calcul the mask position with numpy : 0.050968170166015625 nb_pixel_total : 1334 time to create 1 rle with old method : 0.001975536346435547 time for calcul the mask position with numpy : 0.05135393142700195 nb_pixel_total : 158939 time to create 1 rle with new method : 1.1206402778625488 time for calcul the mask position with numpy : 0.05221247673034668 nb_pixel_total : 43200 time to create 1 rle with old method : 0.04882025718688965 time for calcul the mask position with numpy : 0.05109596252441406 nb_pixel_total : 62295 time to create 1 rle with old method : 0.06844520568847656 time for calcul the mask position with numpy : 0.05069851875305176 nb_pixel_total : 73083 time to create 1 rle with old method : 0.07908105850219727 time for calcul the mask position with numpy : 0.04969620704650879 nb_pixel_total : 37317 time to create 1 rle with old method : 0.040895700454711914 time for calcul the mask position with numpy : 0.051503896713256836 nb_pixel_total : 76060 time to create 1 rle with old method : 0.10233712196350098 time for calcul the mask position with numpy : 0.058541297912597656 nb_pixel_total : 41047 time to create 1 rle with old method : 0.047379493713378906 time for calcul the mask position with numpy : 0.05105423927307129 nb_pixel_total : 13757 time to create 1 rle with old method : 0.015334129333496094 time for calcul the mask position with numpy : 0.0508120059967041 nb_pixel_total : 43850 time to create 1 rle with old method : 0.04939579963684082 time for calcul the mask position with numpy : 0.051099300384521484 nb_pixel_total : 54214 time to create 1 rle with old method : 0.0622251033782959 time for calcul the mask position with numpy : 0.05200910568237305 nb_pixel_total : 47980 time to create 1 rle with old method : 0.05375862121582031 time for calcul the mask position with numpy : 0.04954171180725098 nb_pixel_total : 29472 time to create 1 rle with old method : 0.03425884246826172 time for calcul the mask position with numpy : 0.05409407615661621 nb_pixel_total : 147892 time to create 1 rle with old method : 0.1633453369140625 time for calcul the mask position with numpy : 0.06268548965454102 nb_pixel_total : 215706 time to create 1 rle with new method : 1.031806468963623 time for calcul the mask position with numpy : 0.0538792610168457 nb_pixel_total : 71604 time to create 1 rle with old method : 0.08198118209838867 time for calcul the mask position with numpy : 0.05170416831970215 nb_pixel_total : 29452 time to create 1 rle with old method : 0.033951520919799805 time for calcul the mask position with numpy : 0.05385184288024902 nb_pixel_total : 11624 time to create 1 rle with old method : 0.013547897338867188 time for calcul the mask position with numpy : 0.055460214614868164 nb_pixel_total : 30159 time to create 1 rle with old method : 0.034278154373168945 time for calcul the mask position with numpy : 0.05419015884399414 nb_pixel_total : 183901 time to create 1 rle with new method : 1.1239013671875 time for calcul the mask position with numpy : 0.0501101016998291 nb_pixel_total : 27584 time to create 1 rle with old method : 0.030155658721923828 time for calcul the mask position with numpy : 0.0504152774810791 nb_pixel_total : 12338 time to create 1 rle with old method : 0.014007806777954102 time for calcul the mask position with numpy : 0.05063819885253906 nb_pixel_total : 74707 time to create 1 rle with old method : 0.08090615272521973 time for calcul the mask position with numpy : 0.050039052963256836 nb_pixel_total : 139 time to create 1 rle with old method : 0.00021600723266601562 time for calcul the mask position with numpy : 0.051998138427734375 nb_pixel_total : 155620 time to create 1 rle with new method : 1.0976595878601074 time for calcul the mask position with numpy : 0.05248093605041504 nb_pixel_total : 52802 time to create 1 rle with old method : 0.060237884521484375 time for calcul the mask position with numpy : 0.05269813537597656 nb_pixel_total : 56201 time to create 1 rle with old method : 0.07784795761108398 time for calcul the mask position with numpy : 0.06273889541625977 nb_pixel_total : 446193 time to create 1 rle with new method : 1.3634352684020996 time for calcul the mask position with numpy : 0.05826997756958008 nb_pixel_total : 776200 time to create 1 rle with new method : 1.2758946418762207 time for calcul the mask position with numpy : 0.05035591125488281 nb_pixel_total : 124788 time to create 1 rle with old method : 0.14542055130004883 time for calcul the mask position with numpy : 0.05090928077697754 nb_pixel_total : 1522 time to create 1 rle with old method : 0.002191305160522461 time for calcul the mask position with numpy : 0.051627397537231445 nb_pixel_total : 32195 time to create 1 rle with old method : 0.03618645668029785 time for calcul the mask position with numpy : 0.0524749755859375 nb_pixel_total : 71276 time to create 1 rle with old method : 0.07929277420043945 time for calcul the mask position with numpy : 0.050832509994506836 nb_pixel_total : 210686 time to create 1 rle with new method : 1.1243174076080322 time for calcul the mask position with numpy : 0.05005359649658203 nb_pixel_total : 49470 time to create 1 rle with old method : 0.054499149322509766 time for calcul the mask position with numpy : 0.05240273475646973 nb_pixel_total : 161214 time to create 1 rle with new method : 1.2018101215362549 time for calcul the mask position with numpy : 0.050913095474243164 nb_pixel_total : 43744 time to create 1 rle with old method : 0.048227787017822266 time for calcul the mask position with numpy : 0.05037713050842285 nb_pixel_total : 23855 time to create 1 rle with old method : 0.025866270065307617 time for calcul the mask position with numpy : 0.051445960998535156 nb_pixel_total : 10454 time to create 1 rle with old method : 0.012044191360473633 time for calcul the mask position with numpy : 0.05169391632080078 nb_pixel_total : 30084 time to create 1 rle with old method : 0.03368210792541504 time for calcul the mask position with numpy : 0.0517735481262207 nb_pixel_total : 115617 time to create 1 rle with old method : 0.13315796852111816 time for calcul the mask position with numpy : 0.05347466468811035 nb_pixel_total : 1997 time to create 1 rle with old method : 0.0023648738861083984 time for calcul the mask position with numpy : 0.051245927810668945 nb_pixel_total : 71069 time to create 1 rle with old method : 0.08132004737854004 time for calcul the mask position with numpy : 0.05212283134460449 nb_pixel_total : 20266 time to create 1 rle with old method : 0.023419857025146484 time for calcul the mask position with numpy : 0.05639505386352539 nb_pixel_total : 52203 time to create 1 rle with old method : 0.05985522270202637 create new chi : 22.01842212677002 time to delete rle : 0.0035445690155029297 batch 1 Loaded 58 chid ids of type : 4855 Number RLEs to save : 41601 TO DO : save crop sub photo not yet done ! save time : 2.271932601928711 nb_obj : 48 nb_hashtags : 7 time to prepare the origin masks : 43.731889724731445 time for calcul the mask position with numpy : 0.4525721073150635 nb_pixel_total : 4967013 time to create 1 rle with new method : 1.2236967086791992 time for calcul the mask position with numpy : 0.13909912109375 nb_pixel_total : 396465 time to create 1 rle with new method : 0.9968080520629883 time for calcul the mask position with numpy : 0.05244755744934082 nb_pixel_total : 4754 time to create 1 rle with old method : 0.006307840347290039 time for calcul the mask position with numpy : 0.16115498542785645 nb_pixel_total : 2563001 time to create 1 rle with new method : 1.6709315776824951 time for calcul the mask position with numpy : 0.26181912422180176 nb_pixel_total : 1350830 time to create 1 rle with new method : 1.3246378898620605 time for calcul the mask position with numpy : 0.05420231819152832 nb_pixel_total : 9 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.05510210990905762 nb_pixel_total : 33965 time to create 1 rle with old method : 0.03966951370239258 time for calcul the mask position with numpy : 0.06251287460327148 nb_pixel_total : 1476092 time to create 1 rle with new method : 1.210474967956543 time for calcul the mask position with numpy : 0.05276751518249512 nb_pixel_total : 4376 time to create 1 rle with old method : 0.00518798828125 time for calcul the mask position with numpy : 0.0533902645111084 nb_pixel_total : 17151 time to create 1 rle with old method : 0.019727706909179688 time for calcul the mask position with numpy : 0.05260634422302246 nb_pixel_total : 6900 time to create 1 rle with old method : 0.008033990859985352 time for calcul the mask position with numpy : 0.0548861026763916 nb_pixel_total : 9356 time to create 1 rle with old method : 0.010857343673706055 time for calcul the mask position with numpy : 0.0524904727935791 nb_pixel_total : 889 time to create 1 rle with old method : 0.0011453628540039062 time for calcul the mask position with numpy : 0.05243825912475586 nb_pixel_total : 34824 time to create 1 rle with old method : 0.04046344757080078 time for calcul the mask position with numpy : 0.053082942962646484 nb_pixel_total : 55686 time to create 1 rle with old method : 0.06456303596496582 time for calcul the mask position with numpy : 0.052073001861572266 nb_pixel_total : 30287 time to create 1 rle with old method : 0.03551888465881348 time for calcul the mask position with numpy : 0.05326509475708008 nb_pixel_total : 153688 time to create 1 rle with new method : 1.9559097290039062 time for calcul the mask position with numpy : 0.05170035362243652 nb_pixel_total : 4967 time to create 1 rle with old method : 0.006109476089477539 time for calcul the mask position with numpy : 0.052405357360839844 nb_pixel_total : 69402 time to create 1 rle with old method : 0.08291888236999512 time for calcul the mask position with numpy : 0.05451703071594238 nb_pixel_total : 167807 time to create 1 rle with new method : 1.8444344997406006 time for calcul the mask position with numpy : 0.05279994010925293 nb_pixel_total : 137228 time to create 1 rle with old method : 0.15216326713562012 time for calcul the mask position with numpy : 0.05231165885925293 nb_pixel_total : 7802 time to create 1 rle with old method : 0.008873939514160156 time for calcul the mask position with numpy : 0.05275464057922363 nb_pixel_total : 5024 time to create 1 rle with old method : 0.0057833194732666016 time for calcul the mask position with numpy : 0.052980661392211914 nb_pixel_total : 38631 time to create 1 rle with old method : 0.04501461982727051 time for calcul the mask position with numpy : 0.05653715133666992 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.05386471748352051 nb_pixel_total : 32086 time to create 1 rle with old method : 0.04123353958129883 time for calcul the mask position with numpy : 0.053635597229003906 nb_pixel_total : 24092 time to create 1 rle with old method : 0.6795408725738525 time for calcul the mask position with numpy : 0.051682233810424805 nb_pixel_total : 209181 time to create 1 rle with new method : 1.7904057502746582 time for calcul the mask position with numpy : 0.055168867111206055 nb_pixel_total : 50394 time to create 1 rle with old method : 0.07246804237365723 time for calcul the mask position with numpy : 0.052001237869262695 nb_pixel_total : 73665 time to create 1 rle with old method : 0.0836944580078125 time for calcul the mask position with numpy : 0.05189681053161621 nb_pixel_total : 121067 time to create 1 rle with old method : 0.14235782623291016 time for calcul the mask position with numpy : 0.0582125186920166 nb_pixel_total : 87475 time to create 1 rle with old method : 0.10020971298217773 time for calcul the mask position with numpy : 0.05153155326843262 nb_pixel_total : 78037 time to create 1 rle with old method : 0.0877077579498291 time for calcul the mask position with numpy : 0.05306267738342285 nb_pixel_total : 138831 time to create 1 rle with old method : 0.15590357780456543 time for calcul the mask position with numpy : 0.05086565017700195 nb_pixel_total : 33209 time to create 1 rle with old method : 0.037575483322143555 time for calcul the mask position with numpy : 0.05386853218078613 nb_pixel_total : 53710 time to create 1 rle with old method : 0.060448408126831055 time for calcul the mask position with numpy : 0.052681684494018555 nb_pixel_total : 13245 time to create 1 rle with old method : 0.01568770408630371 time for calcul the mask position with numpy : 0.053292036056518555 nb_pixel_total : 10177 time to create 1 rle with old method : 0.012806892395019531 time for calcul the mask position with numpy : 0.05363917350769043 nb_pixel_total : 135606 time to create 1 rle with old method : 0.1527388095855713 time for calcul the mask position with numpy : 0.05199074745178223 nb_pixel_total : 19251 time to create 1 rle with old method : 0.022147417068481445 time for calcul the mask position with numpy : 0.052024126052856445 nb_pixel_total : 47774 time to create 1 rle with old method : 0.05349612236022949 time for calcul the mask position with numpy : 0.05249953269958496 nb_pixel_total : 13964 time to create 1 rle with old method : 0.016188621520996094 time for calcul the mask position with numpy : 0.0529634952545166 nb_pixel_total : 4258 time to create 1 rle with old method : 0.005469799041748047 time for calcul the mask position with numpy : 0.052918195724487305 nb_pixel_total : 97149 time to create 1 rle with old method : 0.11637187004089355 time for calcul the mask position with numpy : 0.05373358726501465 nb_pixel_total : 35743 time to create 1 rle with old method : 0.04181551933288574 time for calcul the mask position with numpy : 0.05310940742492676 nb_pixel_total : 10605 time to create 1 rle with old method : 0.012215375900268555 time for calcul the mask position with numpy : 0.053131103515625 nb_pixel_total : 77480 time to create 1 rle with old method : 0.0905618667602539 time for calcul the mask position with numpy : 0.052870988845825195 nb_pixel_total : 23750 time to create 1 rle with old method : 0.02786874771118164 time for calcul the mask position with numpy : 0.05352926254272461 nb_pixel_total : 52152 time to create 1 rle with old method : 0.06021308898925781 create new chi : 18.413106441497803 time to delete rle : 0.0039255619049072266 batch 1 Loaded 49 chid ids of type : 4855 Number RLEs to save : 33704 TO DO : save crop sub photo not yet done ! save time : 1.8199963569641113 nb_obj : 61 nb_hashtags : 8 time to prepare the origin masks : 61.326866149902344 time for calcul the mask position with numpy : 0.6901469230651855 nb_pixel_total : 6112508 time to create 1 rle with new method : 1.3949685096740723 time for calcul the mask position with numpy : 0.23013091087341309 nb_pixel_total : 2085573 time to create 1 rle with new method : 1.1508524417877197 time for calcul the mask position with numpy : 0.05641651153564453 nb_pixel_total : 284916 time to create 1 rle with new method : 1.4178047180175781 time for calcul the mask position with numpy : 0.05366683006286621 nb_pixel_total : 30554 time to create 1 rle with old method : 0.0357818603515625 time for calcul the mask position with numpy : 0.05381298065185547 nb_pixel_total : 71660 time to create 1 rle with old method : 0.0839695930480957 time for calcul the mask position with numpy : 0.053992509841918945 nb_pixel_total : 6058 time to create 1 rle with old method : 0.007454633712768555 time for calcul the mask position with numpy : 0.05189943313598633 nb_pixel_total : 26726 time to create 1 rle with old method : 0.030550479888916016 time for calcul the mask position with numpy : 0.05187582969665527 nb_pixel_total : 45816 time to create 1 rle with old method : 0.051569461822509766 time for calcul the mask position with numpy : 0.05160236358642578 nb_pixel_total : 1054 time to create 1 rle with old method : 0.001332998275756836 time for calcul the mask position with numpy : 0.05109739303588867 nb_pixel_total : 20578 time to create 1 rle with old method : 0.023856163024902344 time for calcul the mask position with numpy : 0.05161285400390625 nb_pixel_total : 16401 time to create 1 rle with old method : 0.018721342086791992 time for calcul the mask position with numpy : 0.05410337448120117 nb_pixel_total : 488394 time to create 1 rle with new method : 1.0658221244812012 time for calcul the mask position with numpy : 0.05334925651550293 nb_pixel_total : 205788 time to create 1 rle with new method : 1.0179479122161865 time for calcul the mask position with numpy : 0.05224919319152832 nb_pixel_total : 1780 time to create 1 rle with old method : 0.0020682811737060547 time for calcul the mask position with numpy : 0.05264639854431152 nb_pixel_total : 33803 time to create 1 rle with old method : 0.038512468338012695 time for calcul the mask position with numpy : 0.05214262008666992 nb_pixel_total : 26243 time to create 1 rle with old method : 0.030164480209350586 time for calcul the mask position with numpy : 0.053503990173339844 nb_pixel_total : 230819 time to create 1 rle with new method : 1.1613357067108154 time for calcul the mask position with numpy : 0.05223369598388672 nb_pixel_total : 45628 time to create 1 rle with old method : 0.05249834060668945 time for calcul the mask position with numpy : 0.05311989784240723 nb_pixel_total : 49388 time to create 1 rle with old method : 0.057294368743896484 time for calcul the mask position with numpy : 0.05553388595581055 nb_pixel_total : 48238 time to create 1 rle with old method : 0.05784869194030762 time for calcul the mask position with numpy : 0.05437064170837402 nb_pixel_total : 281725 time to create 1 rle with new method : 1.2144715785980225 time for calcul the mask position with numpy : 0.0527043342590332 nb_pixel_total : 87672 time to create 1 rle with old method : 0.1005241870880127 time for calcul the mask position with numpy : 0.05306100845336914 nb_pixel_total : 62726 time to create 1 rle with old method : 0.07203364372253418 time for calcul the mask position with numpy : 0.053285837173461914 nb_pixel_total : 281353 time to create 1 rle with new method : 0.9891250133514404 time for calcul the mask position with numpy : 0.05187106132507324 nb_pixel_total : 3103 time to create 1 rle with old method : 0.004304170608520508 time for calcul the mask position with numpy : 0.057501792907714844 nb_pixel_total : 22 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.05302691459655762 nb_pixel_total : 50487 time to create 1 rle with old method : 0.05610799789428711 time for calcul the mask position with numpy : 0.05101466178894043 nb_pixel_total : 30989 time to create 1 rle with old method : 0.03482556343078613 time for calcul the mask position with numpy : 0.05066823959350586 nb_pixel_total : 5369 time to create 1 rle with old method : 0.0059893131256103516 time for calcul the mask position with numpy : 0.05122852325439453 nb_pixel_total : 13144 time to create 1 rle with old method : 0.015527963638305664 time for calcul the mask position with numpy : 0.05168962478637695 nb_pixel_total : 127747 time to create 1 rle with old method : 0.1458725929260254 time for calcul the mask position with numpy : 0.051251888275146484 nb_pixel_total : 48534 time to create 1 rle with old method : 0.05539822578430176 time for calcul the mask position with numpy : 0.05389857292175293 nb_pixel_total : 326845 time to create 1 rle with new method : 1.2041213512420654 time for calcul the mask position with numpy : 0.05330801010131836 nb_pixel_total : 83561 time to create 1 rle with old method : 0.09542441368103027 time for calcul the mask position with numpy : 0.051249027252197266 nb_pixel_total : 17399 time to create 1 rle with old method : 0.019763469696044922 time for calcul the mask position with numpy : 0.051506757736206055 nb_pixel_total : 13629 time to create 1 rle with old method : 0.015336990356445312 time for calcul the mask position with numpy : 0.05154919624328613 nb_pixel_total : 91551 time to create 1 rle with old method : 0.10361814498901367 time for calcul the mask position with numpy : 0.05434274673461914 nb_pixel_total : 252554 time to create 1 rle with new method : 1.079463005065918 time for calcul the mask position with numpy : 0.05098772048950195 nb_pixel_total : 41072 time to create 1 rle with old method : 0.04594779014587402 time for calcul the mask position with numpy : 0.05077624320983887 nb_pixel_total : 61414 time to create 1 rle with old method : 0.06797909736633301 time for calcul the mask position with numpy : 0.05316805839538574 nb_pixel_total : 139991 time to create 1 rle with old method : 0.15662527084350586 time for calcul the mask position with numpy : 0.051862239837646484 nb_pixel_total : 76485 time to create 1 rle with old method : 0.08397746086120605 time for calcul the mask position with numpy : 0.051140785217285156 nb_pixel_total : 85409 time to create 1 rle with old method : 0.09369468688964844 time for calcul the mask position with numpy : 0.05102229118347168 nb_pixel_total : 27341 time to create 1 rle with old method : 0.031052589416503906 time for calcul the mask position with numpy : 0.05233621597290039 nb_pixel_total : 74033 time to create 1 rle with old method : 0.0836031436920166 time for calcul the mask position with numpy : 0.05282902717590332 nb_pixel_total : 97812 time to create 1 rle with old method : 0.11974740028381348 time for calcul the mask position with numpy : 0.05484795570373535 nb_pixel_total : 89275 time to create 1 rle with old method : 0.10629415512084961 time for calcul the mask position with numpy : 0.05392193794250488 nb_pixel_total : 20259 time to create 1 rle with old method : 0.02315664291381836 time for calcul the mask position with numpy : 0.0522308349609375 nb_pixel_total : 60913 time to create 1 rle with old method : 0.0693507194519043 time for calcul the mask position with numpy : 0.052317142486572266 nb_pixel_total : 71302 time to create 1 rle with old method : 0.08081364631652832 time for calcul the mask position with numpy : 0.051235198974609375 nb_pixel_total : 48149 time to create 1 rle with old method : 0.05325436592102051 time for calcul the mask position with numpy : 0.0515439510345459 nb_pixel_total : 1528 time to create 1 rle with old method : 0.0019919872283935547 time for calcul the mask position with numpy : 0.052515506744384766 nb_pixel_total : 200233 time to create 1 rle with new method : 1.3599755764007568 time for calcul the mask position with numpy : 0.05655956268310547 nb_pixel_total : 9398 time to create 1 rle with old method : 0.010961532592773438 time for calcul the mask position with numpy : 0.05269145965576172 nb_pixel_total : 1488 time to create 1 rle with old method : 0.0018146038055419922 time for calcul the mask position with numpy : 0.053427696228027344 nb_pixel_total : 72758 time to create 1 rle with old method : 0.08340072631835938 time for calcul the mask position with numpy : 0.05181241035461426 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0022504329681396484 time for calcul the mask position with numpy : 0.05312180519104004 nb_pixel_total : 16838 time to create 1 rle with old method : 0.019246339797973633 time for calcul the mask position with numpy : 0.05275583267211914 nb_pixel_total : 95794 time to create 1 rle with old method : 0.10869574546813965 time for calcul the mask position with numpy : 0.052713632583618164 nb_pixel_total : 72348 time to create 1 rle with old method : 0.08131861686706543 time for calcul the mask position with numpy : 0.06046295166015625 nb_pixel_total : 3065 time to create 1 rle with old method : 0.0065233707427978516 time for calcul the mask position with numpy : 0.05425071716308594 nb_pixel_total : 146 time to create 1 rle with old method : 0.0003502368927001953 create new chi : 20.17016911506653 time to delete rle : 0.0042421817779541016 batch 1 Loaded 62 chid ids of type : 4855 Number RLEs to save : 39012 TO DO : save crop sub photo not yet done ! save time : 2.154937505722046 nb_obj : 46 nb_hashtags : 7 time to prepare the origin masks : 36.92715072631836 time for calcul the mask position with numpy : 0.6325786113739014 nb_pixel_total : 6890264 time to create 1 rle with new method : 1.3408634662628174 time for calcul the mask position with numpy : 0.05287528038024902 nb_pixel_total : 79884 time to create 1 rle with old method : 0.08754587173461914 time for calcul the mask position with numpy : 0.05108165740966797 nb_pixel_total : 43179 time to create 1 rle with old method : 0.04817628860473633 time for calcul the mask position with numpy : 0.24519968032836914 nb_pixel_total : 2140032 time to create 1 rle with new method : 1.7366695404052734 time for calcul the mask position with numpy : 0.05085492134094238 nb_pixel_total : 28613 time to create 1 rle with old method : 0.034923553466796875 time for calcul the mask position with numpy : 0.05404806137084961 nb_pixel_total : 27101 time to create 1 rle with old method : 0.03203177452087402 time for calcul the mask position with numpy : 0.055324554443359375 nb_pixel_total : 81229 time to create 1 rle with old method : 0.0923147201538086 time for calcul the mask position with numpy : 0.05440783500671387 nb_pixel_total : 177283 time to create 1 rle with new method : 1.6080272197723389 time for calcul the mask position with numpy : 0.24896693229675293 nb_pixel_total : 1885470 time to create 1 rle with new method : 1.0500986576080322 time for calcul the mask position with numpy : 0.049977779388427734 nb_pixel_total : 4267 time to create 1 rle with old method : 0.004664182662963867 time for calcul the mask position with numpy : 0.05120515823364258 nb_pixel_total : 111628 time to create 1 rle with old method : 0.1218564510345459 time for calcul the mask position with numpy : 0.05101943016052246 nb_pixel_total : 122508 time to create 1 rle with old method : 0.13357973098754883 time for calcul the mask position with numpy : 0.050115108489990234 nb_pixel_total : 62232 time to create 1 rle with old method : 0.06731724739074707 time for calcul the mask position with numpy : 0.0501399040222168 nb_pixel_total : 10093 time to create 1 rle with old method : 0.011130571365356445 time for calcul the mask position with numpy : 0.05050396919250488 nb_pixel_total : 14633 time to create 1 rle with old method : 0.01634049415588379 time for calcul the mask position with numpy : 0.050393104553222656 nb_pixel_total : 33364 time to create 1 rle with old method : 0.03642630577087402 time for calcul the mask position with numpy : 0.04993128776550293 nb_pixel_total : 22209 time to create 1 rle with old method : 0.02443385124206543 time for calcul the mask position with numpy : 0.05042886734008789 nb_pixel_total : 9650 time to create 1 rle with old method : 0.010607242584228516 time for calcul the mask position with numpy : 0.05022025108337402 nb_pixel_total : 151881 time to create 1 rle with new method : 0.9617207050323486 time for calcul the mask position with numpy : 0.049654483795166016 nb_pixel_total : 43626 time to create 1 rle with old method : 0.046962738037109375 time for calcul the mask position with numpy : 0.04953265190124512 nb_pixel_total : 39879 time to create 1 rle with old method : 0.0426175594329834 time for calcul the mask position with numpy : 0.0504610538482666 nb_pixel_total : 86793 time to create 1 rle with old method : 0.09326863288879395 time for calcul the mask position with numpy : 0.049686431884765625 nb_pixel_total : 21492 time to create 1 rle with old method : 0.023108959197998047 time for calcul the mask position with numpy : 0.05045056343078613 nb_pixel_total : 48800 time to create 1 rle with old method : 0.05438065528869629 time for calcul the mask position with numpy : 0.05104780197143555 nb_pixel_total : 24882 time to create 1 rle with old method : 0.027138948440551758 time for calcul the mask position with numpy : 0.049889564514160156 nb_pixel_total : 66173 time to create 1 rle with old method : 0.07327079772949219 time for calcul the mask position with numpy : 0.050574302673339844 nb_pixel_total : 36210 time to create 1 rle with old method : 0.039403676986694336 time for calcul the mask position with numpy : 0.050485849380493164 nb_pixel_total : 115416 time to create 1 rle with old method : 0.12552380561828613 time for calcul the mask position with numpy : 0.051061153411865234 nb_pixel_total : 21714 time to create 1 rle with old method : 0.0238800048828125 time for calcul the mask position with numpy : 0.05114293098449707 nb_pixel_total : 52652 time to create 1 rle with old method : 0.05693674087524414 time for calcul the mask position with numpy : 0.0500483512878418 nb_pixel_total : 5798 time to create 1 rle with old method : 0.006558418273925781 time for calcul the mask position with numpy : 0.050211429595947266 nb_pixel_total : 45931 time to create 1 rle with old method : 0.05000424385070801 time for calcul the mask position with numpy : 0.050399065017700195 nb_pixel_total : 39255 time to create 1 rle with old method : 0.04381108283996582 time for calcul the mask position with numpy : 0.04972052574157715 nb_pixel_total : 13656 time to create 1 rle with old method : 0.015092611312866211 time for calcul the mask position with numpy : 0.049889564514160156 nb_pixel_total : 57778 time to create 1 rle with old method : 0.06256818771362305 time for calcul the mask position with numpy : 0.04966473579406738 nb_pixel_total : 24292 time to create 1 rle with old method : 0.026582956314086914 time for calcul the mask position with numpy : 0.04990363121032715 nb_pixel_total : 51552 time to create 1 rle with old method : 0.05661606788635254 time for calcul the mask position with numpy : 0.04992485046386719 nb_pixel_total : 8266 time to create 1 rle with old method : 0.009106636047363281 time for calcul the mask position with numpy : 0.04972100257873535 nb_pixel_total : 11813 time to create 1 rle with old method : 0.012916803359985352 time for calcul the mask position with numpy : 0.05030465126037598 nb_pixel_total : 47054 time to create 1 rle with old method : 0.050841331481933594 time for calcul the mask position with numpy : 0.04963088035583496 nb_pixel_total : 7605 time to create 1 rle with old method : 0.008388519287109375 time for calcul the mask position with numpy : 0.04962635040283203 nb_pixel_total : 23784 time to create 1 rle with old method : 0.02620077133178711 time for calcul the mask position with numpy : 0.04999423027038574 nb_pixel_total : 61222 time to create 1 rle with old method : 0.06536507606506348 time for calcul the mask position with numpy : 0.05146074295043945 nb_pixel_total : 35734 time to create 1 rle with old method : 0.03967690467834473 time for calcul the mask position with numpy : 0.05051684379577637 nb_pixel_total : 45777 time to create 1 rle with old method : 0.0501554012298584 time for calcul the mask position with numpy : 0.05109667778015137 nb_pixel_total : 43999 time to create 1 rle with old method : 0.049048662185668945 time for calcul the mask position with numpy : 0.04993867874145508 nb_pixel_total : 2527 time to create 1 rle with old method : 0.002807140350341797 create new chi : 12.205577373504639 time to delete rle : 0.0026464462280273438 batch 1 Loaded 47 chid ids of type : 4855 Number RLEs to save : 30960 TO DO : save crop sub photo not yet done ! save time : 1.6896021366119385 nb_obj : 13 nb_hashtags : 7 time to prepare the origin masks : 24.82744264602661 time for calcul the mask position with numpy : 0.564889669418335 nb_pixel_total : 5912228 time to create 1 rle with new method : 1.40728759765625 time for calcul the mask position with numpy : 0.06647872924804688 nb_pixel_total : 29348 time to create 1 rle with old method : 0.033936500549316406 time for calcul the mask position with numpy : 0.03815412521362305 nb_pixel_total : 4020 time to create 1 rle with old method : 0.0046443939208984375 time for calcul the mask position with numpy : 0.0429224967956543 nb_pixel_total : 17876 time to create 1 rle with old method : 0.020573854446411133 time for calcul the mask position with numpy : 0.0388484001159668 nb_pixel_total : 134417 time to create 1 rle with old method : 0.15529227256774902 time for calcul the mask position with numpy : 0.03963422775268555 nb_pixel_total : 41 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.03956103324890137 nb_pixel_total : 55915 time to create 1 rle with old method : 0.06752181053161621 time for calcul the mask position with numpy : 0.03984332084655762 nb_pixel_total : 9420 time to create 1 rle with old method : 0.010850667953491211 time for calcul the mask position with numpy : 0.04155921936035156 nb_pixel_total : 273406 time to create 1 rle with new method : 1.1225435733795166 time for calcul the mask position with numpy : 0.06964325904846191 nb_pixel_total : 22016 time to create 1 rle with old method : 0.02559065818786621 time for calcul the mask position with numpy : 0.2110741138458252 nb_pixel_total : 1987870 time to create 1 rle with new method : 1.3742666244506836 time for calcul the mask position with numpy : 0.07133769989013672 nb_pixel_total : 906834 time to create 1 rle with new method : 1.1962230205535889 time for calcul the mask position with numpy : 0.06929516792297363 nb_pixel_total : 1004847 time to create 1 rle with new method : 1.1521327495574951 time for calcul the mask position with numpy : 0.2390899658203125 nb_pixel_total : 2620962 time to create 1 rle with new method : 1.3401398658752441 create new chi : 9.764647245407104 time to delete rle : 0.002262115478515625 batch 1 Loaded 14 chid ids of type : 4855 Number RLEs to save : 18611 TO DO : save crop sub photo not yet done ! save time : 1.056596040725708 map_output_result : {1357486095: (0.37620320474761904, 'Should be the crop_list due to order', 0.12889979446629432), 1357486091: (0.37620320474761904, 'Should be the crop_list due to order', 0.24164686909229038), 1357486076: (0.37620320474761904, 'Should be the crop_list due to order', 0.39719671522019206), 1357486070: (0.37620320474761904, 'Should be the crop_list due to order', 0.472850714526699), 1357486066: (0.37620320474761904, 'Should be the crop_list due to order', 0.5412139171824827), 1357486061: (0.37620320474761904, 'Should be the crop_list due to order', 0.33336836168356054), 1357486055: (0.37620320474761904, 'Should be the crop_list due to order', 0.2370193281468421), 1357486051: (0.37620320474761904, 'Should be the crop_list due to order', 0.6574299376625914)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 8 /1357486095.Didn't retrieve data . /1357486091.Didn't retrieve data . /1357486076.Didn't retrieve data . /1357486070.Didn't retrieve data . /1357486066.Didn't retrieve data . /1357486061.Didn't retrieve data . /1357486055.Didn't retrieve data . /1357486051.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015962600708007812 save_final save missing photos in datou_result : time spend for datou_step_exec : 507.6504588127136 time spend to save output : 0.01769423484802246 total time spend for step 5 : 507.66815304756165 step6:crop_condition Sat May 10 15:53:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 393 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3015255 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885264_206975 we have uploaded 25 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.948084592819214 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 104 About to insert : list_path_to_insert length 104 new photo from crops ! About to upload 104 photos upload in portfolio : 3015255 init cache_photo without model_param we have 104 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885316_206975 we have uploaded 104 photos in the portfolio 3015255 time of upload the photos Elapsed time : 40.618008852005005 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885373_206975 we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 13.68268871307373 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885391_206975 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5063047409057617 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885397_206975 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.8069202899932861 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3015255 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885418_206975 we have uploaded 33 photos in the portfolio 3015255 time of upload the photos Elapsed time : 21.390532732009888 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3015255 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885475_206975 we have uploaded 27 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.510403871536255 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885496_206975 we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.273287057876587 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3015255 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746885816_206975 we have uploaded 54 photos in the portfolio 3015255 time of upload the photos Elapsed time : 21.687397956848145 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 307 /1357487516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357487985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357490804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 929 time used for this insertion : 0.08115839958190918 save_final save missing photos in datou_result : time spend for datou_step_exec : 608.0295333862305 time spend to save output : 0.11730599403381348 total time spend for step 6 : 608.1468393802643 step7:ventilate_hashtags_in_portfolio Sat May 10 16:04:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22862239 get user id for portfolio 22862239 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22862559,22862560,22862561,22862562,22862563,22862568,22862570,22862571,22862572,22862573,22862574,22862575,22862577,22862578,22862579,22862580,22862581,22862582,22862583,22862584?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22862239 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 1 /22862239. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013536691665649414 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.099442481994629 time spend to save output : 0.01381373405456543 total time spend for step 7 : 4.113256216049194 step8:final Sat May 10 16:04:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357486095: ('0.39773799115774777',), 1357486091: ('0.39773799115774777',), 1357486076: ('0.39773799115774777',), 1357486070: ('0.39773799115774777',), 1357486066: ('0.39773799115774777',), 1357486061: ('0.39773799115774777',), 1357486055: ('0.39773799115774777',), 1357486051: ('0.39773799115774777',)} new output for save of step final : {1357486095: ('0.39773799115774777',), 1357486091: ('0.39773799115774777',), 1357486076: ('0.39773799115774777',), 1357486070: ('0.39773799115774777',), 1357486066: ('0.39773799115774777',), 1357486061: ('0.39773799115774777',), 1357486055: ('0.39773799115774777',), 1357486051: ('0.39773799115774777',)} [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 8 /1357486095.Didn't retrieve data . /1357486091.Didn't retrieve data . /1357486076.Didn't retrieve data . /1357486070.Didn't retrieve data . /1357486066.Didn't retrieve data . /1357486061.Didn't retrieve data . /1357486055.Didn't retrieve data . /1357486051.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013638019561767578 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12201738357543945 time spend to save output : 0.014103174209594727 total time spend for step 8 : 0.13612055778503418 step9:velours_tree Sat May 10 16:04:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.7919676303863525 time spend to save output : 3.2901763916015625e-05 total time spend for step 9 : 0.7920005321502686 step10:send_mail_cod Sat May 10 16:04:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22862239_10-05-2025_16_04_06.pdf 22862533 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625331746885846 22862534 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625341746885848 22862535 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625351746885850 22862536 change filename to text .imagette228625361746885851 22862537 change filename to text .imagette228625371746885851 22862538 imagette228625381746885852 22862539 imagette228625391746885852 22862540 imagette228625401746885852 22862541 imagette228625411746885852 22862542 imagette228625421746885852 22862543 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625431746885852 22862544 imagette228625441746885853 22862545 imagette228625451746885853 22862546 imagette228625461746885853 22862547 imagette228625471746885853 22862548 imagette228625481746885853 22862549 imagette228625491746885853 22862550 imagette228625501746885853 22862551 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625511746885853 22862553 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228625531746885854 22862554 imagette228625541746885856 22862555 imagette228625551746885856 22862556 imagette228625561746885856 22862557 imagette228625571746885856 22862558 imagette228625581746885856 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22862239 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22862559,22862560,22862561,22862562,22862563,22862568,22862570,22862571,22862572,22862573,22862574,22862575,22862577,22862578,22862579,22862580,22862581,22862582,22862583,22862584?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22862239 your option no_mail is active, we will not send the real mail to your client args[1357486095] : ((1357486095, 5778.486382188189, 492609224), (1357486095, -0.6317479487628951, 501862349), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486091] : ((1357486091, 3445.0903965308653, 492609224), (1357486091, -0.5488147210029459, 501862349), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486076] : ((1357486076, 2482.35324710808, 492609224), (1357486076, -0.27985645372435086, 496442774), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486070] : ((1357486070, 4617.151222151328, 492609224), (1357486070, -0.5974336000415932, 501862349), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486066] : ((1357486066, 6632.295719567364, 492609224), (1357486066, -0.45906284244137113, 496442774), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486061] : ((1357486061, 1829.8762900085183, 2107751945), (1357486061, -0.5753811348190417, 501862349), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486055] : ((1357486055, 3291.768159970664, 492609224), (1357486055, -0.5969903442509962, 501862349), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357486051] : ((1357486051, 1860.9160606408475, 2107751945), (1357486051, -0.4216449472501846, 496442774), '0.39773799115774777') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.39773799115774777 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf results_Auto_P22862239_10-05-2025_16_04_06.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22862239','results_Auto_P22862239_10-05-2025_16_04_06.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf','pdf','','2.59','0.39773799115774777') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013967275619506836 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.21979022026062 time spend to save output : 0.014245033264160156 total time spend for step 10 : 13.23403525352478 step11:split_time_score Sat May 10 16:04:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('37', 1), ('38', 4), ('39', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10052025 22862239 Nombre de photos uploadées : 8 / 23040 (0%) 10052025 22862239 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 10052025 22862239 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004322528839111328 elapsed_time : insert_dashboard_record_day_entry 0.02418041229248047 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2280055167718577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862238_10-05-2025_15_49_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862238 AND mptpi.`type`=4855 To do Qualite : 0.39773799115774777 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862239 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357486095, 1357486091, 1357486076, 1357486070, 1357486066, 1357486061, 1357486055, 1357486051] Looping around the photos to save general results len do output : 1 /22862239Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486095', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486091', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486076', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486070', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486066', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486061', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486055', None, None, None, None, None, '2817442') ('4741', None, None, None, None, None, None, None, '2817442') ('4741', '22862239', '1357486051', None, None, None, None, None, '2817442') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013459920883178711 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3348705768585205 time spend to save output : 0.013633966445922852 total time spend for step 11 : 0.34850454330444336 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 876.06user 402.27system 22:55.48elapsed 92%CPU (0avgtext+0avgdata 7780736maxresident)k 1720144inputs+1086744outputs (20949major+62138521minor)pagefaults 0swaps