python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2270654 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2654379'] with mtr_portfolio_ids : ['21222499'] and first list_photo_ids : [] new path : /proc/2270654/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.9685311317443848 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Mar 11 02:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8954 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-11 02:21:31.952720: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-11 02:21:31.979124: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-11 02:21:31.981313: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1bc8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-11 02:21:31.981362: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-11 02:21:31.986272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-11 02:21:32.146138: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x26185160 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-11 02:21:32.146190: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-11 02:21:32.147218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:21:32.147626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:21:32.152007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:21:32.154575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:21:32.155123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:21:32.158414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:21:32.160367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:21:32.166859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:21:32.168426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:21:32.168536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:21:32.169351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 02:21:32.169370: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 02:21:32.169380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 02:21:32.170794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-11 02:21:32.494796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:21:32.494894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:21:32.494979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:21:32.495007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:21:32.495032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:21:32.495057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:21:32.495082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:21:32.495106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:21:32.496706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:21:32.498004: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:21:32.498073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:21:32.498092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:21:32.498116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:21:32.498146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:21:32.498164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:21:32.498180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:21:32.498196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:21:32.499516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:21:32.499567: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 02:21:32.499580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 02:21:32.499589: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 02:21:32.500918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-11 02:21:46.290294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:21:46.480480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 2270893 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3665 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8954 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0014753341674804688 nb_pixel_total : 37450 time to create 1 rle with old method : 0.048494815826416016 length of segment : 256 time for calcul the mask position with numpy : 0.0015532970428466797 nb_pixel_total : 50708 time to create 1 rle with old method : 0.07806897163391113 length of segment : 427 time for calcul the mask position with numpy : 0.0011000633239746094 nb_pixel_total : 48879 time to create 1 rle with old method : 0.06394433975219727 length of segment : 274 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 8900 time to create 1 rle with old method : 0.011564970016479492 length of segment : 162 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 23099 time to create 1 rle with old method : 0.035666465759277344 length of segment : 153 time for calcul the mask position with numpy : 0.004924297332763672 nb_pixel_total : 191636 time to create 1 rle with new method : 0.013771533966064453 length of segment : 684 time for calcul the mask position with numpy : 0.00033092498779296875 nb_pixel_total : 15391 time to create 1 rle with old method : 0.01826763153076172 length of segment : 159 time for calcul the mask position with numpy : 0.0005745887756347656 nb_pixel_total : 3185 time to create 1 rle with old method : 0.0052144527435302734 length of segment : 117 time for calcul the mask position with numpy : 0.1124582290649414 nb_pixel_total : 495284 time to create 1 rle with new method : 0.11701512336730957 length of segment : 1764 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 26302 time to create 1 rle with old method : 0.031365394592285156 length of segment : 170 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 12131 time to create 1 rle with old method : 0.014500141143798828 length of segment : 177 time for calcul the mask position with numpy : 0.0015096664428710938 nb_pixel_total : 71681 time to create 1 rle with old method : 0.08463382720947266 length of segment : 373 time for calcul the mask position with numpy : 0.0008678436279296875 nb_pixel_total : 45371 time to create 1 rle with old method : 0.05492568016052246 length of segment : 217 time for calcul the mask position with numpy : 0.0009031295776367188 nb_pixel_total : 28590 time to create 1 rle with old method : 0.036598920822143555 length of segment : 224 time for calcul the mask position with numpy : 0.001789093017578125 nb_pixel_total : 83678 time to create 1 rle with old method : 0.10193920135498047 length of segment : 500 time for calcul the mask position with numpy : 0.0022203922271728516 nb_pixel_total : 85243 time to create 1 rle with old method : 0.10111093521118164 length of segment : 515 time for calcul the mask position with numpy : 0.0019843578338623047 nb_pixel_total : 2923 time to create 1 rle with old method : 0.00444793701171875 length of segment : 93 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 53393 time to create 1 rle with old method : 0.06276273727416992 length of segment : 287 time for calcul the mask position with numpy : 0.0010085105895996094 nb_pixel_total : 46323 time to create 1 rle with old method : 0.0582125186920166 length of segment : 316 time for calcul the mask position with numpy : 0.012570858001708984 nb_pixel_total : 481951 time to create 1 rle with new method : 0.146561861038208 length of segment : 1173 time for calcul the mask position with numpy : 0.0040111541748046875 nb_pixel_total : 65829 time to create 1 rle with old method : 0.07610368728637695 length of segment : 698 time for calcul the mask position with numpy : 0.0008902549743652344 nb_pixel_total : 34530 time to create 1 rle with old method : 0.04142618179321289 length of segment : 292 time for calcul the mask position with numpy : 0.0017426013946533203 nb_pixel_total : 65431 time to create 1 rle with old method : 0.10514664649963379 length of segment : 404 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 27190 time to create 1 rle with old method : 0.03276515007019043 length of segment : 256 time for calcul the mask position with numpy : 0.0009100437164306641 nb_pixel_total : 37988 time to create 1 rle with old method : 0.04406332969665527 length of segment : 240 time for calcul the mask position with numpy : 0.0003676414489746094 nb_pixel_total : 12341 time to create 1 rle with old method : 0.014455080032348633 length of segment : 191 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 8327 time to create 1 rle with old method : 0.010228633880615234 length of segment : 121 time for calcul the mask position with numpy : 0.0033004283905029297 nb_pixel_total : 149981 time to create 1 rle with old method : 0.17987322807312012 length of segment : 633 time for calcul the mask position with numpy : 0.0069010257720947266 nb_pixel_total : 226170 time to create 1 rle with new method : 0.012989997863769531 length of segment : 715 time for calcul the mask position with numpy : 0.0014679431915283203 nb_pixel_total : 24300 time to create 1 rle with old method : 0.06041264533996582 length of segment : 201 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 6181 time to create 1 rle with old method : 0.04232668876647949 length of segment : 131 time for calcul the mask position with numpy : 0.020889997482299805 nb_pixel_total : 198143 time to create 1 rle with new method : 0.012373208999633789 length of segment : 528 time for calcul the mask position with numpy : 0.004037618637084961 nb_pixel_total : 71096 time to create 1 rle with old method : 0.13055157661437988 length of segment : 631 time for calcul the mask position with numpy : 0.0016422271728515625 nb_pixel_total : 41543 time to create 1 rle with old method : 0.05713009834289551 length of segment : 263 time for calcul the mask position with numpy : 0.0020580291748046875 nb_pixel_total : 41503 time to create 1 rle with old method : 0.07512807846069336 length of segment : 266 time for calcul the mask position with numpy : 0.0014903545379638672 nb_pixel_total : 36639 time to create 1 rle with old method : 0.06684279441833496 length of segment : 210 time for calcul the mask position with numpy : 0.00337982177734375 nb_pixel_total : 45689 time to create 1 rle with old method : 0.07642841339111328 length of segment : 262 time for calcul the mask position with numpy : 0.000362396240234375 nb_pixel_total : 10007 time to create 1 rle with old method : 0.017610549926757812 length of segment : 109 time for calcul the mask position with numpy : 0.0011091232299804688 nb_pixel_total : 19448 time to create 1 rle with old method : 0.03411555290222168 length of segment : 272 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 14473 time to create 1 rle with old method : 0.017149686813354492 length of segment : 130 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 12479 time to create 1 rle with old method : 0.016618967056274414 length of segment : 130 time for calcul the mask position with numpy : 0.0009381771087646484 nb_pixel_total : 42970 time to create 1 rle with old method : 0.051270246505737305 length of segment : 251 time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 11249 time to create 1 rle with old method : 0.013257503509521484 length of segment : 128 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 15037 time to create 1 rle with old method : 0.02484440803527832 length of segment : 170 time for calcul the mask position with numpy : 0.0007114410400390625 nb_pixel_total : 6035 time to create 1 rle with old method : 0.00788259506225586 length of segment : 110 time for calcul the mask position with numpy : 0.0154876708984375 nb_pixel_total : 510523 time to create 1 rle with new method : 0.06290006637573242 length of segment : 589 time for calcul the mask position with numpy : 0.01960468292236328 nb_pixel_total : 444265 time to create 1 rle with new method : 0.4068119525909424 length of segment : 877 time for calcul the mask position with numpy : 0.15064311027526855 nb_pixel_total : 701751 time to create 1 rle with new method : 0.09074187278747559 length of segment : 1154 time for calcul the mask position with numpy : 0.005722761154174805 nb_pixel_total : 183685 time to create 1 rle with new method : 0.009630680084228516 length of segment : 410 time for calcul the mask position with numpy : 0.0012576580047607422 nb_pixel_total : 32078 time to create 1 rle with old method : 0.0406641960144043 length of segment : 192 time for calcul the mask position with numpy : 0.001739501953125 nb_pixel_total : 33544 time to create 1 rle with old method : 0.039641618728637695 length of segment : 270 time for calcul the mask position with numpy : 0.0007312297821044922 nb_pixel_total : 21614 time to create 1 rle with old method : 0.02656722068786621 length of segment : 108 time for calcul the mask position with numpy : 0.18787193298339844 nb_pixel_total : 897405 time to create 1 rle with new method : 0.36911892890930176 length of segment : 1194 time for calcul the mask position with numpy : 0.0008547306060791016 nb_pixel_total : 24792 time to create 1 rle with old method : 0.029156208038330078 length of segment : 136 time for calcul the mask position with numpy : 0.0007536411285400391 nb_pixel_total : 26945 time to create 1 rle with old method : 0.03153800964355469 length of segment : 132 time for calcul the mask position with numpy : 0.007814645767211914 nb_pixel_total : 237847 time to create 1 rle with new method : 0.11892318725585938 length of segment : 655 time for calcul the mask position with numpy : 0.0029211044311523438 nb_pixel_total : 120421 time to create 1 rle with old method : 0.14002132415771484 length of segment : 566 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 29471 time to create 1 rle with old method : 0.04044508934020996 length of segment : 199 time for calcul the mask position with numpy : 0.0030975341796875 nb_pixel_total : 27874 time to create 1 rle with old method : 0.04561114311218262 length of segment : 313 time for calcul the mask position with numpy : 0.031078577041625977 nb_pixel_total : 823767 time to create 1 rle with new method : 0.5764980316162109 length of segment : 1218 time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 50888 time to create 1 rle with old method : 0.05881762504577637 length of segment : 295 time for calcul the mask position with numpy : 0.012254476547241211 nb_pixel_total : 37752 time to create 1 rle with old method : 0.04863882064819336 length of segment : 389 time for calcul the mask position with numpy : 0.04929852485656738 nb_pixel_total : 465188 time to create 1 rle with new method : 0.2788844108581543 length of segment : 1156 time for calcul the mask position with numpy : 0.0040857791900634766 nb_pixel_total : 19238 time to create 1 rle with old method : 0.02509307861328125 length of segment : 132 time for calcul the mask position with numpy : 0.032141923904418945 nb_pixel_total : 50295 time to create 1 rle with old method : 0.0631108283996582 length of segment : 289 time for calcul the mask position with numpy : 0.051029205322265625 nb_pixel_total : 114113 time to create 1 rle with old method : 0.14303970336914062 length of segment : 558 time for calcul the mask position with numpy : 0.031215190887451172 nb_pixel_total : 70082 time to create 1 rle with old method : 0.09253573417663574 length of segment : 262 time for calcul the mask position with numpy : 0.004486560821533203 nb_pixel_total : 18688 time to create 1 rle with old method : 0.03082561492919922 length of segment : 201 time for calcul the mask position with numpy : 0.2699897289276123 nb_pixel_total : 17891 time to create 1 rle with old method : 0.03545403480529785 length of segment : 111 time for calcul the mask position with numpy : 0.03563332557678223 nb_pixel_total : 88055 time to create 1 rle with old method : 0.19391489028930664 length of segment : 569 time for calcul the mask position with numpy : 0.004297018051147461 nb_pixel_total : 56158 time to create 1 rle with old method : 0.07176899909973145 length of segment : 297 time for calcul the mask position with numpy : 0.263566255569458 nb_pixel_total : 192213 time to create 1 rle with new method : 0.01504373550415039 length of segment : 578 time for calcul the mask position with numpy : 0.013992786407470703 nb_pixel_total : 17419 time to create 1 rle with old method : 0.02500009536743164 length of segment : 237 time for calcul the mask position with numpy : 0.014451265335083008 nb_pixel_total : 60060 time to create 1 rle with old method : 0.09112834930419922 length of segment : 231 time for calcul the mask position with numpy : 0.2897465229034424 nb_pixel_total : 185803 time to create 1 rle with new method : 0.023509740829467773 length of segment : 466 time for calcul the mask position with numpy : 0.004319906234741211 nb_pixel_total : 171388 time to create 1 rle with new method : 0.011654853820800781 length of segment : 477 time for calcul the mask position with numpy : 0.6165997982025146 nb_pixel_total : 663579 time to create 1 rle with new method : 0.08021664619445801 length of segment : 1259 time for calcul the mask position with numpy : 0.4766054153442383 nb_pixel_total : 774207 time to create 1 rle with new method : 0.6900961399078369 length of segment : 1468 time for calcul the mask position with numpy : 1.0438451766967773 nb_pixel_total : 1094747 time to create 1 rle with new method : 0.16899514198303223 length of segment : 1321 time for calcul the mask position with numpy : 0.3749358654022217 nb_pixel_total : 710902 time to create 1 rle with new method : 0.18579649925231934 length of segment : 1109 time for calcul the mask position with numpy : 0.22791099548339844 nb_pixel_total : 1082287 time to create 1 rle with new method : 0.7868542671203613 length of segment : 909 time for calcul the mask position with numpy : 0.10293388366699219 nb_pixel_total : 564164 time to create 1 rle with new method : 0.07118630409240723 length of segment : 822 time for calcul the mask position with numpy : 0.013836145401000977 nb_pixel_total : 21357 time to create 1 rle with old method : 0.03368806838989258 length of segment : 125 time for calcul the mask position with numpy : 0.004828214645385742 nb_pixel_total : 83962 time to create 1 rle with old method : 0.09876036643981934 length of segment : 558 time for calcul the mask position with numpy : 1.1634154319763184 nb_pixel_total : 650260 time to create 1 rle with new method : 0.12540674209594727 length of segment : 1132 time for calcul the mask position with numpy : 0.4917571544647217 nb_pixel_total : 84417 time to create 1 rle with old method : 0.10322690010070801 length of segment : 505 time for calcul the mask position with numpy : 0.028656721115112305 nb_pixel_total : 706493 time to create 1 rle with new method : 0.04563093185424805 length of segment : 1042 time for calcul the mask position with numpy : 0.2721900939941406 nb_pixel_total : 41460 time to create 1 rle with old method : 0.05316281318664551 length of segment : 133 time for calcul the mask position with numpy : 1.451786994934082 nb_pixel_total : 3624336 time to create 1 rle with new method : 0.7978813648223877 length of segment : 1535 time for calcul the mask position with numpy : 0.5540566444396973 nb_pixel_total : 4133682 time to create 1 rle with new method : 0.43854546546936035 length of segment : 1845 time for calcul the mask position with numpy : 1.2552807331085205 nb_pixel_total : 5095523 time to create 1 rle with new method : 0.5407071113586426 length of segment : 2658 time for calcul the mask position with numpy : 0.19758296012878418 nb_pixel_total : 3639380 time to create 1 rle with new method : 0.44675636291503906 length of segment : 1444 time spent for convertir_results : 31.33248019218445 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 92 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 84.82768106460571 time spend to save output : 0.4375877380371094 total time spend for step 1 : 85.26526880264282 step2:mask_detect Tue Mar 11 02:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8954 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-11 02:23:00.058003: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-11 02:23:00.191409: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-11 02:23:00.194758: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1bc0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-11 02:23:00.194835: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-11 02:23:00.209591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-11 02:23:00.668177: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x275af7e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-11 02:23:00.668261: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-11 02:23:00.669873: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:23:00.678086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:23:00.780181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:23:00.807141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:23:00.812374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:23:00.851044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:23:00.856575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:23:00.915613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:23:00.917476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:23:00.918051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:23:00.924383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 02:23:00.924437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 02:23:00.924449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 02:23:00.927382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-11 02:23:01.180665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:23:01.180779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:23:01.180821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:23:01.180844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:23:01.180875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:23:01.180903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:23:01.180925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:23:01.180945: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:23:01.182552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:23:01.184123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-11 02:23:01.184191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-11 02:23:01.184214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:23:01.184234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-11 02:23:01.184253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-11 02:23:01.184277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-11 02:23:01.184306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-11 02:23:01.184337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-11 02:23:01.185927: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-11 02:23:01.185965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-11 02:23:01.185977: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-11 02:23:01.185986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-11 02:23:01.187723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-11 02:23:07.927124: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-03-11 02:23:16.963822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-11 02:23:17.694493: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 61 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 2275206 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3665 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5667 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.5023636817932129 nb_pixel_total : 150046 time to create 1 rle with new method : 0.028018474578857422 length of segment : 558 time for calcul the mask position with numpy : 0.5104312896728516 nb_pixel_total : 150488 time to create 1 rle with new method : 0.009717941284179688 length of segment : 417 time for calcul the mask position with numpy : 0.05383133888244629 nb_pixel_total : 34258 time to create 1 rle with old method : 0.04603862762451172 length of segment : 312 time for calcul the mask position with numpy : 0.1462090015411377 nb_pixel_total : 31444 time to create 1 rle with old method : 0.042200565338134766 length of segment : 251 time for calcul the mask position with numpy : 0.06356239318847656 nb_pixel_total : 12832 time to create 1 rle with old method : 0.024632930755615234 length of segment : 134 time for calcul the mask position with numpy : 0.09198665618896484 nb_pixel_total : 16574 time to create 1 rle with old method : 0.029140949249267578 length of segment : 219 time for calcul the mask position with numpy : 1.0046019554138184 nb_pixel_total : 429493 time to create 1 rle with new method : 0.039923906326293945 length of segment : 702 time for calcul the mask position with numpy : 1.4265329837799072 nb_pixel_total : 795251 time to create 1 rle with new method : 0.24591469764709473 length of segment : 987 time for calcul the mask position with numpy : 0.3754425048828125 nb_pixel_total : 92625 time to create 1 rle with old method : 0.11506867408752441 length of segment : 545 time for calcul the mask position with numpy : 0.14461684226989746 nb_pixel_total : 87283 time to create 1 rle with old method : 0.10999917984008789 length of segment : 579 time for calcul the mask position with numpy : 1.4922575950622559 nb_pixel_total : 903236 time to create 1 rle with new method : 0.07802367210388184 length of segment : 848 time for calcul the mask position with numpy : 0.002076387405395508 nb_pixel_total : 80379 time to create 1 rle with old method : 0.11314630508422852 length of segment : 280 time for calcul the mask position with numpy : 0.42506885528564453 nb_pixel_total : 129718 time to create 1 rle with old method : 0.1583259105682373 length of segment : 421 time for calcul the mask position with numpy : 0.39662885665893555 nb_pixel_total : 149134 time to create 1 rle with old method : 0.1968708038330078 length of segment : 511 time for calcul the mask position with numpy : 0.3035242557525635 nb_pixel_total : 100107 time to create 1 rle with old method : 0.13130927085876465 length of segment : 403 time for calcul the mask position with numpy : 0.18579530715942383 nb_pixel_total : 137235 time to create 1 rle with old method : 0.19025707244873047 length of segment : 353 time for calcul the mask position with numpy : 0.8958628177642822 nb_pixel_total : 552629 time to create 1 rle with new method : 0.05860757827758789 length of segment : 1345 time for calcul the mask position with numpy : 0.006051778793334961 nb_pixel_total : 57985 time to create 1 rle with old method : 0.08859562873840332 length of segment : 317 time for calcul the mask position with numpy : 0.1865217685699463 nb_pixel_total : 59128 time to create 1 rle with old method : 0.11414265632629395 length of segment : 314 time for calcul the mask position with numpy : 0.0960695743560791 nb_pixel_total : 25302 time to create 1 rle with old method : 0.037496089935302734 length of segment : 175 time for calcul the mask position with numpy : 0.08889484405517578 nb_pixel_total : 184383 time to create 1 rle with new method : 0.028275489807128906 length of segment : 808 time for calcul the mask position with numpy : 0.09384441375732422 nb_pixel_total : 150284 time to create 1 rle with new method : 0.010093212127685547 length of segment : 511 time for calcul the mask position with numpy : 1.334376335144043 nb_pixel_total : 842983 time to create 1 rle with new method : 0.06243491172790527 length of segment : 1276 time for calcul the mask position with numpy : 0.007718801498413086 nb_pixel_total : 27792 time to create 1 rle with old method : 0.05528593063354492 length of segment : 121 time for calcul the mask position with numpy : 0.05689096450805664 nb_pixel_total : 79494 time to create 1 rle with old method : 0.13557863235473633 length of segment : 246 time for calcul the mask position with numpy : 0.9116663932800293 nb_pixel_total : 1426401 time to create 1 rle with new method : 0.225358247756958 length of segment : 2683 time for calcul the mask position with numpy : 0.10457205772399902 nb_pixel_total : 193374 time to create 1 rle with new method : 0.0190732479095459 length of segment : 938 time for calcul the mask position with numpy : 0.16204309463500977 nb_pixel_total : 185910 time to create 1 rle with new method : 0.0246279239654541 length of segment : 438 time for calcul the mask position with numpy : 0.023553133010864258 nb_pixel_total : 119696 time to create 1 rle with old method : 0.15982747077941895 length of segment : 629 time for calcul the mask position with numpy : 0.15532279014587402 nb_pixel_total : 989828 time to create 1 rle with new method : 0.1300649642944336 length of segment : 1513 time for calcul the mask position with numpy : 0.01200556755065918 nb_pixel_total : 619637 time to create 1 rle with new method : 0.05672955513000488 length of segment : 1569 time for calcul the mask position with numpy : 0.4441814422607422 nb_pixel_total : 412963 time to create 1 rle with new method : 0.025914907455444336 length of segment : 936 time for calcul the mask position with numpy : 0.0029821395874023438 nb_pixel_total : 134850 time to create 1 rle with old method : 0.1999826431274414 length of segment : 480 time for calcul the mask position with numpy : 0.0035309791564941406 nb_pixel_total : 133977 time to create 1 rle with old method : 0.15630483627319336 length of segment : 555 time for calcul the mask position with numpy : 0.00708460807800293 nb_pixel_total : 63179 time to create 1 rle with old method : 0.07559347152709961 length of segment : 228 time for calcul the mask position with numpy : 0.20036554336547852 nb_pixel_total : 231466 time to create 1 rle with new method : 0.011476993560791016 length of segment : 626 time for calcul the mask position with numpy : 0.09975552558898926 nb_pixel_total : 46425 time to create 1 rle with old method : 0.07087182998657227 length of segment : 509 time for calcul the mask position with numpy : 0.03647160530090332 nb_pixel_total : 210184 time to create 1 rle with new method : 0.016375064849853516 length of segment : 1528 time for calcul the mask position with numpy : 0.0997312068939209 nb_pixel_total : 129716 time to create 1 rle with old method : 0.1692667007446289 length of segment : 502 time for calcul the mask position with numpy : 0.033121347427368164 nb_pixel_total : 238852 time to create 1 rle with new method : 0.01722097396850586 length of segment : 1317 time for calcul the mask position with numpy : 0.003972053527832031 nb_pixel_total : 138215 time to create 1 rle with old method : 0.17295074462890625 length of segment : 513 time for calcul the mask position with numpy : 0.0009677410125732422 nb_pixel_total : 28677 time to create 1 rle with old method : 0.03965401649475098 length of segment : 217 time for calcul the mask position with numpy : 0.01945948600769043 nb_pixel_total : 245706 time to create 1 rle with new method : 0.027718782424926758 length of segment : 810 time for calcul the mask position with numpy : 0.09272480010986328 nb_pixel_total : 598011 time to create 1 rle with new method : 0.17436528205871582 length of segment : 1916 time for calcul the mask position with numpy : 0.08388566970825195 nb_pixel_total : 97275 time to create 1 rle with old method : 0.11541152000427246 length of segment : 499 time for calcul the mask position with numpy : 0.005813121795654297 nb_pixel_total : 27888 time to create 1 rle with old method : 0.03185248374938965 length of segment : 859 time for calcul the mask position with numpy : 0.2468717098236084 nb_pixel_total : 629507 time to create 1 rle with new method : 0.21167922019958496 length of segment : 1369 time for calcul the mask position with numpy : 0.1045839786529541 nb_pixel_total : 169511 time to create 1 rle with new method : 0.015880346298217773 length of segment : 735 time for calcul the mask position with numpy : 0.0038573741912841797 nb_pixel_total : 176051 time to create 1 rle with new method : 0.011040925979614258 length of segment : 436 time for calcul the mask position with numpy : 0.0019214153289794922 nb_pixel_total : 69134 time to create 1 rle with old method : 0.08836531639099121 length of segment : 552 time for calcul the mask position with numpy : 0.012506246566772461 nb_pixel_total : 56008 time to create 1 rle with old method : 0.07259368896484375 length of segment : 366 time for calcul the mask position with numpy : 0.03409218788146973 nb_pixel_total : 701689 time to create 1 rle with new method : 0.09466338157653809 length of segment : 934 time for calcul the mask position with numpy : 0.020483016967773438 nb_pixel_total : 103470 time to create 1 rle with old method : 0.12458086013793945 length of segment : 305 time for calcul the mask position with numpy : 0.3627772331237793 nb_pixel_total : 65407 time to create 1 rle with old method : 0.08898067474365234 length of segment : 350 time for calcul the mask position with numpy : 2.0060980319976807 nb_pixel_total : 830333 time to create 1 rle with new method : 0.21466064453125 length of segment : 1134 time for calcul the mask position with numpy : 0.5941216945648193 nb_pixel_total : 240702 time to create 1 rle with new method : 0.02050638198852539 length of segment : 610 time for calcul the mask position with numpy : 0.16819024085998535 nb_pixel_total : 51316 time to create 1 rle with old method : 0.07318282127380371 length of segment : 285 time for calcul the mask position with numpy : 0.32743120193481445 nb_pixel_total : 118000 time to create 1 rle with old method : 0.22205662727355957 length of segment : 477 time for calcul the mask position with numpy : 2.05888032913208 nb_pixel_total : 1027878 time to create 1 rle with new method : 0.2748448848724365 length of segment : 1410 time for calcul the mask position with numpy : 1.582693338394165 nb_pixel_total : 679985 time to create 1 rle with new method : 0.1415996551513672 length of segment : 1167 time for calcul the mask position with numpy : 0.21524739265441895 nb_pixel_total : 57731 time to create 1 rle with old method : 0.0665578842163086 length of segment : 315 time for calcul the mask position with numpy : 0.15730547904968262 nb_pixel_total : 88074 time to create 1 rle with old method : 0.1381382942199707 length of segment : 289 time for calcul the mask position with numpy : 0.7760863304138184 nb_pixel_total : 570727 time to create 1 rle with new method : 0.056623220443725586 length of segment : 1272 time for calcul the mask position with numpy : 0.1577911376953125 nb_pixel_total : 260690 time to create 1 rle with new method : 0.030419588088989258 length of segment : 625 time for calcul the mask position with numpy : 0.2695600986480713 nb_pixel_total : 248654 time to create 1 rle with new method : 0.011981725692749023 length of segment : 727 time for calcul the mask position with numpy : 0.36411380767822266 nb_pixel_total : 120169 time to create 1 rle with old method : 0.15209436416625977 length of segment : 735 time for calcul the mask position with numpy : 0.24196600914001465 nb_pixel_total : 106619 time to create 1 rle with old method : 0.16229510307312012 length of segment : 428 time for calcul the mask position with numpy : 0.0018181800842285156 nb_pixel_total : 51914 time to create 1 rle with old method : 0.07829570770263672 length of segment : 353 time for calcul the mask position with numpy : 0.01665806770324707 nb_pixel_total : 137578 time to create 1 rle with old method : 0.19104552268981934 length of segment : 473 time for calcul the mask position with numpy : 0.18219757080078125 nb_pixel_total : 218753 time to create 1 rle with new method : 0.016984939575195312 length of segment : 804 time for calcul the mask position with numpy : 0.1496262550354004 nb_pixel_total : 45754 time to create 1 rle with old method : 0.06829214096069336 length of segment : 249 time for calcul the mask position with numpy : 0.012249469757080078 nb_pixel_total : 24084 time to create 1 rle with old method : 0.04052472114562988 length of segment : 256 time for calcul the mask position with numpy : 0.14373564720153809 nb_pixel_total : 223762 time to create 1 rle with new method : 0.031770944595336914 length of segment : 664 time for calcul the mask position with numpy : 0.0026831626892089844 nb_pixel_total : 109953 time to create 1 rle with old method : 0.13131356239318848 length of segment : 351 time for calcul the mask position with numpy : 0.04857063293457031 nb_pixel_total : 34622 time to create 1 rle with old method : 0.05150580406188965 length of segment : 232 time for calcul the mask position with numpy : 0.30199193954467773 nb_pixel_total : 238722 time to create 1 rle with new method : 0.015220165252685547 length of segment : 444 time for calcul the mask position with numpy : 0.0206148624420166 nb_pixel_total : 52253 time to create 1 rle with old method : 0.07215309143066406 length of segment : 280 time for calcul the mask position with numpy : 0.3437333106994629 nb_pixel_total : 221966 time to create 1 rle with new method : 0.02077341079711914 length of segment : 529 time for calcul the mask position with numpy : 0.0012776851654052734 nb_pixel_total : 28148 time to create 1 rle with old method : 0.03359365463256836 length of segment : 229 time for calcul the mask position with numpy : 0.10677361488342285 nb_pixel_total : 59856 time to create 1 rle with old method : 0.0755457878112793 length of segment : 233 time for calcul the mask position with numpy : 0.45990681648254395 nb_pixel_total : 616537 time to create 1 rle with new method : 0.0518946647644043 length of segment : 1042 time for calcul the mask position with numpy : 0.04538702964782715 nb_pixel_total : 108514 time to create 1 rle with old method : 0.13451838493347168 length of segment : 529 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 25465 time to create 1 rle with old method : 0.03214716911315918 length of segment : 287 time for calcul the mask position with numpy : 0.2532343864440918 nb_pixel_total : 332406 time to create 1 rle with new method : 0.03133058547973633 length of segment : 782 time for calcul the mask position with numpy : 0.06978726387023926 nb_pixel_total : 114816 time to create 1 rle with old method : 0.16013717651367188 length of segment : 495 time for calcul the mask position with numpy : 0.0027010440826416016 nb_pixel_total : 46017 time to create 1 rle with old method : 0.052668094635009766 length of segment : 225 time for calcul the mask position with numpy : 0.04612231254577637 nb_pixel_total : 117489 time to create 1 rle with old method : 0.16443347930908203 length of segment : 322 time for calcul the mask position with numpy : 0.00295257568359375 nb_pixel_total : 99776 time to create 1 rle with old method : 0.12093210220336914 length of segment : 326 time for calcul the mask position with numpy : 0.015169620513916016 nb_pixel_total : 102582 time to create 1 rle with old method : 0.1304798126220703 length of segment : 349 time for calcul the mask position with numpy : 0.005276918411254883 nb_pixel_total : 233979 time to create 1 rle with new method : 0.01988983154296875 length of segment : 970 time for calcul the mask position with numpy : 0.10920882225036621 nb_pixel_total : 124663 time to create 1 rle with old method : 0.14875483512878418 length of segment : 375 time for calcul the mask position with numpy : 0.01142120361328125 nb_pixel_total : 9753 time to create 1 rle with old method : 0.017981767654418945 length of segment : 201 time for calcul the mask position with numpy : 0.03498101234436035 nb_pixel_total : 52213 time to create 1 rle with old method : 0.05945134162902832 length of segment : 250 time for calcul the mask position with numpy : 0.16840100288391113 nb_pixel_total : 270371 time to create 1 rle with new method : 0.01764535903930664 length of segment : 624 time for calcul the mask position with numpy : 0.0675506591796875 nb_pixel_total : 68719 time to create 1 rle with old method : 0.08394432067871094 length of segment : 538 time for calcul the mask position with numpy : 0.03091597557067871 nb_pixel_total : 75820 time to create 1 rle with old method : 0.11287546157836914 length of segment : 275 time for calcul the mask position with numpy : 0.11813020706176758 nb_pixel_total : 300562 time to create 1 rle with new method : 0.01795196533203125 length of segment : 441 time for calcul the mask position with numpy : 0.017307758331298828 nb_pixel_total : 91098 time to create 1 rle with old method : 0.11012697219848633 length of segment : 276 time for calcul the mask position with numpy : 0.2137913703918457 nb_pixel_total : 348662 time to create 1 rle with new method : 0.02054119110107422 length of segment : 604 time for calcul the mask position with numpy : 0.02514815330505371 nb_pixel_total : 48069 time to create 1 rle with old method : 0.06066465377807617 length of segment : 240 time for calcul the mask position with numpy : 0.0015947818756103516 nb_pixel_total : 14892 time to create 1 rle with old method : 0.018836498260498047 length of segment : 169 time for calcul the mask position with numpy : 0.004027843475341797 nb_pixel_total : 83716 time to create 1 rle with old method : 0.12462782859802246 length of segment : 815 time for calcul the mask position with numpy : 0.01632237434387207 nb_pixel_total : 381064 time to create 1 rle with new method : 0.029203414916992188 length of segment : 651 time for calcul the mask position with numpy : 0.010510921478271484 nb_pixel_total : 306866 time to create 1 rle with new method : 0.017322778701782227 length of segment : 532 time for calcul the mask position with numpy : 0.00235748291015625 nb_pixel_total : 102543 time to create 1 rle with old method : 0.13072752952575684 length of segment : 505 time for calcul the mask position with numpy : 1.1817398071289062 nb_pixel_total : 632405 time to create 1 rle with new method : 0.04397225379943848 length of segment : 1056 time for calcul the mask position with numpy : 0.7417104244232178 nb_pixel_total : 452465 time to create 1 rle with new method : 0.030066490173339844 length of segment : 716 time for calcul the mask position with numpy : 0.9646542072296143 nb_pixel_total : 262257 time to create 1 rle with new method : 0.025272846221923828 length of segment : 672 time for calcul the mask position with numpy : 0.11344218254089355 nb_pixel_total : 35577 time to create 1 rle with old method : 0.05505776405334473 length of segment : 263 time for calcul the mask position with numpy : 0.04307126998901367 nb_pixel_total : 47035 time to create 1 rle with old method : 0.06681275367736816 length of segment : 291 time for calcul the mask position with numpy : 0.08045625686645508 nb_pixel_total : 79321 time to create 1 rle with old method : 0.09377312660217285 length of segment : 389 time for calcul the mask position with numpy : 2.303144693374634 nb_pixel_total : 450944 time to create 1 rle with new method : 0.12283062934875488 length of segment : 682 time for calcul the mask position with numpy : 0.13374948501586914 nb_pixel_total : 44638 time to create 1 rle with old method : 0.05530953407287598 length of segment : 200 time for calcul the mask position with numpy : 0.021991729736328125 nb_pixel_total : 289799 time to create 1 rle with new method : 0.041022539138793945 length of segment : 577 time for calcul the mask position with numpy : 0.19438767433166504 nb_pixel_total : 132455 time to create 1 rle with old method : 0.15769290924072266 length of segment : 461 time for calcul the mask position with numpy : 0.33866286277770996 nb_pixel_total : 163667 time to create 1 rle with new method : 0.01585674285888672 length of segment : 746 time for calcul the mask position with numpy : 0.5617485046386719 nb_pixel_total : 159665 time to create 1 rle with new method : 0.020399093627929688 length of segment : 803 time for calcul the mask position with numpy : 0.5398683547973633 nb_pixel_total : 166001 time to create 1 rle with new method : 0.01337742805480957 length of segment : 768 time for calcul the mask position with numpy : 0.09517645835876465 nb_pixel_total : 369094 time to create 1 rle with new method : 0.021802663803100586 length of segment : 637 time for calcul the mask position with numpy : 0.7452223300933838 nb_pixel_total : 401216 time to create 1 rle with new method : 0.03480339050292969 length of segment : 970 time for calcul the mask position with numpy : 0.02832341194152832 nb_pixel_total : 18743 time to create 1 rle with old method : 0.03556036949157715 length of segment : 189 time for calcul the mask position with numpy : 0.33337950706481934 nb_pixel_total : 185164 time to create 1 rle with new method : 0.016363859176635742 length of segment : 436 time for calcul the mask position with numpy : 0.5041413307189941 nb_pixel_total : 370006 time to create 1 rle with new method : 0.018442392349243164 length of segment : 751 time for calcul the mask position with numpy : 0.02393937110900879 nb_pixel_total : 15166 time to create 1 rle with old method : 0.021974563598632812 length of segment : 296 time for calcul the mask position with numpy : 0.139923095703125 nb_pixel_total : 268259 time to create 1 rle with new method : 0.01618814468383789 length of segment : 627 time for calcul the mask position with numpy : 0.002291440963745117 nb_pixel_total : 99080 time to create 1 rle with old method : 0.11408305168151855 length of segment : 415 time for calcul the mask position with numpy : 0.05191946029663086 nb_pixel_total : 51648 time to create 1 rle with old method : 0.06444096565246582 length of segment : 204 time for calcul the mask position with numpy : 0.0020096302032470703 nb_pixel_total : 81904 time to create 1 rle with old method : 0.09522080421447754 length of segment : 232 time for calcul the mask position with numpy : 0.0008141994476318359 nb_pixel_total : 27343 time to create 1 rle with old method : 0.03246641159057617 length of segment : 305 time for calcul the mask position with numpy : 0.008591175079345703 nb_pixel_total : 22284 time to create 1 rle with old method : 0.02762436866760254 length of segment : 126 time for calcul the mask position with numpy : 0.07148170471191406 nb_pixel_total : 23864 time to create 1 rle with old method : 0.03308725357055664 length of segment : 208 time for calcul the mask position with numpy : 0.39694762229919434 nb_pixel_total : 306577 time to create 1 rle with new method : 0.015643835067749023 length of segment : 723 time for calcul the mask position with numpy : 0.03871941566467285 nb_pixel_total : 41702 time to create 1 rle with old method : 0.05361628532409668 length of segment : 226 time for calcul the mask position with numpy : 0.1869356632232666 nb_pixel_total : 156802 time to create 1 rle with new method : 0.014441728591918945 length of segment : 399 time for calcul the mask position with numpy : 0.05115032196044922 nb_pixel_total : 59824 time to create 1 rle with old method : 0.3638269901275635 length of segment : 361 time for calcul the mask position with numpy : 0.003880023956298828 nb_pixel_total : 153334 time to create 1 rle with new method : 0.011050701141357422 length of segment : 475 time for calcul the mask position with numpy : 0.1030271053314209 nb_pixel_total : 99485 time to create 1 rle with old method : 0.15472984313964844 length of segment : 422 time for calcul the mask position with numpy : 0.17928671836853027 nb_pixel_total : 191304 time to create 1 rle with new method : 0.022803306579589844 length of segment : 523 time for calcul the mask position with numpy : 0.10242390632629395 nb_pixel_total : 55012 time to create 1 rle with old method : 0.10443711280822754 length of segment : 281 time for calcul the mask position with numpy : 0.004390716552734375 nb_pixel_total : 156190 time to create 1 rle with new method : 0.01521444320678711 length of segment : 402 time for calcul the mask position with numpy : 0.28487491607666016 nb_pixel_total : 297066 time to create 1 rle with new method : 0.02353692054748535 length of segment : 796 time for calcul the mask position with numpy : 0.01964592933654785 nb_pixel_total : 48164 time to create 1 rle with old method : 0.08398628234863281 length of segment : 189 time for calcul the mask position with numpy : 0.006997585296630859 nb_pixel_total : 273567 time to create 1 rle with new method : 0.023647546768188477 length of segment : 1233 time for calcul the mask position with numpy : 0.0012197494506835938 nb_pixel_total : 26214 time to create 1 rle with old method : 0.03267717361450195 length of segment : 284 time for calcul the mask position with numpy : 0.001262664794921875 nb_pixel_total : 31968 time to create 1 rle with old method : 0.03885531425476074 length of segment : 234 time for calcul the mask position with numpy : 0.0026237964630126953 nb_pixel_total : 119888 time to create 1 rle with old method : 0.1594069004058838 length of segment : 358 time for calcul the mask position with numpy : 0.007272481918334961 nb_pixel_total : 125695 time to create 1 rle with old method : 0.1772449016571045 length of segment : 496 time for calcul the mask position with numpy : 0.05194520950317383 nb_pixel_total : 33408 time to create 1 rle with old method : 0.0452570915222168 length of segment : 168 time for calcul the mask position with numpy : 0.11614799499511719 nb_pixel_total : 216074 time to create 1 rle with new method : 0.010999679565429688 length of segment : 597 time for calcul the mask position with numpy : 0.0018200874328613281 nb_pixel_total : 78558 time to create 1 rle with old method : 0.09131669998168945 length of segment : 312 time for calcul the mask position with numpy : 0.07741761207580566 nb_pixel_total : 69187 time to create 1 rle with old method : 0.14956974983215332 length of segment : 302 time for calcul the mask position with numpy : 0.0033371448516845703 nb_pixel_total : 43678 time to create 1 rle with old method : 0.07273983955383301 length of segment : 236 time for calcul the mask position with numpy : 0.09602737426757812 nb_pixel_total : 18484 time to create 1 rle with old method : 0.02608203887939453 length of segment : 231 time for calcul the mask position with numpy : 0.001241445541381836 nb_pixel_total : 49552 time to create 1 rle with old method : 0.06443500518798828 length of segment : 282 time for calcul the mask position with numpy : 0.029427528381347656 nb_pixel_total : 14502 time to create 1 rle with old method : 0.02190995216369629 length of segment : 147 time for calcul the mask position with numpy : 0.0017926692962646484 nb_pixel_total : 79613 time to create 1 rle with old method : 0.09373855590820312 length of segment : 264 time for calcul the mask position with numpy : 0.4975430965423584 nb_pixel_total : 1121920 time to create 1 rle with new method : 0.32698512077331543 length of segment : 1477 time for calcul the mask position with numpy : 0.003775358200073242 nb_pixel_total : 162733 time to create 1 rle with new method : 0.012642383575439453 length of segment : 660 time for calcul the mask position with numpy : 0.004087686538696289 nb_pixel_total : 131604 time to create 1 rle with old method : 0.14845013618469238 length of segment : 466 time for calcul the mask position with numpy : 0.09418988227844238 nb_pixel_total : 259510 time to create 1 rle with new method : 0.02408313751220703 length of segment : 944 time for calcul the mask position with numpy : 0.0006694793701171875 nb_pixel_total : 22935 time to create 1 rle with old method : 0.02709364891052246 length of segment : 250 time for calcul the mask position with numpy : 0.02869415283203125 nb_pixel_total : 265094 time to create 1 rle with new method : 0.018006324768066406 length of segment : 1005 time for calcul the mask position with numpy : 0.004827976226806641 nb_pixel_total : 111967 time to create 1 rle with old method : 0.15188169479370117 length of segment : 454 time for calcul the mask position with numpy : 0.20624542236328125 nb_pixel_total : 107606 time to create 1 rle with old method : 0.13679957389831543 length of segment : 455 time for calcul the mask position with numpy : 0.005429506301879883 nb_pixel_total : 157195 time to create 1 rle with new method : 0.031407833099365234 length of segment : 324 time for calcul the mask position with numpy : 0.10576367378234863 nb_pixel_total : 317034 time to create 1 rle with new method : 0.019620656967163086 length of segment : 548 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 22990 time to create 1 rle with old method : 0.026628494262695312 length of segment : 240 time for calcul the mask position with numpy : 0.026786088943481445 nb_pixel_total : 1078078 time to create 1 rle with new method : 0.3625948429107666 length of segment : 1268 time for calcul the mask position with numpy : 0.016412019729614258 nb_pixel_total : 60227 time to create 1 rle with old method : 0.0735633373260498 length of segment : 501 time for calcul the mask position with numpy : 0.002523660659790039 nb_pixel_total : 80298 time to create 1 rle with old method : 0.09940361976623535 length of segment : 388 time for calcul the mask position with numpy : 0.0012831687927246094 nb_pixel_total : 64481 time to create 1 rle with old method : 0.07498049736022949 length of segment : 272 time for calcul the mask position with numpy : 0.003930807113647461 nb_pixel_total : 120445 time to create 1 rle with old method : 0.14162731170654297 length of segment : 436 time for calcul the mask position with numpy : 0.0019526481628417969 nb_pixel_total : 55889 time to create 1 rle with old method : 0.07399654388427734 length of segment : 357 time for calcul the mask position with numpy : 0.9577314853668213 nb_pixel_total : 364802 time to create 1 rle with new method : 0.018277645111083984 length of segment : 585 time for calcul the mask position with numpy : 0.8160445690155029 nb_pixel_total : 263316 time to create 1 rle with new method : 0.0159759521484375 length of segment : 514 time for calcul the mask position with numpy : 1.2001144886016846 nb_pixel_total : 428454 time to create 1 rle with new method : 0.030866384506225586 length of segment : 727 time for calcul the mask position with numpy : 0.06727743148803711 nb_pixel_total : 68974 time to create 1 rle with old method : 0.08709049224853516 length of segment : 330 time for calcul the mask position with numpy : 0.2953610420227051 nb_pixel_total : 85293 time to create 1 rle with old method : 0.11180686950683594 length of segment : 431 time for calcul the mask position with numpy : 0.0991811752319336 nb_pixel_total : 26135 time to create 1 rle with old method : 0.034798622131347656 length of segment : 150 time for calcul the mask position with numpy : 1.7647833824157715 nb_pixel_total : 679676 time to create 1 rle with new method : 0.05749082565307617 length of segment : 1141 time for calcul the mask position with numpy : 0.3099093437194824 nb_pixel_total : 140385 time to create 1 rle with old method : 0.17731785774230957 length of segment : 400 time for calcul the mask position with numpy : 1.0301742553710938 nb_pixel_total : 169709 time to create 1 rle with new method : 0.1532001495361328 length of segment : 578 time for calcul the mask position with numpy : 0.22438907623291016 nb_pixel_total : 77962 time to create 1 rle with old method : 0.1390974521636963 length of segment : 289 time for calcul the mask position with numpy : 0.10716986656188965 nb_pixel_total : 20870 time to create 1 rle with old method : 0.028483152389526367 length of segment : 180 time for calcul the mask position with numpy : 0.3896515369415283 nb_pixel_total : 164157 time to create 1 rle with new method : 0.009630441665649414 length of segment : 499 time for calcul the mask position with numpy : 0.041620731353759766 nb_pixel_total : 31344 time to create 1 rle with old method : 0.04112720489501953 length of segment : 113 time for calcul the mask position with numpy : 0.3444209098815918 nb_pixel_total : 122895 time to create 1 rle with old method : 0.14520692825317383 length of segment : 439 time for calcul the mask position with numpy : 0.3256661891937256 nb_pixel_total : 329703 time to create 1 rle with new method : 0.02013540267944336 length of segment : 575 time for calcul the mask position with numpy : 1.4749529361724854 nb_pixel_total : 1056131 time to create 1 rle with new method : 0.7697591781616211 length of segment : 1615 time for calcul the mask position with numpy : 0.3957493305206299 nb_pixel_total : 190509 time to create 1 rle with new method : 0.013176918029785156 length of segment : 430 time for calcul the mask position with numpy : 0.016925811767578125 nb_pixel_total : 39877 time to create 1 rle with old method : 0.05059003829956055 length of segment : 221 time for calcul the mask position with numpy : 0.16146469116210938 nb_pixel_total : 103363 time to create 1 rle with old method : 0.12112569808959961 length of segment : 302 time for calcul the mask position with numpy : 0.04428434371948242 nb_pixel_total : 35317 time to create 1 rle with old method : 0.04708290100097656 length of segment : 228 time for calcul the mask position with numpy : 0.10831618309020996 nb_pixel_total : 31213 time to create 1 rle with old method : 0.04584670066833496 length of segment : 339 time for calcul the mask position with numpy : 0.4256265163421631 nb_pixel_total : 295992 time to create 1 rle with new method : 0.01715874671936035 length of segment : 932 time for calcul the mask position with numpy : 0.28884291648864746 nb_pixel_total : 327621 time to create 1 rle with new method : 0.03331923484802246 length of segment : 611 time for calcul the mask position with numpy : 0.0074841976165771484 nb_pixel_total : 185274 time to create 1 rle with new method : 0.015754222869873047 length of segment : 553 time for calcul the mask position with numpy : 0.212005615234375 nb_pixel_total : 147235 time to create 1 rle with old method : 0.2009110450744629 length of segment : 1211 time for calcul the mask position with numpy : 0.1015009880065918 nb_pixel_total : 95234 time to create 1 rle with old method : 0.11226582527160645 length of segment : 353 time for calcul the mask position with numpy : 0.012193918228149414 nb_pixel_total : 34273 time to create 1 rle with old method : 0.052654266357421875 length of segment : 184 time for calcul the mask position with numpy : 0.4513542652130127 nb_pixel_total : 1043141 time to create 1 rle with new method : 0.3022274971008301 length of segment : 1641 time for calcul the mask position with numpy : 0.007858991622924805 nb_pixel_total : 44877 time to create 1 rle with old method : 0.05594062805175781 length of segment : 275 time for calcul the mask position with numpy : 0.08655357360839844 nb_pixel_total : 54247 time to create 1 rle with old method : 0.0727682113647461 length of segment : 239 time for calcul the mask position with numpy : 0.004011392593383789 nb_pixel_total : 142806 time to create 1 rle with old method : 0.2478194236755371 length of segment : 563 time for calcul the mask position with numpy : 0.029870033264160156 nb_pixel_total : 66449 time to create 1 rle with old method : 0.08857035636901855 length of segment : 282 time for calcul the mask position with numpy : 0.053769588470458984 nb_pixel_total : 243786 time to create 1 rle with new method : 0.016039133071899414 length of segment : 526 time for calcul the mask position with numpy : 0.15187859535217285 nb_pixel_total : 84528 time to create 1 rle with old method : 0.13625645637512207 length of segment : 282 time for calcul the mask position with numpy : 0.7657442092895508 nb_pixel_total : 528965 time to create 1 rle with new method : 0.07694768905639648 length of segment : 626 time for calcul the mask position with numpy : 0.07433366775512695 nb_pixel_total : 162018 time to create 1 rle with new method : 0.009997844696044922 length of segment : 342 time for calcul the mask position with numpy : 0.17890453338623047 nb_pixel_total : 408192 time to create 1 rle with new method : 0.036298274993896484 length of segment : 665 time for calcul the mask position with numpy : 0.08884453773498535 nb_pixel_total : 133876 time to create 1 rle with old method : 0.1937391757965088 length of segment : 362 time for calcul the mask position with numpy : 0.10621953010559082 nb_pixel_total : 571005 time to create 1 rle with new method : 0.1371629238128662 length of segment : 1402 time for calcul the mask position with numpy : 0.0012509822845458984 nb_pixel_total : 19481 time to create 1 rle with old method : 0.03348255157470703 length of segment : 99 time for calcul the mask position with numpy : 0.0009031295776367188 nb_pixel_total : 1675 time to create 1 rle with old method : 0.0027849674224853516 length of segment : 79 time for calcul the mask position with numpy : 0.0015797615051269531 nb_pixel_total : 36095 time to create 1 rle with old method : 0.044450998306274414 length of segment : 195 time for calcul the mask position with numpy : 0.0008976459503173828 nb_pixel_total : 16587 time to create 1 rle with old method : 0.020042896270751953 length of segment : 188 time for calcul the mask position with numpy : 0.012317180633544922 nb_pixel_total : 20497 time to create 1 rle with old method : 0.025342226028442383 length of segment : 182 time for calcul the mask position with numpy : 0.010723590850830078 nb_pixel_total : 261795 time to create 1 rle with new method : 0.014809846878051758 length of segment : 532 time for calcul the mask position with numpy : 0.0008933544158935547 nb_pixel_total : 52618 time to create 1 rle with old method : 0.06176471710205078 length of segment : 300 time for calcul the mask position with numpy : 0.5371150970458984 nb_pixel_total : 851723 time to create 1 rle with new method : 0.12972521781921387 length of segment : 1262 time for calcul the mask position with numpy : 0.002656221389770508 nb_pixel_total : 56388 time to create 1 rle with old method : 0.07079339027404785 length of segment : 650 time for calcul the mask position with numpy : 0.004136085510253906 nb_pixel_total : 157735 time to create 1 rle with new method : 0.012228727340698242 length of segment : 601 time for calcul the mask position with numpy : 0.03582429885864258 nb_pixel_total : 108137 time to create 1 rle with old method : 0.12695980072021484 length of segment : 371 time for calcul the mask position with numpy : 0.0622861385345459 nb_pixel_total : 290268 time to create 1 rle with new method : 0.01937413215637207 length of segment : 546 time for calcul the mask position with numpy : 0.04182577133178711 nb_pixel_total : 69616 time to create 1 rle with old method : 0.08677172660827637 length of segment : 190 time for calcul the mask position with numpy : 0.0021762847900390625 nb_pixel_total : 116551 time to create 1 rle with old method : 0.13668584823608398 length of segment : 359 time for calcul the mask position with numpy : 0.015217065811157227 nb_pixel_total : 827574 time to create 1 rle with new method : 0.08755874633789062 length of segment : 1156 time for calcul the mask position with numpy : 0.002971649169921875 nb_pixel_total : 113948 time to create 1 rle with old method : 0.14694476127624512 length of segment : 389 time for calcul the mask position with numpy : 0.031063556671142578 nb_pixel_total : 38383 time to create 1 rle with old method : 0.06752943992614746 length of segment : 195 time for calcul the mask position with numpy : 0.4546961784362793 nb_pixel_total : 1329298 time to create 1 rle with new method : 0.505770206451416 length of segment : 2410 time for calcul the mask position with numpy : 0.03629112243652344 nb_pixel_total : 173548 time to create 1 rle with new method : 0.012256622314453125 length of segment : 464 time for calcul the mask position with numpy : 0.8087010383605957 nb_pixel_total : 67049 time to create 1 rle with old method : 0.09538936614990234 length of segment : 331 time for calcul the mask position with numpy : 0.9445431232452393 nb_pixel_total : 65175 time to create 1 rle with old method : 0.08200931549072266 length of segment : 438 time for calcul the mask position with numpy : 2.7650012969970703 nb_pixel_total : 259974 time to create 1 rle with new method : 0.018023967742919922 length of segment : 668 time for calcul the mask position with numpy : 0.2640652656555176 nb_pixel_total : 44038 time to create 1 rle with old method : 0.05850028991699219 length of segment : 269 time for calcul the mask position with numpy : 0.6815662384033203 nb_pixel_total : 49506 time to create 1 rle with old method : 0.07379841804504395 length of segment : 357 time for calcul the mask position with numpy : 0.6797616481781006 nb_pixel_total : 32667 time to create 1 rle with old method : 0.04294395446777344 length of segment : 200 time for calcul the mask position with numpy : 0.5025286674499512 nb_pixel_total : 54991 time to create 1 rle with old method : 0.06982612609863281 length of segment : 339 time for calcul the mask position with numpy : 2.678175926208496 nb_pixel_total : 958963 time to create 1 rle with new method : 0.1590254306793213 length of segment : 1370 time for calcul the mask position with numpy : 0.2855048179626465 nb_pixel_total : 124553 time to create 1 rle with old method : 0.21095037460327148 length of segment : 299 time for calcul the mask position with numpy : 0.09329056739807129 nb_pixel_total : 18163 time to create 1 rle with old method : 0.025461435317993164 length of segment : 186 time for calcul the mask position with numpy : 0.2064511775970459 nb_pixel_total : 77242 time to create 1 rle with old method : 0.09908342361450195 length of segment : 314 time for calcul the mask position with numpy : 0.20471644401550293 nb_pixel_total : 82145 time to create 1 rle with old method : 0.10068058967590332 length of segment : 359 time for calcul the mask position with numpy : 0.3343334197998047 nb_pixel_total : 119871 time to create 1 rle with old method : 0.15102601051330566 length of segment : 394 time for calcul the mask position with numpy : 0.48477959632873535 nb_pixel_total : 484632 time to create 1 rle with new method : 0.03387260437011719 length of segment : 1225 time for calcul the mask position with numpy : 0.09149813652038574 nb_pixel_total : 52291 time to create 1 rle with old method : 0.06900596618652344 length of segment : 183 time for calcul the mask position with numpy : 0.07718372344970703 nb_pixel_total : 39261 time to create 1 rle with old method : 0.052700042724609375 length of segment : 208 time for calcul the mask position with numpy : 1.29620361328125 nb_pixel_total : 766967 time to create 1 rle with new method : 0.11822509765625 length of segment : 1211 time for calcul the mask position with numpy : 0.08972382545471191 nb_pixel_total : 111258 time to create 1 rle with old method : 0.15450811386108398 length of segment : 485 time for calcul the mask position with numpy : 0.20555353164672852 nb_pixel_total : 69635 time to create 1 rle with old method : 0.08366608619689941 length of segment : 467 time for calcul the mask position with numpy : 0.23001837730407715 nb_pixel_total : 110997 time to create 1 rle with old method : 0.13921332359313965 length of segment : 452 time for calcul the mask position with numpy : 0.0011827945709228516 nb_pixel_total : 22535 time to create 1 rle with old method : 0.04027867317199707 length of segment : 163 time for calcul the mask position with numpy : 0.001813650131225586 nb_pixel_total : 63100 time to create 1 rle with old method : 0.10801005363464355 length of segment : 267 time for calcul the mask position with numpy : 0.3019111156463623 nb_pixel_total : 266761 time to create 1 rle with new method : 0.16002368927001953 length of segment : 646 time for calcul the mask position with numpy : 0.3477914333343506 nb_pixel_total : 146960 time to create 1 rle with old method : 0.18559646606445312 length of segment : 431 time for calcul the mask position with numpy : 0.022305965423583984 nb_pixel_total : 274913 time to create 1 rle with new method : 0.021770715713500977 length of segment : 419 time for calcul the mask position with numpy : 0.21631264686584473 nb_pixel_total : 112629 time to create 1 rle with old method : 0.15917420387268066 length of segment : 554 time for calcul the mask position with numpy : 0.008157730102539062 nb_pixel_total : 210428 time to create 1 rle with new method : 0.018685340881347656 length of segment : 662 time for calcul the mask position with numpy : 0.04509377479553223 nb_pixel_total : 56259 time to create 1 rle with old method : 0.07300782203674316 length of segment : 326 time for calcul the mask position with numpy : 0.06016421318054199 nb_pixel_total : 34960 time to create 1 rle with old method : 0.04435896873474121 length of segment : 446 time for calcul the mask position with numpy : 0.2764463424682617 nb_pixel_total : 95199 time to create 1 rle with old method : 0.12724876403808594 length of segment : 463 time for calcul the mask position with numpy : 0.02635645866394043 nb_pixel_total : 43496 time to create 1 rle with old method : 0.05640578269958496 length of segment : 218 time for calcul the mask position with numpy : 0.08651399612426758 nb_pixel_total : 98962 time to create 1 rle with old method : 0.1287059783935547 length of segment : 313 time for calcul the mask position with numpy : 0.18431520462036133 nb_pixel_total : 180700 time to create 1 rle with new method : 0.011050701141357422 length of segment : 669 time for calcul the mask position with numpy : 0.2539212703704834 nb_pixel_total : 108059 time to create 1 rle with old method : 0.13833856582641602 length of segment : 501 time for calcul the mask position with numpy : 0.9009983539581299 nb_pixel_total : 423202 time to create 1 rle with new method : 0.6137294769287109 length of segment : 1473 time for calcul the mask position with numpy : 0.0008528232574462891 nb_pixel_total : 5424 time to create 1 rle with old method : 0.011059761047363281 length of segment : 213 time for calcul the mask position with numpy : 0.023731231689453125 nb_pixel_total : 150751 time to create 1 rle with new method : 0.01333308219909668 length of segment : 586 time for calcul the mask position with numpy : 0.4818880558013916 nb_pixel_total : 416778 time to create 1 rle with new method : 0.04495358467102051 length of segment : 619 time for calcul the mask position with numpy : 0.08615398406982422 nb_pixel_total : 27730 time to create 1 rle with old method : 0.03700113296508789 length of segment : 267 time for calcul the mask position with numpy : 0.0024356842041015625 nb_pixel_total : 101758 time to create 1 rle with old method : 0.11698460578918457 length of segment : 339 time for calcul the mask position with numpy : 0.025513172149658203 nb_pixel_total : 67898 time to create 1 rle with old method : 0.08295416831970215 length of segment : 566 time for calcul the mask position with numpy : 0.21588492393493652 nb_pixel_total : 309588 time to create 1 rle with new method : 0.024607419967651367 length of segment : 655 time for calcul the mask position with numpy : 0.0018815994262695312 nb_pixel_total : 75778 time to create 1 rle with old method : 0.10836935043334961 length of segment : 302 time for calcul the mask position with numpy : 0.023895740509033203 nb_pixel_total : 288260 time to create 1 rle with new method : 0.49309301376342773 length of segment : 688 time for calcul the mask position with numpy : 0.12016439437866211 nb_pixel_total : 192054 time to create 1 rle with new method : 0.023284196853637695 length of segment : 1304 time for calcul the mask position with numpy : 0.03893756866455078 nb_pixel_total : 509762 time to create 1 rle with new method : 0.10318112373352051 length of segment : 1115 time for calcul the mask position with numpy : 0.03768301010131836 nb_pixel_total : 173626 time to create 1 rle with new method : 0.015751123428344727 length of segment : 734 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 50549 time to create 1 rle with old method : 0.06462979316711426 length of segment : 342 time for calcul the mask position with numpy : 0.013740301132202148 nb_pixel_total : 579598 time to create 1 rle with new method : 0.03812599182128906 length of segment : 1265 time for calcul the mask position with numpy : 0.0016567707061767578 nb_pixel_total : 83590 time to create 1 rle with old method : 0.09729909896850586 length of segment : 419 time for calcul the mask position with numpy : 0.009475946426391602 nb_pixel_total : 29515 time to create 1 rle with old method : 0.036481380462646484 length of segment : 255 time for calcul the mask position with numpy : 0.0029053688049316406 nb_pixel_total : 140386 time to create 1 rle with old method : 0.1655716896057129 length of segment : 432 time for calcul the mask position with numpy : 0.058919668197631836 nb_pixel_total : 221424 time to create 1 rle with new method : 0.02039957046508789 length of segment : 514 time for calcul the mask position with numpy : 0.21725153923034668 nb_pixel_total : 386542 time to create 1 rle with new method : 0.032637596130371094 length of segment : 1011 time for calcul the mask position with numpy : 0.08380341529846191 nb_pixel_total : 91351 time to create 1 rle with old method : 0.16426396369934082 length of segment : 333 time for calcul the mask position with numpy : 0.02526688575744629 nb_pixel_total : 441858 time to create 1 rle with new method : 0.04186367988586426 length of segment : 666 time for calcul the mask position with numpy : 0.00687408447265625 nb_pixel_total : 210371 time to create 1 rle with new method : 0.02356553077697754 length of segment : 507 time for calcul the mask position with numpy : 0.0006792545318603516 nb_pixel_total : 21122 time to create 1 rle with old method : 0.024796485900878906 length of segment : 194 time for calcul the mask position with numpy : 0.004070281982421875 nb_pixel_total : 155360 time to create 1 rle with new method : 0.01320338249206543 length of segment : 596 time for calcul the mask position with numpy : 0.004624843597412109 nb_pixel_total : 86925 time to create 1 rle with old method : 0.10688328742980957 length of segment : 685 time for calcul the mask position with numpy : 0.001508951187133789 nb_pixel_total : 68153 time to create 1 rle with old method : 0.0775454044342041 length of segment : 360 time for calcul the mask position with numpy : 1.0123116970062256 nb_pixel_total : 622642 time to create 1 rle with new method : 0.022330284118652344 length of segment : 879 time for calcul the mask position with numpy : 1.0253701210021973 nb_pixel_total : 383042 time to create 1 rle with new method : 0.02599644660949707 length of segment : 897 time for calcul the mask position with numpy : 1.377734661102295 nb_pixel_total : 846623 time to create 1 rle with new method : 0.0663917064666748 length of segment : 1395 time for calcul the mask position with numpy : 1.1098105907440186 nb_pixel_total : 1290614 time to create 1 rle with new method : 1.5890216827392578 length of segment : 1104 time for calcul the mask position with numpy : 0.16439056396484375 nb_pixel_total : 85705 time to create 1 rle with old method : 0.10870122909545898 length of segment : 312 time for calcul the mask position with numpy : 0.4830143451690674 nb_pixel_total : 722213 time to create 1 rle with new method : 0.06983041763305664 length of segment : 1025 time for calcul the mask position with numpy : 0.10826778411865234 nb_pixel_total : 45399 time to create 1 rle with old method : 0.05701184272766113 length of segment : 203 time for calcul the mask position with numpy : 0.3061985969543457 nb_pixel_total : 318293 time to create 1 rle with new method : 0.02303624153137207 length of segment : 740 time for calcul the mask position with numpy : 0.5112664699554443 nb_pixel_total : 757003 time to create 1 rle with new method : 0.03278708457946777 length of segment : 1151 time for calcul the mask position with numpy : 0.0003917217254638672 nb_pixel_total : 7248 time to create 1 rle with old method : 0.008159160614013672 length of segment : 163 time for calcul the mask position with numpy : 0.24091005325317383 nb_pixel_total : 251401 time to create 1 rle with new method : 0.02545905113220215 length of segment : 773 time for calcul the mask position with numpy : 0.1091315746307373 nb_pixel_total : 212891 time to create 1 rle with new method : 0.01789689064025879 length of segment : 410 time for calcul the mask position with numpy : 0.0015094280242919922 nb_pixel_total : 85061 time to create 1 rle with old method : 0.10063052177429199 length of segment : 549 time for calcul the mask position with numpy : 0.22354507446289062 nb_pixel_total : 392653 time to create 1 rle with new method : 0.022993803024291992 length of segment : 650 time for calcul the mask position with numpy : 0.03930950164794922 nb_pixel_total : 55142 time to create 1 rle with old method : 0.06651687622070312 length of segment : 305 time for calcul the mask position with numpy : 0.180741548538208 nb_pixel_total : 890038 time to create 1 rle with new method : 0.3445014953613281 length of segment : 1586 time for calcul the mask position with numpy : 0.03524208068847656 nb_pixel_total : 62305 time to create 1 rle with old method : 0.07973766326904297 length of segment : 226 time for calcul the mask position with numpy : 0.016749858856201172 nb_pixel_total : 28889 time to create 1 rle with old method : 0.04073381423950195 length of segment : 154 time for calcul the mask position with numpy : 0.019617795944213867 nb_pixel_total : 34335 time to create 1 rle with old method : 0.04341411590576172 length of segment : 158 time for calcul the mask position with numpy : 0.07488203048706055 nb_pixel_total : 38972 time to create 1 rle with old method : 0.06655478477478027 length of segment : 236 time for calcul the mask position with numpy : 0.5201799869537354 nb_pixel_total : 758349 time to create 1 rle with new method : 0.07275056838989258 length of segment : 826 time for calcul the mask position with numpy : 0.14307665824890137 nb_pixel_total : 1111613 time to create 1 rle with new method : 0.30552220344543457 length of segment : 1841 time for calcul the mask position with numpy : 0.02090740203857422 nb_pixel_total : 898661 time to create 1 rle with new method : 0.300262451171875 length of segment : 1355 time for calcul the mask position with numpy : 0.0026547908782958984 nb_pixel_total : 134863 time to create 1 rle with old method : 0.15782880783081055 length of segment : 578 time for calcul the mask position with numpy : 0.00787663459777832 nb_pixel_total : 246899 time to create 1 rle with new method : 0.01246023178100586 length of segment : 791 time for calcul the mask position with numpy : 0.1553199291229248 nb_pixel_total : 377698 time to create 1 rle with new method : 0.13811922073364258 length of segment : 581 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 18779 time to create 1 rle with old method : 0.022739171981811523 length of segment : 133 time for calcul the mask position with numpy : 0.0015134811401367188 nb_pixel_total : 67742 time to create 1 rle with old method : 0.08353018760681152 length of segment : 498 time for calcul the mask position with numpy : 0.0006699562072753906 nb_pixel_total : 20061 time to create 1 rle with old method : 0.023801326751708984 length of segment : 194 time for calcul the mask position with numpy : 0.0017468929290771484 nb_pixel_total : 76609 time to create 1 rle with old method : 0.3674020767211914 length of segment : 210 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 22355 time to create 1 rle with old method : 0.025852441787719727 length of segment : 167 time for calcul the mask position with numpy : 0.007803440093994141 nb_pixel_total : 393468 time to create 1 rle with new method : 0.0201416015625 length of segment : 695 time for calcul the mask position with numpy : 0.03180432319641113 nb_pixel_total : 241742 time to create 1 rle with new method : 0.008906364440917969 length of segment : 577 time for calcul the mask position with numpy : 0.0016870498657226562 nb_pixel_total : 81253 time to create 1 rle with old method : 0.09695267677307129 length of segment : 647 time for calcul the mask position with numpy : 0.004175662994384766 nb_pixel_total : 247709 time to create 1 rle with new method : 0.011867523193359375 length of segment : 610 time for calcul the mask position with numpy : 0.001390695571899414 nb_pixel_total : 78464 time to create 1 rle with old method : 0.08808231353759766 length of segment : 220 time for calcul the mask position with numpy : 0.9029133319854736 nb_pixel_total : 3040978 time to create 1 rle with new method : 0.28485989570617676 length of segment : 3202 time for calcul the mask position with numpy : 0.0008728504180908203 nb_pixel_total : 42827 time to create 1 rle with old method : 0.07042741775512695 length of segment : 460 time for calcul the mask position with numpy : 1.0949866771697998 nb_pixel_total : 6331458 time to create 1 rle with new method : 0.6264562606811523 length of segment : 2520 time for calcul the mask position with numpy : 0.0004646778106689453 nb_pixel_total : 26110 time to create 1 rle with old method : 0.03071284294128418 length of segment : 190 time for calcul the mask position with numpy : 0.12113714218139648 nb_pixel_total : 770364 time to create 1 rle with new method : 0.06249380111694336 length of segment : 887 time for calcul the mask position with numpy : 0.0008993148803710938 nb_pixel_total : 64105 time to create 1 rle with old method : 0.07420468330383301 length of segment : 285 time for calcul the mask position with numpy : 0.002204418182373047 nb_pixel_total : 155360 time to create 1 rle with new method : 0.005442380905151367 length of segment : 240 time spent for convertir_results : 157.68114256858826 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 427 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 397.53794026374817 time spend to save output : 0.23742461204528809 total time spend for step 2 : 397.77536487579346 step3:blur_detection Tue Mar 11 02:29:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 4207.911355415265 (4160, 3120) 4147.746375099354 (4160, 3120) 3844.975401937175 (3120, 4160) 3589.750382649638 (4160, 3120) 1676.169255662549 (4160, 3120) 1884.6919879397617 (4160, 3120) 593.0097892583647 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 30.091180562973022 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.01903986930847168 save missing photos in datou_result : time spend for datou_step_exec : 2.92049241065979 time spend to save output : 30.11443257331848 total time spend for step 3 : 33.03492498397827 step4:brightness Tue Mar 11 02:30:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741656086_2270654_1342523940_aab78b76891012b2929cd5d9c1f32d8e.jpg treat image : temp/1741656086_2270654_1342523935_8dab47d65d8ffcdbbfa5c9e7402c56b1.jpg treat image : temp/1741656086_2270654_1342523898_5eeda8b29c2b90182cdc179a65fee21f.jpg treat image : temp/1741656086_2270654_1342523894_fe234f701518bd4aec79c167b9063d57.jpg treat image : temp/1741656086_2270654_1342523889_744ef39a9e6ade2ee9caa43173107b14.jpg treat image : temp/1741656086_2270654_1342523886_ec143615054027200c0f8d897b241677.jpg treat image : temp/1741656086_2270654_1342523883_26b453d8e4c877749068a5df104c0b04.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.012395381927490234 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.014342546463012695 save missing photos in datou_result : time spend for datou_step_exec : 11.305469512939453 time spend to save output : 0.031659603118896484 total time spend for step 4 : 11.33712911605835 step5:rle_unique_nms_with_priority Tue Mar 11 02:30:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 427 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 64 nb_hashtags : 9 time to prepare the origin masks : 75.62887740135193 time for calcul the mask position with numpy : 0.409160852432251 nb_pixel_total : 2879791 time to create 1 rle with new method : 1.569446325302124 time for calcul the mask position with numpy : 0.05973339080810547 nb_pixel_total : 15381 time to create 1 rle with old method : 0.017826557159423828 time for calcul the mask position with numpy : 0.057573556900024414 nb_pixel_total : 27608 time to create 1 rle with old method : 0.03131699562072754 time for calcul the mask position with numpy : 0.05565690994262695 nb_pixel_total : 51880 time to create 1 rle with old method : 0.06073403358459473 time for calcul the mask position with numpy : 0.062377214431762695 nb_pixel_total : 27537 time to create 1 rle with old method : 0.039270639419555664 time for calcul the mask position with numpy : 0.15924882888793945 nb_pixel_total : 795162 time to create 1 rle with new method : 0.9807286262512207 time for calcul the mask position with numpy : 0.06108236312866211 nb_pixel_total : 231234 time to create 1 rle with new method : 1.2035243511199951 time for calcul the mask position with numpy : 0.05635976791381836 nb_pixel_total : 125645 time to create 1 rle with old method : 0.14862298965454102 time for calcul the mask position with numpy : 0.06526494026184082 nb_pixel_total : 942092 time to create 1 rle with new method : 1.8803610801696777 time for calcul the mask position with numpy : 0.05501675605773926 nb_pixel_total : 25342 time to create 1 rle with old method : 0.02942037582397461 time for calcul the mask position with numpy : 0.05881142616271973 nb_pixel_total : 196340 time to create 1 rle with new method : 1.052757740020752 time for calcul the mask position with numpy : 0.05379676818847656 nb_pixel_total : 34043 time to create 1 rle with old method : 0.049839019775390625 time for calcul the mask position with numpy : 0.05726313591003418 nb_pixel_total : 24185 time to create 1 rle with old method : 0.03010869026184082 time for calcul the mask position with numpy : 0.054641008377075195 nb_pixel_total : 187565 time to create 1 rle with new method : 1.2935521602630615 time for calcul the mask position with numpy : 0.05353999137878418 nb_pixel_total : 17 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.0538172721862793 nb_pixel_total : 12798 time to create 1 rle with old method : 0.014322757720947266 time for calcul the mask position with numpy : 0.0543513298034668 nb_pixel_total : 87149 time to create 1 rle with old method : 0.1048738956451416 time for calcul the mask position with numpy : 0.06067633628845215 nb_pixel_total : 46232 time to create 1 rle with old method : 0.05408740043640137 time for calcul the mask position with numpy : 0.05530858039855957 nb_pixel_total : 58514 time to create 1 rle with old method : 0.076995849609375 time for calcul the mask position with numpy : 0.06160855293273926 nb_pixel_total : 160840 time to create 1 rle with new method : 1.2362616062164307 time for calcul the mask position with numpy : 0.0545039176940918 nb_pixel_total : 149610 time to create 1 rle with old method : 0.17021632194519043 time for calcul the mask position with numpy : 0.0545506477355957 nb_pixel_total : 129233 time to create 1 rle with old method : 0.14474964141845703 time for calcul the mask position with numpy : 0.053813934326171875 nb_pixel_total : 148859 time to create 1 rle with old method : 0.17735934257507324 time for calcul the mask position with numpy : 0.062341928482055664 nb_pixel_total : 491744 time to create 1 rle with new method : 0.8807179927825928 time for calcul the mask position with numpy : 0.05419182777404785 nb_pixel_total : 88065 time to create 1 rle with old method : 0.10865545272827148 time for calcul the mask position with numpy : 0.057256460189819336 nb_pixel_total : 34161 time to create 1 rle with old method : 0.0409393310546875 time for calcul the mask position with numpy : 0.05705404281616211 nb_pixel_total : 28596 time to create 1 rle with old method : 0.035588979721069336 time for calcul the mask position with numpy : 0.0570375919342041 nb_pixel_total : 55907 time to create 1 rle with old method : 0.06580305099487305 time for calcul the mask position with numpy : 0.05408596992492676 nb_pixel_total : 59021 time to create 1 rle with old method : 0.07877683639526367 time for calcul the mask position with numpy : 0.0600283145904541 nb_pixel_total : 9714 time to create 1 rle with old method : 0.011201143264770508 time for calcul the mask position with numpy : 0.05236959457397461 nb_pixel_total : 134670 time to create 1 rle with old method : 0.16517210006713867 time for calcul the mask position with numpy : 0.055892229080200195 nb_pixel_total : 78993 time to create 1 rle with old method : 0.08870410919189453 time for calcul the mask position with numpy : 0.053479671478271484 nb_pixel_total : 183588 time to create 1 rle with new method : 1.4278326034545898 time for calcul the mask position with numpy : 0.05310630798339844 nb_pixel_total : 1852 time to create 1 rle with old method : 0.002427816390991211 time for calcul the mask position with numpy : 0.05231213569641113 nb_pixel_total : 3928 time to create 1 rle with old method : 0.005602359771728516 time for calcul the mask position with numpy : 0.05277419090270996 nb_pixel_total : 23044 time to create 1 rle with old method : 0.0253751277923584 time for calcul the mask position with numpy : 0.052300214767456055 nb_pixel_total : 487209 time to create 1 rle with new method : 0.9412267208099365 time for calcul the mask position with numpy : 0.054698944091796875 nb_pixel_total : 62886 time to create 1 rle with old method : 0.11115837097167969 time for calcul the mask position with numpy : 0.05316662788391113 nb_pixel_total : 4368 time to create 1 rle with old method : 0.005685329437255859 time for calcul the mask position with numpy : 0.06137704849243164 nb_pixel_total : 842436 time to create 1 rle with new method : 1.1353085041046143 time for calcul the mask position with numpy : 0.05733895301818848 nb_pixel_total : 99757 time to create 1 rle with old method : 0.11917710304260254 time for calcul the mask position with numpy : 0.055047035217285156 nb_pixel_total : 37340 time to create 1 rle with old method : 0.046441078186035156 time for calcul the mask position with numpy : 0.05839824676513672 nb_pixel_total : 55626 time to create 1 rle with old method : 0.06373262405395508 time for calcul the mask position with numpy : 0.05576467514038086 nb_pixel_total : 48715 time to create 1 rle with old method : 0.054558753967285156 time for calcul the mask position with numpy : 0.053849220275878906 nb_pixel_total : 169608 time to create 1 rle with new method : 0.9733097553253174 time for calcul the mask position with numpy : 0.05359315872192383 nb_pixel_total : 92620 time to create 1 rle with old method : 0.10317730903625488 time for calcul the mask position with numpy : 0.05298495292663574 nb_pixel_total : 66463 time to create 1 rle with old method : 0.07442712783813477 time for calcul the mask position with numpy : 0.050932884216308594 nb_pixel_total : 31408 time to create 1 rle with old method : 0.03520798683166504 time for calcul the mask position with numpy : 0.05329751968383789 nb_pixel_total : 193115 time to create 1 rle with new method : 0.741734504699707 time for calcul the mask position with numpy : 0.05271339416503906 nb_pixel_total : 162251 time to create 1 rle with new method : 0.911853551864624 time for calcul the mask position with numpy : 0.05657243728637695 nb_pixel_total : 568851 time to create 1 rle with new method : 0.9015142917633057 time for calcul the mask position with numpy : 0.05423784255981445 nb_pixel_total : 129274 time to create 1 rle with old method : 0.1678025722503662 time for calcul the mask position with numpy : 0.05896902084350586 nb_pixel_total : 98359 time to create 1 rle with old method : 0.11556267738342285 time for calcul the mask position with numpy : 0.054282426834106445 nb_pixel_total : 97023 time to create 1 rle with old method : 0.10905766487121582 time for calcul the mask position with numpy : 0.05685997009277344 nb_pixel_total : 419056 time to create 1 rle with new method : 1.0436413288116455 time for calcul the mask position with numpy : 0.052697181701660156 nb_pixel_total : 137019 time to create 1 rle with old method : 0.14062118530273438 time for calcul the mask position with numpy : 0.05115222930908203 nb_pixel_total : 16571 time to create 1 rle with old method : 0.017272472381591797 time for calcul the mask position with numpy : 0.0507967472076416 nb_pixel_total : 2809 time to create 1 rle with old method : 0.0031609535217285156 time for calcul the mask position with numpy : 0.04969024658203125 nb_pixel_total : 8885 time to create 1 rle with old method : 0.009111642837524414 time for calcul the mask position with numpy : 0.0572056770324707 nb_pixel_total : 886343 time to create 1 rle with new method : 0.7521462440490723 time for calcul the mask position with numpy : 0.054167747497558594 nb_pixel_total : 428672 time to create 1 rle with new method : 0.8711438179016113 time for calcul the mask position with numpy : 0.05016922950744629 nb_pixel_total : 59786 time to create 1 rle with old method : 0.06574869155883789 time for calcul the mask position with numpy : 0.050890445709228516 nb_pixel_total : 150062 time to create 1 rle with new method : 0.7867124080657959 time for calcul the mask position with numpy : 0.0629732608795166 nb_pixel_total : 21221 time to create 1 rle with old method : 0.02589106559753418 time for calcul the mask position with numpy : 0.06194615364074707 nb_pixel_total : 51127 time to create 1 rle with old method : 0.06879949569702148 create new chi : 28.629881381988525 time to delete rle : 0.03294849395751953 batch 1 Loaded 65 chid ids of type : 4855 Number RLEs to save : 65381 TO DO : save crop sub photo not yet done ! save time : 16.003640174865723 nb_obj : 65 nb_hashtags : 9 time to prepare the origin masks : 72.24127697944641 time for calcul the mask position with numpy : 0.5061125755310059 nb_pixel_total : 4118767 time to create 1 rle with new method : 1.256324291229248 time for calcul the mask position with numpy : 0.0505061149597168 nb_pixel_total : 91021 time to create 1 rle with old method : 0.09465527534484863 time for calcul the mask position with numpy : 0.051174163818359375 nb_pixel_total : 113327 time to create 1 rle with old method : 0.11736273765563965 time for calcul the mask position with numpy : 0.050974369049072266 nb_pixel_total : 52038 time to create 1 rle with old method : 0.05310249328613281 time for calcul the mask position with numpy : 0.050966739654541016 nb_pixel_total : 83284 time to create 1 rle with old method : 0.08740592002868652 time for calcul the mask position with numpy : 0.052353858947753906 nb_pixel_total : 238072 time to create 1 rle with new method : 0.9856915473937988 time for calcul the mask position with numpy : 0.05470108985900879 nb_pixel_total : 48254 time to create 1 rle with old method : 0.05556511878967285 time for calcul the mask position with numpy : 0.05144929885864258 nb_pixel_total : 33174 time to create 1 rle with old method : 0.03537631034851074 time for calcul the mask position with numpy : 0.08450078964233398 nb_pixel_total : 1029063 time to create 1 rle with new method : 0.9550948143005371 time for calcul the mask position with numpy : 0.05048823356628418 nb_pixel_total : 10127 time to create 1 rle with old method : 0.011742115020751953 time for calcul the mask position with numpy : 0.05137801170349121 nb_pixel_total : 23977 time to create 1 rle with old method : 0.026206016540527344 time for calcul the mask position with numpy : 0.054651737213134766 nb_pixel_total : 30227 time to create 1 rle with old method : 0.036766767501831055 time for calcul the mask position with numpy : 0.06014442443847656 nb_pixel_total : 84701 time to create 1 rle with old method : 0.11002492904663086 time for calcul the mask position with numpy : 0.06135892868041992 nb_pixel_total : 614649 time to create 1 rle with new method : 1.6368916034698486 time for calcul the mask position with numpy : 0.054022789001464844 nb_pixel_total : 241087 time to create 1 rle with new method : 1.4595286846160889 time for calcul the mask position with numpy : 0.05346345901489258 nb_pixel_total : 65619 time to create 1 rle with old method : 0.07380795478820801 time for calcul the mask position with numpy : 0.052590131759643555 nb_pixel_total : 28442 time to create 1 rle with old method : 0.03231096267700195 time for calcul the mask position with numpy : 0.05266714096069336 nb_pixel_total : 24862 time to create 1 rle with old method : 0.02816462516784668 time for calcul the mask position with numpy : 0.05342459678649902 nb_pixel_total : 117731 time to create 1 rle with old method : 0.12636017799377441 time for calcul the mask position with numpy : 0.05374288558959961 nb_pixel_total : 45647 time to create 1 rle with old method : 0.05186891555786133 time for calcul the mask position with numpy : 0.054361820220947266 nb_pixel_total : 25316 time to create 1 rle with old method : 0.03316140174865723 time for calcul the mask position with numpy : 0.053732872009277344 nb_pixel_total : 38670 time to create 1 rle with old method : 0.044712066650390625 time for calcul the mask position with numpy : 0.055451393127441406 nb_pixel_total : 347483 time to create 1 rle with new method : 1.090461015701294 time for calcul the mask position with numpy : 0.05433845520019531 nb_pixel_total : 2937 time to create 1 rle with old method : 0.0039217472076416016 time for calcul the mask position with numpy : 0.054173946380615234 nb_pixel_total : 90601 time to create 1 rle with old method : 0.1035163402557373 time for calcul the mask position with numpy : 0.06934547424316406 nb_pixel_total : 71580 time to create 1 rle with old method : 0.0978538990020752 time for calcul the mask position with numpy : 0.05504894256591797 nb_pixel_total : 44286 time to create 1 rle with old method : 0.049867868423461914 time for calcul the mask position with numpy : 0.054128170013427734 nb_pixel_total : 65338 time to create 1 rle with old method : 0.0760660171508789 time for calcul the mask position with numpy : 0.0551304817199707 nb_pixel_total : 114670 time to create 1 rle with old method : 0.1321272850036621 time for calcul the mask position with numpy : 0.05539894104003906 nb_pixel_total : 121276 time to create 1 rle with old method : 0.1396028995513916 time for calcul the mask position with numpy : 0.05626201629638672 nb_pixel_total : 129 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.0533299446105957 nb_pixel_total : 12869 time to create 1 rle with old method : 0.014730453491210938 time for calcul the mask position with numpy : 0.054053306579589844 nb_pixel_total : 45245 time to create 1 rle with old method : 0.05241727828979492 time for calcul the mask position with numpy : 0.05867576599121094 nb_pixel_total : 215602 time to create 1 rle with new method : 1.374161720275879 time for calcul the mask position with numpy : 0.05367732048034668 nb_pixel_total : 4325 time to create 1 rle with old method : 0.005387544631958008 time for calcul the mask position with numpy : 0.05611109733581543 nb_pixel_total : 124282 time to create 1 rle with old method : 0.14036965370178223 time for calcul the mask position with numpy : 0.05402231216430664 nb_pixel_total : 59721 time to create 1 rle with old method : 0.06916213035583496 time for calcul the mask position with numpy : 0.05421257019042969 nb_pixel_total : 87837 time to create 1 rle with old method : 0.10571837425231934 time for calcul the mask position with numpy : 0.05450630187988281 nb_pixel_total : 28066 time to create 1 rle with old method : 0.03266763687133789 time for calcul the mask position with numpy : 0.05562734603881836 nb_pixel_total : 299108 time to create 1 rle with new method : 1.3052828311920166 time for calcul the mask position with numpy : 0.05479264259338379 nb_pixel_total : 51205 time to create 1 rle with old method : 0.060537099838256836 time for calcul the mask position with numpy : 0.07041668891906738 nb_pixel_total : 679386 time to create 1 rle with new method : 1.5004780292510986 time for calcul the mask position with numpy : 0.059023141860961914 nb_pixel_total : 568899 time to create 1 rle with new method : 1.3967933654785156 time for calcul the mask position with numpy : 0.05575823783874512 nb_pixel_total : 217292 time to create 1 rle with new method : 0.9597022533416748 time for calcul the mask position with numpy : 0.05082273483276367 nb_pixel_total : 45863 time to create 1 rle with old method : 0.05245018005371094 time for calcul the mask position with numpy : 0.053491830825805664 nb_pixel_total : 17767 time to create 1 rle with old method : 0.020197391510009766 time for calcul the mask position with numpy : 0.050522804260253906 nb_pixel_total : 8230 time to create 1 rle with old method : 0.009042978286743164 time for calcul the mask position with numpy : 0.05127096176147461 nb_pixel_total : 30068 time to create 1 rle with old method : 0.033083200454711914 time for calcul the mask position with numpy : 0.06186223030090332 nb_pixel_total : 829740 time to create 1 rle with new method : 0.8396041393280029 time for calcul the mask position with numpy : 0.05286836624145508 nb_pixel_total : 93275 time to create 1 rle with old method : 0.10483264923095703 time for calcul the mask position with numpy : 0.05485200881958008 nb_pixel_total : 223372 time to create 1 rle with new method : 1.4135081768035889 time for calcul the mask position with numpy : 0.05039262771606445 nb_pixel_total : 12316 time to create 1 rle with old method : 0.01277470588684082 time for calcul the mask position with numpy : 0.05526542663574219 nb_pixel_total : 248282 time to create 1 rle with new method : 0.7814071178436279 time for calcul the mask position with numpy : 0.05387759208679199 nb_pixel_total : 331808 time to create 1 rle with new method : 0.9522707462310791 time for calcul the mask position with numpy : 0.05272841453552246 nb_pixel_total : 76402 time to create 1 rle with old method : 0.08555006980895996 time for calcul the mask position with numpy : 0.05003023147583008 nb_pixel_total : 9478 time to create 1 rle with old method : 0.009926557540893555 time for calcul the mask position with numpy : 0.05067896842956543 nb_pixel_total : 19816 time to create 1 rle with old method : 0.020544767379760742 time for calcul the mask position with numpy : 0.050935983657836914 nb_pixel_total : 87287 time to create 1 rle with old method : 0.09168815612792969 time for calcul the mask position with numpy : 0.05570197105407715 nb_pixel_total : 68443 time to create 1 rle with old method : 0.07529067993164062 time for calcul the mask position with numpy : 0.05435609817504883 nb_pixel_total : 269810 time to create 1 rle with new method : 0.7852568626403809 time for calcul the mask position with numpy : 0.05443239212036133 nb_pixel_total : 34472 time to create 1 rle with old method : 0.04883575439453125 time for calcul the mask position with numpy : 0.05612516403198242 nb_pixel_total : 53219 time to create 1 rle with old method : 0.0590972900390625 time for calcul the mask position with numpy : 0.05223894119262695 nb_pixel_total : 58118 time to create 1 rle with old method : 0.06575846672058105 time for calcul the mask position with numpy : 0.0527191162109375 nb_pixel_total : 47951 time to create 1 rle with old method : 0.05379915237426758 time for calcul the mask position with numpy : 0.05175948143005371 nb_pixel_total : 137 time to create 1 rle with old method : 0.00023055076599121094 time for calcul the mask position with numpy : 0.05185270309448242 nb_pixel_total : 3154 time to create 1 rle with old method : 0.0034537315368652344 create new chi : 26.46106266975403 time to delete rle : 0.0074520111083984375 batch 1 Loaded 66 chid ids of type : 4855 Number RLEs to save : 56338 TO DO : save crop sub photo not yet done ! save time : 11.591654539108276 nb_obj : 85 nb_hashtags : 9 time to prepare the origin masks : 79.65878510475159 time for calcul the mask position with numpy : 0.4307258129119873 nb_pixel_total : 4213672 time to create 1 rle with new method : 1.095545768737793 time for calcul the mask position with numpy : 0.05483245849609375 nb_pixel_total : 44422 time to create 1 rle with old method : 0.04960823059082031 time for calcul the mask position with numpy : 0.055515289306640625 nb_pixel_total : 1864 time to create 1 rle with old method : 0.002313852310180664 time for calcul the mask position with numpy : 0.053374290466308594 nb_pixel_total : 2106 time to create 1 rle with old method : 0.0025632381439208984 time for calcul the mask position with numpy : 0.05403256416320801 nb_pixel_total : 146834 time to create 1 rle with old method : 0.16104340553283691 time for calcul the mask position with numpy : 0.06195330619812012 nb_pixel_total : 197691 time to create 1 rle with new method : 1.066986083984375 time for calcul the mask position with numpy : 0.05397844314575195 nb_pixel_total : 225967 time to create 1 rle with new method : 0.875892162322998 time for calcul the mask position with numpy : 0.05376911163330078 nb_pixel_total : 38255 time to create 1 rle with old method : 0.043622732162475586 time for calcul the mask position with numpy : 0.05451774597167969 nb_pixel_total : 255190 time to create 1 rle with new method : 1.1906960010528564 time for calcul the mask position with numpy : 0.05413103103637695 nb_pixel_total : 26082 time to create 1 rle with old method : 0.029957294464111328 time for calcul the mask position with numpy : 0.05421328544616699 nb_pixel_total : 8355 time to create 1 rle with old method : 0.010319232940673828 time for calcul the mask position with numpy : 0.0614926815032959 nb_pixel_total : 153645 time to create 1 rle with new method : 1.0990102291107178 time for calcul the mask position with numpy : 0.05462217330932617 nb_pixel_total : 35551 time to create 1 rle with old method : 0.04560661315917969 time for calcul the mask position with numpy : 0.05495119094848633 nb_pixel_total : 144678 time to create 1 rle with old method : 0.16277670860290527 time for calcul the mask position with numpy : 0.06302595138549805 nb_pixel_total : 184707 time to create 1 rle with new method : 1.2493476867675781 time for calcul the mask position with numpy : 0.054160118103027344 nb_pixel_total : 33263 time to create 1 rle with old method : 0.0388493537902832 time for calcul the mask position with numpy : 0.05491280555725098 nb_pixel_total : 87254 time to create 1 rle with old method : 0.10015606880187988 time for calcul the mask position with numpy : 0.0538630485534668 nb_pixel_total : 4829 time to create 1 rle with old method : 0.006222724914550781 time for calcul the mask position with numpy : 0.05645251274108887 nb_pixel_total : 131173 time to create 1 rle with old method : 0.15401196479797363 time for calcul the mask position with numpy : 0.05520915985107422 nb_pixel_total : 155408 time to create 1 rle with new method : 1.0233893394470215 time for calcul the mask position with numpy : 0.05463886260986328 nb_pixel_total : 11422 time to create 1 rle with old method : 0.013085603713989258 time for calcul the mask position with numpy : 0.05710411071777344 nb_pixel_total : 45618 time to create 1 rle with old method : 0.06835412979125977 time for calcul the mask position with numpy : 0.060404062271118164 nb_pixel_total : 3804 time to create 1 rle with old method : 0.005079030990600586 time for calcul the mask position with numpy : 0.06384730339050293 nb_pixel_total : 449801 time to create 1 rle with new method : 0.8462438583374023 time for calcul the mask position with numpy : 0.05407357215881348 nb_pixel_total : 41304 time to create 1 rle with old method : 0.04764509201049805 time for calcul the mask position with numpy : 0.05418539047241211 nb_pixel_total : 14753 time to create 1 rle with old method : 0.017927169799804688 time for calcul the mask position with numpy : 0.05405235290527344 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009198188781738281 time for calcul the mask position with numpy : 0.05368161201477051 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0016798973083496094 time for calcul the mask position with numpy : 0.05738973617553711 nb_pixel_total : 14401 time to create 1 rle with old method : 0.016933679580688477 time for calcul the mask position with numpy : 0.05987977981567383 nb_pixel_total : 211 time to create 1 rle with old method : 0.00043129920959472656 time for calcul the mask position with numpy : 0.06316637992858887 nb_pixel_total : 24194 time to create 1 rle with old method : 0.02783513069152832 time for calcul the mask position with numpy : 0.058087825775146484 nb_pixel_total : 6162 time to create 1 rle with old method : 0.007531404495239258 time for calcul the mask position with numpy : 0.057654380798339844 nb_pixel_total : 368281 time to create 1 rle with new method : 1.719463586807251 time for calcul the mask position with numpy : 0.05429697036743164 nb_pixel_total : 20325 time to create 1 rle with old method : 0.02436089515686035 time for calcul the mask position with numpy : 0.055605173110961914 nb_pixel_total : 149707 time to create 1 rle with old method : 0.16701459884643555 time for calcul the mask position with numpy : 0.055620431900024414 nb_pixel_total : 81475 time to create 1 rle with old method : 0.09395194053649902 time for calcul the mask position with numpy : 0.05504727363586426 nb_pixel_total : 155760 time to create 1 rle with new method : 0.8558306694030762 time for calcul the mask position with numpy : 0.09262990951538086 nb_pixel_total : 892785 time to create 1 rle with new method : 1.0324571132659912 time for calcul the mask position with numpy : 0.05560731887817383 nb_pixel_total : 31656 time to create 1 rle with old method : 0.03746819496154785 time for calcul the mask position with numpy : 0.05455160140991211 nb_pixel_total : 27137 time to create 1 rle with old method : 0.03381824493408203 time for calcul the mask position with numpy : 0.05462503433227539 nb_pixel_total : 20133 time to create 1 rle with old method : 0.02305889129638672 time for calcul the mask position with numpy : 0.05487179756164551 nb_pixel_total : 103283 time to create 1 rle with old method : 0.1153266429901123 time for calcul the mask position with numpy : 0.05398130416870117 nb_pixel_total : 14450 time to create 1 rle with old method : 0.01862502098083496 time for calcul the mask position with numpy : 0.053817033767700195 nb_pixel_total : 3458 time to create 1 rle with old method : 0.004756927490234375 time for calcul the mask position with numpy : 0.05529928207397461 nb_pixel_total : 156120 time to create 1 rle with new method : 1.453099250793457 time for calcul the mask position with numpy : 0.057593345642089844 nb_pixel_total : 315982 time to create 1 rle with new method : 1.7968895435333252 time for calcul the mask position with numpy : 0.05885601043701172 nb_pixel_total : 47002 time to create 1 rle with old method : 0.07363319396972656 time for calcul the mask position with numpy : 0.06094837188720703 nb_pixel_total : 7356 time to create 1 rle with old method : 0.010391473770141602 time for calcul the mask position with numpy : 0.06508803367614746 nb_pixel_total : 215725 time to create 1 rle with new method : 0.8993692398071289 time for calcul the mask position with numpy : 0.056313514709472656 nb_pixel_total : 261845 time to create 1 rle with new method : 1.010284423828125 time for calcul the mask position with numpy : 0.05843210220336914 nb_pixel_total : 400974 time to create 1 rle with new method : 0.8902273178100586 time for calcul the mask position with numpy : 0.054099321365356445 nb_pixel_total : 20705 time to create 1 rle with old method : 0.024744272232055664 time for calcul the mask position with numpy : 0.05438518524169922 nb_pixel_total : 69638 time to create 1 rle with old method : 0.07704329490661621 time for calcul the mask position with numpy : 0.056823015213012695 nb_pixel_total : 54884 time to create 1 rle with old method : 0.07019615173339844 time for calcul the mask position with numpy : 0.05702090263366699 nb_pixel_total : 41278 time to create 1 rle with old method : 0.049504995346069336 time for calcul the mask position with numpy : 0.059481143951416016 nb_pixel_total : 3136 time to create 1 rle with old method : 0.004449367523193359 time for calcul the mask position with numpy : 0.062117815017700195 nb_pixel_total : 107375 time to create 1 rle with old method : 0.1248619556427002 time for calcul the mask position with numpy : 0.06326913833618164 nb_pixel_total : 1346 time to create 1 rle with old method : 0.0016863346099853516 time for calcul the mask position with numpy : 0.06539607048034668 nb_pixel_total : 51415 time to create 1 rle with old method : 0.06989645957946777 time for calcul the mask position with numpy : 0.06688356399536133 nb_pixel_total : 78685 time to create 1 rle with old method : 0.09117960929870605 time for calcul the mask position with numpy : 0.06797575950622559 nb_pixel_total : 59729 time to create 1 rle with old method : 0.0702219009399414 time for calcul the mask position with numpy : 0.05893683433532715 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0017762184143066406 time for calcul the mask position with numpy : 0.05928325653076172 nb_pixel_total : 125300 time to create 1 rle with old method : 0.15091609954833984 time for calcul the mask position with numpy : 0.06305146217346191 nb_pixel_total : 11215 time to create 1 rle with old method : 0.019750118255615234 time for calcul the mask position with numpy : 0.07017111778259277 nb_pixel_total : 59670 time to create 1 rle with old method : 0.06823420524597168 time for calcul the mask position with numpy : 0.0552668571472168 nb_pixel_total : 132025 time to create 1 rle with old method : 0.15068483352661133 time for calcul the mask position with numpy : 0.0537571907043457 nb_pixel_total : 40 time to create 1 rle with old method : 1.1811251640319824 time for calcul the mask position with numpy : 0.05882143974304199 nb_pixel_total : 22680 time to create 1 rle with old method : 0.02628159523010254 time for calcul the mask position with numpy : 0.05375814437866211 nb_pixel_total : 432 time to create 1 rle with old method : 0.0007638931274414062 time for calcul the mask position with numpy : 0.05686545372009277 nb_pixel_total : 262586 time to create 1 rle with new method : 1.354938268661499 time for calcul the mask position with numpy : 0.054361581802368164 nb_pixel_total : 29479 time to create 1 rle with old method : 0.034232378005981445 time for calcul the mask position with numpy : 0.06424140930175781 nb_pixel_total : 630518 time to create 1 rle with new method : 1.0459513664245605 time for calcul the mask position with numpy : 0.0646507740020752 nb_pixel_total : 71028 time to create 1 rle with old method : 0.08176970481872559 time for calcul the mask position with numpy : 0.060622453689575195 nb_pixel_total : 75415 time to create 1 rle with old method : 0.1019737720489502 time for calcul the mask position with numpy : 0.054467201232910156 nb_pixel_total : 10945 time to create 1 rle with old method : 0.013586997985839844 time for calcul the mask position with numpy : 0.05684924125671387 nb_pixel_total : 296496 time to create 1 rle with new method : 1.0737535953521729 time for calcul the mask position with numpy : 0.05937027931213379 nb_pixel_total : 451274 time to create 1 rle with new method : 0.6112546920776367 time for calcul the mask position with numpy : 0.061032772064208984 nb_pixel_total : 102 time to create 1 rle with old method : 0.00046324729919433594 time for calcul the mask position with numpy : 0.06038975715637207 nb_pixel_total : 191172 time to create 1 rle with new method : 0.7972767353057861 time for calcul the mask position with numpy : 0.054039955139160156 nb_pixel_total : 15145 time to create 1 rle with old method : 0.017940044403076172 time for calcul the mask position with numpy : 0.053708553314208984 nb_pixel_total : 8125 time to create 1 rle with old method : 0.0096435546875 time for calcul the mask position with numpy : 0.05440497398376465 nb_pixel_total : 45478 time to create 1 rle with old method : 0.050332069396972656 time for calcul the mask position with numpy : 0.07554817199707031 nb_pixel_total : 34146 time to create 1 rle with old method : 0.039459943771362305 time for calcul the mask position with numpy : 0.06022977828979492 nb_pixel_total : 36621 time to create 1 rle with old method : 0.044812679290771484 time for calcul the mask position with numpy : 0.05533933639526367 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007116794586181641 time for calcul the mask position with numpy : 0.053437232971191406 nb_pixel_total : 1609 time to create 1 rle with old method : 0.0019698143005371094 create new chi : 33.56781625747681 time to delete rle : 0.007483243942260742 batch 1 Loaded 86 chid ids of type : 4855 Number RLEs to save : 59607 TO DO : save crop sub photo not yet done ! save time : 17.26773762702942 nb_obj : 76 nb_hashtags : 7 time to prepare the origin masks : 93.642902135849 time for calcul the mask position with numpy : 0.42279648780822754 nb_pixel_total : 2865398 time to create 1 rle with new method : 0.6173207759857178 time for calcul the mask position with numpy : 0.054511070251464844 nb_pixel_total : 84017 time to create 1 rle with old method : 0.09814286231994629 time for calcul the mask position with numpy : 0.05428123474121094 nb_pixel_total : 22547 time to create 1 rle with old method : 0.02583456039428711 time for calcul the mask position with numpy : 0.056147098541259766 nb_pixel_total : 161831 time to create 1 rle with new method : 1.0762407779693604 time for calcul the mask position with numpy : 0.05629873275756836 nb_pixel_total : 140040 time to create 1 rle with old method : 0.1731877326965332 time for calcul the mask position with numpy : 0.060178518295288086 nb_pixel_total : 12244 time to create 1 rle with old method : 0.01508784294128418 time for calcul the mask position with numpy : 0.05453777313232422 nb_pixel_total : 107811 time to create 1 rle with old method : 0.12188172340393066 time for calcul the mask position with numpy : 0.057704925537109375 nb_pixel_total : 185339 time to create 1 rle with new method : 1.7114019393920898 time for calcul the mask position with numpy : 0.057401418685913086 nb_pixel_total : 163673 time to create 1 rle with new method : 1.6213877201080322 time for calcul the mask position with numpy : 0.05434823036193848 nb_pixel_total : 72987 time to create 1 rle with old method : 0.08392667770385742 time for calcul the mask position with numpy : 0.057267189025878906 nb_pixel_total : 54201 time to create 1 rle with old method : 0.06188035011291504 time for calcul the mask position with numpy : 0.057401418685913086 nb_pixel_total : 77709 time to create 1 rle with old method : 0.10719847679138184 time for calcul the mask position with numpy : 0.07604765892028809 nb_pixel_total : 2256 time to create 1 rle with old method : 0.0037119388580322266 time for calcul the mask position with numpy : 0.06092977523803711 nb_pixel_total : 688 time to create 1 rle with old method : 0.0010139942169189453 time for calcul the mask position with numpy : 0.05850696563720703 nb_pixel_total : 364176 time to create 1 rle with new method : 1.8240413665771484 time for calcul the mask position with numpy : 0.05552864074707031 nb_pixel_total : 328754 time to create 1 rle with new method : 1.5679526329040527 time for calcul the mask position with numpy : 0.05390787124633789 nb_pixel_total : 39758 time to create 1 rle with old method : 0.04418540000915527 time for calcul the mask position with numpy : 0.054025888442993164 nb_pixel_total : 102847 time to create 1 rle with old method : 0.12060976028442383 time for calcul the mask position with numpy : 0.05381965637207031 nb_pixel_total : 95059 time to create 1 rle with old method : 0.10618996620178223 time for calcul the mask position with numpy : 0.05718636512756348 nb_pixel_total : 102234 time to create 1 rle with old method : 0.1255326271057129 time for calcul the mask position with numpy : 0.05401015281677246 nb_pixel_total : 33403 time to create 1 rle with old method : 0.03741812705993652 time for calcul the mask position with numpy : 0.05425834655761719 nb_pixel_total : 68787 time to create 1 rle with old method : 0.0784444808959961 time for calcul the mask position with numpy : 0.05470108985900879 nb_pixel_total : 21509 time to create 1 rle with old method : 0.02533698081970215 time for calcul the mask position with numpy : 0.05355381965637207 nb_pixel_total : 1256 time to create 1 rle with old method : 0.0015404224395751953 time for calcul the mask position with numpy : 0.05412006378173828 nb_pixel_total : 44496 time to create 1 rle with old method : 0.0519413948059082 time for calcul the mask position with numpy : 0.053633689880371094 nb_pixel_total : 16012 time to create 1 rle with old method : 0.018215179443359375 time for calcul the mask position with numpy : 0.05329418182373047 nb_pixel_total : 1666 time to create 1 rle with old method : 0.001924753189086914 time for calcul the mask position with numpy : 0.05340743064880371 nb_pixel_total : 20802 time to create 1 rle with old method : 0.024788379669189453 time for calcul the mask position with numpy : 0.05393195152282715 nb_pixel_total : 26802 time to create 1 rle with old method : 0.03019547462463379 time for calcul the mask position with numpy : 0.05336284637451172 nb_pixel_total : 17865 time to create 1 rle with old method : 0.02044200897216797 time for calcul the mask position with numpy : 0.05570530891418457 nb_pixel_total : 326797 time to create 1 rle with new method : 1.2694942951202393 time for calcul the mask position with numpy : 0.05605268478393555 nb_pixel_total : 189699 time to create 1 rle with new method : 1.640939474105835 time for calcul the mask position with numpy : 0.05193972587585449 nb_pixel_total : 24483 time to create 1 rle with old method : 0.027126073837280273 time for calcul the mask position with numpy : 0.05165433883666992 nb_pixel_total : 25911 time to create 1 rle with old method : 0.027749300003051758 time for calcul the mask position with numpy : 0.056832075119018555 nb_pixel_total : 443341 time to create 1 rle with new method : 3.8788199424743652 time for calcul the mask position with numpy : 0.05356001853942871 nb_pixel_total : 19420 time to create 1 rle with old method : 0.021999597549438477 time for calcul the mask position with numpy : 0.05301022529602051 nb_pixel_total : 63818 time to create 1 rle with old method : 0.07571768760681152 time for calcul the mask position with numpy : 0.05161595344543457 nb_pixel_total : 56109 time to create 1 rle with old method : 0.05986523628234863 time for calcul the mask position with numpy : 0.05450296401977539 nb_pixel_total : 295027 time to create 1 rle with new method : 1.2081477642059326 time for calcul the mask position with numpy : 0.05154871940612793 nb_pixel_total : 5 time to create 1 rle with old method : 6.365776062011719e-05 time for calcul the mask position with numpy : 0.051053762435913086 nb_pixel_total : 69568 time to create 1 rle with old method : 0.07414865493774414 time for calcul the mask position with numpy : 0.0511479377746582 nb_pixel_total : 4369 time to create 1 rle with old method : 0.004675865173339844 time for calcul the mask position with numpy : 0.051249027252197266 nb_pixel_total : 166110 time to create 1 rle with new method : 0.940331220626831 time for calcul the mask position with numpy : 0.05033683776855469 nb_pixel_total : 35438 time to create 1 rle with old method : 0.038289785385131836 time for calcul the mask position with numpy : 0.05166292190551758 nb_pixel_total : 59693 time to create 1 rle with old method : 0.06602764129638672 time for calcul the mask position with numpy : 0.0765535831451416 nb_pixel_total : 886469 time to create 1 rle with new method : 0.8939440250396729 time for calcul the mask position with numpy : 0.05120229721069336 nb_pixel_total : 32160 time to create 1 rle with old method : 0.03345894813537598 time for calcul the mask position with numpy : 0.05331015586853027 nb_pixel_total : 427882 time to create 1 rle with new method : 0.8218326568603516 time for calcul the mask position with numpy : 0.05316591262817383 nb_pixel_total : 2814 time to create 1 rle with old method : 0.0034475326538085938 time for calcul the mask position with numpy : 0.06098580360412598 nb_pixel_total : 851029 time to create 1 rle with new method : 1.0731053352355957 time for calcul the mask position with numpy : 0.05004262924194336 nb_pixel_total : 195 time to create 1 rle with old method : 0.0004553794860839844 time for calcul the mask position with numpy : 0.05227255821228027 nb_pixel_total : 4362 time to create 1 rle with old method : 0.005636692047119141 time for calcul the mask position with numpy : 0.05037856101989746 nb_pixel_total : 9614 time to create 1 rle with old method : 0.010534286499023438 time for calcul the mask position with numpy : 0.049846649169921875 nb_pixel_total : 131 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.05347561836242676 nb_pixel_total : 140638 time to create 1 rle with old method : 0.1536710262298584 time for calcul the mask position with numpy : 0.051513671875 nb_pixel_total : 122481 time to create 1 rle with old method : 0.13675713539123535 time for calcul the mask position with numpy : 0.05235910415649414 nb_pixel_total : 35163 time to create 1 rle with old method : 0.0375370979309082 time for calcul the mask position with numpy : 0.05310559272766113 nb_pixel_total : 183191 time to create 1 rle with new method : 1.0226294994354248 time for calcul the mask position with numpy : 0.054677724838256836 nb_pixel_total : 166388 time to create 1 rle with new method : 1.0664949417114258 time for calcul the mask position with numpy : 0.054956912994384766 nb_pixel_total : 281012 time to create 1 rle with new method : 1.0575735569000244 time for calcul the mask position with numpy : 0.06604576110839844 nb_pixel_total : 700897 time to create 1 rle with new method : 1.0667543411254883 time for calcul the mask position with numpy : 0.058478593826293945 nb_pixel_total : 509335 time to create 1 rle with new method : 1.9506101608276367 time for calcul the mask position with numpy : 0.06128287315368652 nb_pixel_total : 27747 time to create 1 rle with old method : 0.03870034217834473 time for calcul the mask position with numpy : 0.07105565071105957 nb_pixel_total : 679771 time to create 1 rle with new method : 1.9495060443878174 time for calcul the mask position with numpy : 0.05311870574951172 nb_pixel_total : 184022 time to create 1 rle with new method : 2.0763819217681885 time for calcul the mask position with numpy : 0.0525970458984375 nb_pixel_total : 17378 time to create 1 rle with old method : 0.0200347900390625 time for calcul the mask position with numpy : 0.052910566329956055 nb_pixel_total : 31073 time to create 1 rle with old method : 0.03575706481933594 time for calcul the mask position with numpy : 0.05347132682800293 nb_pixel_total : 262692 time to create 1 rle with new method : 1.8200078010559082 time for calcul the mask position with numpy : 0.05326128005981445 nb_pixel_total : 133613 time to create 1 rle with old method : 0.14972639083862305 time for calcul the mask position with numpy : 0.052545785903930664 nb_pixel_total : 85211 time to create 1 rle with old method : 0.0928659439086914 time for calcul the mask position with numpy : 0.05393075942993164 nb_pixel_total : 539 time to create 1 rle with old method : 0.0008103847503662109 time for calcul the mask position with numpy : 0.05746173858642578 nb_pixel_total : 29383 time to create 1 rle with old method : 0.04456377029418945 time for calcul the mask position with numpy : 0.05667543411254883 nb_pixel_total : 31934 time to create 1 rle with old method : 0.03690338134765625 time for calcul the mask position with numpy : 0.05413222312927246 nb_pixel_total : 38257 time to create 1 rle with old method : 0.04474973678588867 time for calcul the mask position with numpy : 0.05544590950012207 nb_pixel_total : 5429 time to create 1 rle with old method : 0.006833076477050781 time for calcul the mask position with numpy : 0.05484938621520996 nb_pixel_total : 51180 time to create 1 rle with old method : 0.05997347831726074 time for calcul the mask position with numpy : 0.05547928810119629 nb_pixel_total : 31255 time to create 1 rle with old method : 0.035889387130737305 create new chi : 40.74838852882385 time to delete rle : 0.007216453552246094 batch 1 Loaded 77 chid ids of type : 4855 Number RLEs to save : 56249 TO DO : save crop sub photo not yet done ! save time : 46.45588517189026 nb_obj : 68 nb_hashtags : 9 time to prepare the origin masks : 84.08787775039673 time for calcul the mask position with numpy : 1.003067970275879 nb_pixel_total : 5045247 time to create 1 rle with new method : 2.141261577606201 time for calcul the mask position with numpy : 0.05565595626831055 nb_pixel_total : 6150 time to create 1 rle with old method : 0.008215904235839844 time for calcul the mask position with numpy : 0.05627894401550293 nb_pixel_total : 43916 time to create 1 rle with old method : 0.05100226402282715 time for calcul the mask position with numpy : 0.054290771484375 nb_pixel_total : 17849 time to create 1 rle with old method : 0.021288633346557617 time for calcul the mask position with numpy : 0.05648446083068848 nb_pixel_total : 109596 time to create 1 rle with old method : 0.12184882164001465 time for calcul the mask position with numpy : 0.05542707443237305 nb_pixel_total : 12440 time to create 1 rle with old method : 0.016582489013671875 time for calcul the mask position with numpy : 0.06113862991333008 nb_pixel_total : 15408 time to create 1 rle with old method : 0.021982669830322266 time for calcul the mask position with numpy : 0.054930686950683594 nb_pixel_total : 27532 time to create 1 rle with old method : 0.031786203384399414 time for calcul the mask position with numpy : 0.05506443977355957 nb_pixel_total : 39028 time to create 1 rle with old method : 0.1606612205505371 time for calcul the mask position with numpy : 0.05928301811218262 nb_pixel_total : 146617 time to create 1 rle with old method : 0.19277048110961914 time for calcul the mask position with numpy : 0.05674886703491211 nb_pixel_total : 58632 time to create 1 rle with old method : 0.06606006622314453 time for calcul the mask position with numpy : 0.05950498580932617 nb_pixel_total : 259380 time to create 1 rle with new method : 1.7311925888061523 time for calcul the mask position with numpy : 0.05431485176086426 nb_pixel_total : 91058 time to create 1 rle with old method : 0.10006523132324219 time for calcul the mask position with numpy : 0.05481886863708496 nb_pixel_total : 3504 time to create 1 rle with old method : 0.0044591426849365234 time for calcul the mask position with numpy : 0.055750370025634766 nb_pixel_total : 16045 time to create 1 rle with old method : 0.020380258560180664 time for calcul the mask position with numpy : 0.05949139595031738 nb_pixel_total : 18633 time to create 1 rle with old method : 0.022351741790771484 time for calcul the mask position with numpy : 0.05508136749267578 nb_pixel_total : 50210 time to create 1 rle with old method : 0.05749940872192383 time for calcul the mask position with numpy : 0.05341672897338867 nb_pixel_total : 52156 time to create 1 rle with old method : 0.06060624122619629 time for calcul the mask position with numpy : 0.05911827087402344 nb_pixel_total : 309214 time to create 1 rle with new method : 0.8372571468353271 time for calcul the mask position with numpy : 0.054702043533325195 nb_pixel_total : 4513 time to create 1 rle with old method : 0.005796670913696289 time for calcul the mask position with numpy : 0.054639577865600586 nb_pixel_total : 48449 time to create 1 rle with old method : 0.057096004486083984 time for calcul the mask position with numpy : 0.058914899826049805 nb_pixel_total : 2677 time to create 1 rle with old method : 0.0035126209259033203 time for calcul the mask position with numpy : 0.0559995174407959 nb_pixel_total : 114012 time to create 1 rle with old method : 0.12828326225280762 time for calcul the mask position with numpy : 0.05493521690368652 nb_pixel_total : 119205 time to create 1 rle with old method : 0.14073753356933594 time for calcul the mask position with numpy : 0.05431866645812988 nb_pixel_total : 26599 time to create 1 rle with old method : 0.030951499938964844 time for calcul the mask position with numpy : 0.059763431549072266 nb_pixel_total : 415640 time to create 1 rle with new method : 1.3263046741485596 time for calcul the mask position with numpy : 0.05493974685668945 nb_pixel_total : 107903 time to create 1 rle with old method : 0.12050461769104004 time for calcul the mask position with numpy : 0.055982112884521484 nb_pixel_total : 216812 time to create 1 rle with new method : 1.0160648822784424 time for calcul the mask position with numpy : 0.0584871768951416 nb_pixel_total : 386419 time to create 1 rle with new method : 1.3860621452331543 time for calcul the mask position with numpy : 0.05584526062011719 nb_pixel_total : 32490 time to create 1 rle with old method : 0.03649449348449707 time for calcul the mask position with numpy : 0.05468440055847168 nb_pixel_total : 1582 time to create 1 rle with old method : 0.002628803253173828 time for calcul the mask position with numpy : 0.05498337745666504 nb_pixel_total : 54777 time to create 1 rle with old method : 0.06311774253845215 time for calcul the mask position with numpy : 0.05548739433288574 nb_pixel_total : 62907 time to create 1 rle with old method : 0.07064414024353027 time for calcul the mask position with numpy : 0.055274248123168945 nb_pixel_total : 65151 time to create 1 rle with old method : 0.09184479713439941 time for calcul the mask position with numpy : 0.09576821327209473 nb_pixel_total : 954894 time to create 1 rle with new method : 1.3626794815063477 time for calcul the mask position with numpy : 0.05657649040222168 nb_pixel_total : 11925 time to create 1 rle with old method : 0.014578104019165039 time for calcul the mask position with numpy : 0.058020830154418945 nb_pixel_total : 268313 time to create 1 rle with new method : 0.8624112606048584 time for calcul the mask position with numpy : 0.05591630935668945 nb_pixel_total : 82039 time to create 1 rle with old method : 0.09258365631103516 time for calcul the mask position with numpy : 0.0550084114074707 nb_pixel_total : 20607 time to create 1 rle with old method : 0.022837400436401367 time for calcul the mask position with numpy : 0.05642199516296387 nb_pixel_total : 57148 time to create 1 rle with old method : 0.06523418426513672 time for calcul the mask position with numpy : 0.05779528617858887 nb_pixel_total : 8727 time to create 1 rle with old method : 0.014735221862792969 time for calcul the mask position with numpy : 0.06055021286010742 nb_pixel_total : 154904 time to create 1 rle with new method : 1.1332945823669434 time for calcul the mask position with numpy : 0.056737422943115234 nb_pixel_total : 111091 time to create 1 rle with old method : 0.12658095359802246 time for calcul the mask position with numpy : 0.0595095157623291 nb_pixel_total : 462752 time to create 1 rle with new method : 0.6613848209381104 time for calcul the mask position with numpy : 0.05678510665893555 nb_pixel_total : 25469 time to create 1 rle with old method : 0.029453277587890625 time for calcul the mask position with numpy : 0.05408334732055664 nb_pixel_total : 49463 time to create 1 rle with old method : 0.0562748908996582 time for calcul the mask position with numpy : 0.05971240997314453 nb_pixel_total : 180267 time to create 1 rle with new method : 0.730949878692627 time for calcul the mask position with numpy : 0.05783534049987793 nb_pixel_total : 66923 time to create 1 rle with old method : 0.0798959732055664 time for calcul the mask position with numpy : 0.05696845054626465 nb_pixel_total : 5358 time to create 1 rle with old method : 0.006460666656494141 time for calcul the mask position with numpy : 0.05887770652770996 nb_pixel_total : 94845 time to create 1 rle with old method : 0.13117671012878418 time for calcul the mask position with numpy : 0.05575227737426758 nb_pixel_total : 4262 time to create 1 rle with old method : 0.0057621002197265625 time for calcul the mask position with numpy : 0.07392621040344238 nb_pixel_total : 181941 time to create 1 rle with new method : 0.7279360294342041 time for calcul the mask position with numpy : 0.0787501335144043 nb_pixel_total : 765348 time to create 1 rle with new method : 0.8439664840698242 time for calcul the mask position with numpy : 0.05774402618408203 nb_pixel_total : 77076 time to create 1 rle with old method : 0.08840751647949219 time for calcul the mask position with numpy : 0.0566864013671875 nb_pixel_total : 138450 time to create 1 rle with old method : 0.15466070175170898 time for calcul the mask position with numpy : 0.05771064758300781 nb_pixel_total : 125008 time to create 1 rle with old method : 0.1377089023590088 time for calcul the mask position with numpy : 0.05578184127807617 nb_pixel_total : 124097 time to create 1 rle with old method : 0.13135695457458496 time for calcul the mask position with numpy : 0.05745959281921387 nb_pixel_total : 421906 time to create 1 rle with new method : 1.406083106994629 time for calcul the mask position with numpy : 0.054727792739868164 nb_pixel_total : 92 time to create 1 rle with old method : 0.0004200935363769531 time for calcul the mask position with numpy : 0.05493807792663574 nb_pixel_total : 284 time to create 1 rle with old method : 0.0006170272827148438 time for calcul the mask position with numpy : 0.05608987808227539 nb_pixel_total : 98734 time to create 1 rle with old method : 0.12981390953063965 time for calcul the mask position with numpy : 0.056333303451538086 nb_pixel_total : 69535 time to create 1 rle with old method : 0.08191633224487305 time for calcul the mask position with numpy : 0.05576586723327637 nb_pixel_total : 5053 time to create 1 rle with old method : 0.006346464157104492 time for calcul the mask position with numpy : 0.055795907974243164 nb_pixel_total : 69914 time to create 1 rle with old method : 0.0796205997467041 time for calcul the mask position with numpy : 0.0556941032409668 nb_pixel_total : 88067 time to create 1 rle with old method : 0.10533356666564941 time for calcul the mask position with numpy : 0.060698747634887695 nb_pixel_total : 94975 time to create 1 rle with old method : 0.10332703590393066 time for calcul the mask position with numpy : 0.05433773994445801 nb_pixel_total : 43298 time to create 1 rle with old method : 0.049256324768066406 time for calcul the mask position with numpy : 0.057585954666137695 nb_pixel_total : 129244 time to create 1 rle with old method : 0.13886189460754395 time for calcul the mask position with numpy : 0.05387592315673828 nb_pixel_total : 5440 time to create 1 rle with old method : 0.006223201751708984 create new chi : 25.42646884918213 time to delete rle : 0.00979161262512207 batch 1 Loaded 69 chid ids of type : 4855 Number RLEs to save : 56924 TO DO : save crop sub photo not yet done ! save time : 17.251662731170654 nb_obj : 51 nb_hashtags : 7 time to prepare the origin masks : 62.90005826950073 time for calcul the mask position with numpy : 0.5760493278503418 nb_pixel_total : 2415225 time to create 1 rle with new method : 1.8273115158081055 time for calcul the mask position with numpy : 0.07010030746459961 nb_pixel_total : 376002 time to create 1 rle with new method : 1.4288408756256104 time for calcul the mask position with numpy : 0.10292720794677734 nb_pixel_total : 748610 time to create 1 rle with new method : 1.7925331592559814 time for calcul the mask position with numpy : 0.05660605430603027 nb_pixel_total : 31680 time to create 1 rle with old method : 0.03852558135986328 time for calcul the mask position with numpy : 0.05600595474243164 nb_pixel_total : 7835 time to create 1 rle with old method : 0.009449481964111328 time for calcul the mask position with numpy : 0.055266618728637695 nb_pixel_total : 520 time to create 1 rle with old method : 0.0008461475372314453 time for calcul the mask position with numpy : 0.05738353729248047 nb_pixel_total : 277730 time to create 1 rle with new method : 2.236818790435791 time for calcul the mask position with numpy : 0.0558168888092041 nb_pixel_total : 45296 time to create 1 rle with old method : 0.06754517555236816 time for calcul the mask position with numpy : 0.061347007751464844 nb_pixel_total : 38856 time to create 1 rle with old method : 0.04570174217224121 time for calcul the mask position with numpy : 0.05505633354187012 nb_pixel_total : 48335 time to create 1 rle with old method : 0.05428647994995117 time for calcul the mask position with numpy : 0.05487465858459473 nb_pixel_total : 17402 time to create 1 rle with old method : 0.02030658721923828 time for calcul the mask position with numpy : 0.05671811103820801 nb_pixel_total : 55027 time to create 1 rle with old method : 0.08193850517272949 time for calcul the mask position with numpy : 0.06319618225097656 nb_pixel_total : 88461 time to create 1 rle with old method : 0.10139894485473633 time for calcul the mask position with numpy : 0.054918766021728516 nb_pixel_total : 75296 time to create 1 rle with old method : 0.0957193374633789 time for calcul the mask position with numpy : 0.055724143981933594 nb_pixel_total : 85482 time to create 1 rle with old method : 0.10099530220031738 time for calcul the mask position with numpy : 0.05553793907165527 nb_pixel_total : 185519 time to create 1 rle with new method : 1.9924819469451904 time for calcul the mask position with numpy : 0.05664253234863281 nb_pixel_total : 1596 time to create 1 rle with old method : 0.002460956573486328 time for calcul the mask position with numpy : 0.05609464645385742 nb_pixel_total : 5959 time to create 1 rle with old method : 0.0076198577880859375 time for calcul the mask position with numpy : 0.05669546127319336 nb_pixel_total : 59664 time to create 1 rle with old method : 0.07570409774780273 time for calcul the mask position with numpy : 0.0610804557800293 nb_pixel_total : 74876 time to create 1 rle with old method : 0.0873270034790039 time for calcul the mask position with numpy : 0.05581927299499512 nb_pixel_total : 2155 time to create 1 rle with old method : 0.0029449462890625 time for calcul the mask position with numpy : 0.05750441551208496 nb_pixel_total : 191770 time to create 1 rle with new method : 2.318751096725464 time for calcul the mask position with numpy : 0.06576371192932129 nb_pixel_total : 720766 time to create 1 rle with new method : 1.4294764995574951 time for calcul the mask position with numpy : 0.059690237045288086 nb_pixel_total : 376452 time to create 1 rle with new method : 1.2424302101135254 time for calcul the mask position with numpy : 0.06655025482177734 nb_pixel_total : 841414 time to create 1 rle with new method : 1.1208398342132568 time for calcul the mask position with numpy : 0.057355403900146484 nb_pixel_total : 126740 time to create 1 rle with old method : 0.14820551872253418 time for calcul the mask position with numpy : 0.05601143836975098 nb_pixel_total : 212032 time to create 1 rle with new method : 0.9893300533294678 time for calcul the mask position with numpy : 0.07748723030090332 nb_pixel_total : 755652 time to create 1 rle with new method : 1.5429894924163818 time for calcul the mask position with numpy : 0.051842451095581055 nb_pixel_total : 18565 time to create 1 rle with old method : 0.020724058151245117 time for calcul the mask position with numpy : 0.051579952239990234 nb_pixel_total : 5335 time to create 1 rle with old method : 0.006367683410644531 time for calcul the mask position with numpy : 0.05772972106933594 nb_pixel_total : 392379 time to create 1 rle with new method : 1.2339746952056885 time for calcul the mask position with numpy : 0.05877256393432617 nb_pixel_total : 843002 time to create 1 rle with new method : 1.7201216220855713 time for calcul the mask position with numpy : 0.05784440040588379 nb_pixel_total : 75926 time to create 1 rle with old method : 0.08467769622802734 time for calcul the mask position with numpy : 0.05491375923156738 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0041387081146240234 time for calcul the mask position with numpy : 0.05503511428833008 nb_pixel_total : 46056 time to create 1 rle with old method : 0.05181264877319336 time for calcul the mask position with numpy : 0.056888580322265625 nb_pixel_total : 29005 time to create 1 rle with old method : 0.0341339111328125 time for calcul the mask position with numpy : 0.057942867279052734 nb_pixel_total : 75591 time to create 1 rle with old method : 0.08918237686157227 time for calcul the mask position with numpy : 0.07201719284057617 nb_pixel_total : 1098006 time to create 1 rle with new method : 1.7109246253967285 time for calcul the mask position with numpy : 0.05437278747558594 nb_pixel_total : 8351 time to create 1 rle with old method : 0.010558128356933594 time for calcul the mask position with numpy : 0.05774807929992676 nb_pixel_total : 241631 time to create 1 rle with new method : 1.6966423988342285 time for calcul the mask position with numpy : 0.05203747749328613 nb_pixel_total : 34181 time to create 1 rle with old method : 0.037935733795166016 time for calcul the mask position with numpy : 0.05365347862243652 nb_pixel_total : 170518 time to create 1 rle with new method : 1.4438278675079346 time for calcul the mask position with numpy : 0.050518035888671875 nb_pixel_total : 6543 time to create 1 rle with old method : 0.0070340633392333984 time for calcul the mask position with numpy : 0.05128622055053711 nb_pixel_total : 81352 time to create 1 rle with old method : 0.08716368675231934 time for calcul the mask position with numpy : 0.05085945129394531 nb_pixel_total : 9763 time to create 1 rle with old method : 0.011391162872314453 time for calcul the mask position with numpy : 0.31792688369750977 nb_pixel_total : 1286375 time to create 1 rle with new method : 1.7482318878173828 time for calcul the mask position with numpy : 0.05253410339355469 nb_pixel_total : 7280 time to create 1 rle with old method : 0.008333683013916016 time for calcul the mask position with numpy : 0.054116010665893555 nb_pixel_total : 11569 time to create 1 rle with old method : 0.014675617218017578 time for calcul the mask position with numpy : 0.05508065223693848 nb_pixel_total : 24528 time to create 1 rle with old method : 0.0267488956451416 time for calcul the mask position with numpy : 0.059023380279541016 nb_pixel_total : 622069 time to create 1 rle with new method : 1.6888954639434814 time for calcul the mask position with numpy : 0.05486702919006348 nb_pixel_total : 634 time to create 1 rle with old method : 0.000972747802734375 time for calcul the mask position with numpy : 0.05339980125427246 nb_pixel_total : 21262 time to create 1 rle with old method : 0.02269721031188965 create new chi : 35.51903057098389 time to delete rle : 0.006356000900268555 batch 1 Loaded 52 chid ids of type : 4855 Number RLEs to save : 49962 TO DO : save crop sub photo not yet done ! save time : 19.253602027893066 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 31.60076880455017 time for calcul the mask position with numpy : 0.16660189628601074 nb_pixel_total : 1363398 time to create 1 rle with new method : 1.201765537261963 time for calcul the mask position with numpy : 0.07395005226135254 nb_pixel_total : 57961 time to create 1 rle with old method : 0.07350039482116699 time for calcul the mask position with numpy : 0.06644058227539062 nb_pixel_total : 60585 time to create 1 rle with old method : 0.07143187522888184 time for calcul the mask position with numpy : 0.0652456283569336 nb_pixel_total : 35849 time to create 1 rle with old method : 0.041723012924194336 time for calcul the mask position with numpy : 0.04126310348510742 nb_pixel_total : 231224 time to create 1 rle with new method : 0.9748349189758301 time for calcul the mask position with numpy : 0.04668569564819336 nb_pixel_total : 371430 time to create 1 rle with new method : 1.2736093997955322 time for calcul the mask position with numpy : 0.07144498825073242 nb_pixel_total : 607645 time to create 1 rle with new method : 1.3380546569824219 time for calcul the mask position with numpy : 0.07888960838317871 nb_pixel_total : 694729 time to create 1 rle with new method : 1.7044517993927002 time for calcul the mask position with numpy : 0.06724214553833008 nb_pixel_total : 15612 time to create 1 rle with old method : 0.018245458602905273 time for calcul the mask position with numpy : 0.7107102870941162 nb_pixel_total : 6319508 time to create 1 rle with new method : 1.6513152122497559 time for calcul the mask position with numpy : 0.05441856384277344 nb_pixel_total : 42826 time to create 1 rle with old method : 0.05050539970397949 time for calcul the mask position with numpy : 0.06487894058227539 nb_pixel_total : 41262 time to create 1 rle with old method : 0.047532081604003906 time for calcul the mask position with numpy : 0.3088526725769043 nb_pixel_total : 3137171 time to create 1 rle with new method : 1.5573320388793945 create new chi : 12.197339057922363 time to delete rle : 0.0031507015228271484 batch 1 Loaded 13 chid ids of type : 4855 Number RLEs to save : 23797 TO DO : save crop sub photo not yet done ! save time : 10.255980491638184 map_output_result : {1342523940: (0.4262014102100858, 'Should be the crop_list due to order', 0.4004116126269211), 1342523935: (0.4262014102100858, 'Should be the crop_list due to order', 0.36983391115942693), 1342523898: (0.4262014102100858, 'Should be the crop_list due to order', 0.16445818943571283), 1342523894: (0.4262014102100858, 'Should be the crop_list due to order', 0.4940541312989793), 1342523889: (0.4262014102100858, 'Should be the crop_list due to order', 0.16684889926073404), 1342523886: (0.4262014102100858, 'Should be the crop_list due to order', 0.538535712317738), 1342523883: (0.4262014102100858, 'Should be the crop_list due to order', 0.8492674153710883)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 7 /1342523940.Didn't retrieve data . /1342523935.Didn't retrieve data . /1342523898.Didn't retrieve data . /1342523894.Didn't retrieve data . /1342523889.Didn't retrieve data . /1342523886.Didn't retrieve data . /1342523883.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013765096664428711 save_final save missing photos in datou_result : time spend for datou_step_exec : 843.8343389034271 time spend to save output : 0.08120942115783691 total time spend for step 5 : 843.915548324585 step6:crop_condition Tue Mar 11 02:44:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 428 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3015255 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657540_2270654 we have uploaded 54 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.900883913040161 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 105 About to insert : list_path_to_insert length 105 new photo from crops ! About to upload 105 photos upload in portfolio : 3015255 init cache_photo without model_param we have 105 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657629_2270654 we have uploaded 105 photos in the portfolio 3015255 time of upload the photos Elapsed time : 49.05675172805786 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657685_2270654 we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.55526065826416 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657693_2270654 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.216068983078003 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3015255 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657728_2270654 we have uploaded 32 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.61911916732788 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657743_2270654 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.2082703113555908 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3015255 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657800_2270654 we have uploaded 41 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.55063509941101 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657821_2270654 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.9141578674316406 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3015255 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657833_2270654 we have uploaded 10 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.6662437915802 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741657957_2270654 we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.784194231033325 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 302 /1342779530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342779631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342780999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342781014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1342783104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 913 time used for this insertion : 0.11904072761535645 save_final save missing photos in datou_result : time spend for datou_step_exec : 535.8684170246124 time spend to save output : 0.47020745277404785 total time spend for step 6 : 536.3386244773865 step7:ventilate_hashtags_in_portfolio Tue Mar 11 02:53:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21222499 get user id for portfolio 21222499 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222499 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222499 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222499 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222499 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/21252510,21252511,21252512,21252513,21252514,21252519,21252521,21252522,21252523,21252524,21252525,21252526,21252528,21252529,21252530,21252531,21252532,21252533,21252534,21252535?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222499 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 1 /21222499. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.018786907196044922 save_final save missing photos in datou_result : time spend for datou_step_exec : 22.743407487869263 time spend to save output : 0.019129037857055664 total time spend for step 7 : 22.76253652572632 step8:final Tue Mar 11 02:53:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1342523940: ('0.37675382389150175',), 1342523935: ('0.37675382389150175',), 1342523898: ('0.37675382389150175',), 1342523894: ('0.37675382389150175',), 1342523889: ('0.37675382389150175',), 1342523886: ('0.37675382389150175',), 1342523883: ('0.37675382389150175',)} new output for save of step final : {1342523940: ('0.37675382389150175',), 1342523935: ('0.37675382389150175',), 1342523898: ('0.37675382389150175',), 1342523894: ('0.37675382389150175',), 1342523889: ('0.37675382389150175',), 1342523886: ('0.37675382389150175',), 1342523883: ('0.37675382389150175',)} [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 7 /1342523940.Didn't retrieve data . /1342523935.Didn't retrieve data . /1342523898.Didn't retrieve data . /1342523894.Didn't retrieve data . /1342523889.Didn't retrieve data . /1342523886.Didn't retrieve data . /1342523883.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.11954927444458008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16623735427856445 time spend to save output : 0.12013077735900879 total time spend for step 8 : 0.28636813163757324 step9:velours_tree Tue Mar 11 02:53:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4665369987487793 time spend to save output : 3.719329833984375e-05 total time spend for step 9 : 0.46657419204711914 step10:send_mail_cod Tue Mar 11 02:53:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21222499_11-03-2025_02_53_40.pdf 21252484 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212524841741658020 21252485 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212524851741658021 21252486 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212524861741658023 21252487 change filename to text .change filename to text .change filename to text .change filename to text .imagette212524871741658025 21252488 imagette212524881741658025 21252489 imagette212524891741658025 21252490 imagette212524901741658025 21252491 imagette212524911741658025 21252492 imagette212524921741658025 21252493 imagette212524931741658025 21252494 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212524941741658025 21252495 change filename to text .change filename to text .change filename to text .change filename to text .imagette212524951741658027 21252496 imagette212524961741658027 21252497 imagette212524971741658027 21252498 imagette212524981741658027 21252499 imagette212524991741658027 21252500 imagette212525001741658027 21252501 change filename to text .change filename to text .imagette212525011741658027 21252502 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212525021741658027 21252504 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette212525041741658028 21252505 imagette212525051741658030 21252506 imagette212525061741658030 21252507 imagette212525071741658030 21252508 imagette212525081741658030 21252509 imagette212525091741658030 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21222499 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21252510,21252511,21252512,21252513,21252514,21252519,21252521,21252522,21252523,21252524,21252525,21252526,21252528,21252529,21252530,21252531,21252532,21252533,21252534,21252535?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=21222499 your option no_mail is active, we will not send the real mail to your client args[1342523940] : ((1342523940, 4207.911355415265, 492609224), (1342523940, 0.013484437776770814, 2107752395), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523935] : ((1342523935, 4147.746375099354, 492609224), (1342523935, -0.12758817900526756, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523898] : ((1342523898, 3844.975401937175, 492609224), (1342523898, -0.10887553371770294, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523894] : ((1342523894, 3589.750382649638, 492609224), (1342523894, -0.21839409369876772, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523889] : ((1342523889, 1676.169255662549, 2107751945), (1342523889, -0.24822579193471875, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523886] : ((1342523886, 1884.6919879397617, 2107751945), (1342523886, -0.32114873923905907, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1342523883] : ((1342523883, 593.0097892583647, 492688767), (1342523883, -0.35750846324188923, 496442774), '0.37675382389150175') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.37675382389150175 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222499_11-03-2025_02_53_40.pdf results_Auto_P21222499_11-03-2025_02_53_40.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222499_11-03-2025_02_53_40.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','21222499','results_Auto_P21222499_11-03-2025_02_53_40.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222499_11-03-2025_02_53_40.pdf','pdf','','3.28','0.37675382389150175') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.01534271240234375 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.35840106010437 time spend to save output : 0.015608549118041992 total time spend for step 10 : 14.374009609222412 step11:split_time_score Tue Mar 11 02:53:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 1), ('25', 6)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08022025 21222499 Nombre de photos uploadées : 7 / 23040 (0%) 08022025 21222499 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 08022025 21222499 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0008134841918945312 elapsed_time : insert_dashboard_record_day_entry 0.024573326110839844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.30163425013503214 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222496_11-03-2025_01_19_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222496 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222496 AND mptpi.`type`=4855 To do Qualite : 0.2519774671649127 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222497_11-03-2025_01_26_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222497 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222497 AND mptpi.`type`=4855 To do Qualite : 0.37675382389150175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222499_11-03-2025_02_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222499 AND mptpi.`type`=4855 To do Qualite : 0.40756533634970127 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21222500_11-03-2025_00_13_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21222500 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21222500 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08022025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1342523940, 1342523935, 1342523898, 1342523894, 1342523889, 1342523886, 1342523883] Looping around the photos to save general results len do output : 1 /21222499Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523940', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523935', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523898', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523894', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523889', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523886', None, None, None, None, None, '2654379') ('4741', None, None, None, None, None, None, None, '2654379') ('4741', '21222499', '1342523883', None, None, None, None, None, '2654379') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.019171953201293945 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.10811448097229 time spend to save output : 0.0203092098236084 total time spend for step 11 : 1.1284236907958984 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 872.97user 1034.26system 32:32.91elapsed 97%CPU (0avgtext+0avgdata 5518968maxresident)k 25542040inputs+952256outputs (781798major+83178528minor)pagefaults 0swaps