python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2361572 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2799187'] with mtr_portfolio_ids : ['22731302'] and first list_photo_ids : [] new path : /proc/2361572/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.416083812713623 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 6 22:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3693 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 22:41:31.193925: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 22:41:31.223086: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 22:41:31.225153: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5cf8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 22:41:31.225196: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 22:41:31.228427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 22:41:31.384080: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2d875a70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 22:41:31.384152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 22:41:31.385327: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:41:31.389883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:41:31.393201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:41:31.396657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:41:31.398406: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:41:31.403050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:41:31.404895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:41:31.410360: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:41:31.411509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:41:31.411606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:41:31.412165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 22:41:31.412180: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 22:41:31.412190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 22:41:31.413694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3241 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 22:41:31.745167: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:41:31.745250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:41:31.745267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:41:31.745283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:41:31.745298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:41:31.745312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:41:31.745327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:41:31.745342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:41:31.746194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:41:31.747498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:41:31.747543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:41:31.747568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:41:31.747588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:41:31.747619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:41:31.747640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:41:31.747660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:41:31.747679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:41:31.748774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:41:31.748814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 22:41:31.748826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 22:41:31.748836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 22:41:31.749949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3241 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 22:41:42.535953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:41:42.726372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:41:44.399265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.67G (2863529984 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-06 22:41:45.158852: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 22:41:45.159066: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 22:41:45.165975: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-06 22:41:45.166009: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 2361870 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 42 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0012128353118896484 nb_pixel_total : 41829 time to create 1 rle with old method : 0.04999256134033203 length of segment : 185 time for calcul the mask position with numpy : 0.18216896057128906 nb_pixel_total : 656179 time to create 1 rle with new method : 0.11817646026611328 length of segment : 564 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 61517 time to create 1 rle with old method : 0.08738064765930176 length of segment : 329 time for calcul the mask position with numpy : 0.009416580200195312 nb_pixel_total : 618097 time to create 1 rle with new method : 0.023120641708374023 length of segment : 1001 time for calcul the mask position with numpy : 0.0004591941833496094 nb_pixel_total : 4211 time to create 1 rle with old method : 0.006098747253417969 length of segment : 102 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 16964 time to create 1 rle with old method : 0.02443218231201172 length of segment : 159 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 27015 time to create 1 rle with old method : 0.03526806831359863 length of segment : 211 time for calcul the mask position with numpy : 0.00041413307189941406 nb_pixel_total : 22321 time to create 1 rle with old method : 0.026433229446411133 length of segment : 189 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 15817 time to create 1 rle with old method : 0.01883673667907715 length of segment : 182 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 12645 time to create 1 rle with old method : 0.016597509384155273 length of segment : 106 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 19412 time to create 1 rle with old method : 0.0230405330657959 length of segment : 215 time for calcul the mask position with numpy : 0.0010378360748291016 nb_pixel_total : 37549 time to create 1 rle with old method : 0.0449831485748291 length of segment : 410 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 24586 time to create 1 rle with old method : 0.04193449020385742 length of segment : 244 time for calcul the mask position with numpy : 0.0009958744049072266 nb_pixel_total : 28944 time to create 1 rle with old method : 0.03507852554321289 length of segment : 470 time for calcul the mask position with numpy : 0.002483844757080078 nb_pixel_total : 82768 time to create 1 rle with old method : 0.09783077239990234 length of segment : 403 time for calcul the mask position with numpy : 0.0038933753967285156 nb_pixel_total : 140396 time to create 1 rle with old method : 0.18514728546142578 length of segment : 388 time for calcul the mask position with numpy : 0.004125118255615234 nb_pixel_total : 112869 time to create 1 rle with old method : 0.14919090270996094 length of segment : 159 time for calcul the mask position with numpy : 0.013195514678955078 nb_pixel_total : 494031 time to create 1 rle with new method : 0.025751590728759766 length of segment : 1328 time for calcul the mask position with numpy : 0.007028102874755859 nb_pixel_total : 293672 time to create 1 rle with new method : 0.010156631469726562 length of segment : 588 time for calcul the mask position with numpy : 0.0026786327362060547 nb_pixel_total : 108904 time to create 1 rle with old method : 0.1274855136871338 length of segment : 322 time for calcul the mask position with numpy : 0.004040718078613281 nb_pixel_total : 159456 time to create 1 rle with new method : 0.006154537200927734 length of segment : 507 time for calcul the mask position with numpy : 0.005190134048461914 nb_pixel_total : 215283 time to create 1 rle with new method : 0.013492345809936523 length of segment : 594 time for calcul the mask position with numpy : 0.0043299198150634766 nb_pixel_total : 208609 time to create 1 rle with new method : 0.014101266860961914 length of segment : 488 time for calcul the mask position with numpy : 0.0025284290313720703 nb_pixel_total : 85061 time to create 1 rle with old method : 0.09943842887878418 length of segment : 368 time for calcul the mask position with numpy : 0.008495330810546875 nb_pixel_total : 354719 time to create 1 rle with new method : 0.01383519172668457 length of segment : 789 time for calcul the mask position with numpy : 0.00045299530029296875 nb_pixel_total : 34247 time to create 1 rle with old method : 0.04014301300048828 length of segment : 124 time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 22968 time to create 1 rle with old method : 0.027029991149902344 length of segment : 343 time for calcul the mask position with numpy : 0.0011057853698730469 nb_pixel_total : 84196 time to create 1 rle with old method : 0.10393428802490234 length of segment : 179 time for calcul the mask position with numpy : 0.0006260871887207031 nb_pixel_total : 34876 time to create 1 rle with old method : 0.04385018348693848 length of segment : 160 time for calcul the mask position with numpy : 0.0023794174194335938 nb_pixel_total : 123010 time to create 1 rle with old method : 0.17090249061584473 length of segment : 269 time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 58850 time to create 1 rle with old method : 0.06912446022033691 length of segment : 262 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 30955 time to create 1 rle with old method : 0.03649616241455078 length of segment : 212 time for calcul the mask position with numpy : 0.004349470138549805 nb_pixel_total : 154066 time to create 1 rle with new method : 0.011800765991210938 length of segment : 621 time for calcul the mask position with numpy : 0.0020623207092285156 nb_pixel_total : 102344 time to create 1 rle with old method : 0.12381482124328613 length of segment : 493 time for calcul the mask position with numpy : 0.0010333061218261719 nb_pixel_total : 60822 time to create 1 rle with old method : 0.07140660285949707 length of segment : 496 time for calcul the mask position with numpy : 0.0070116519927978516 nb_pixel_total : 175279 time to create 1 rle with new method : 0.011148691177368164 length of segment : 570 time for calcul the mask position with numpy : 0.002279996871948242 nb_pixel_total : 91114 time to create 1 rle with old method : 0.11018085479736328 length of segment : 394 time for calcul the mask position with numpy : 0.002315044403076172 nb_pixel_total : 98539 time to create 1 rle with old method : 0.11639881134033203 length of segment : 222 time for calcul the mask position with numpy : 0.0011973381042480469 nb_pixel_total : 38231 time to create 1 rle with old method : 0.05434608459472656 length of segment : 237 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 17597 time to create 1 rle with old method : 0.0237123966217041 length of segment : 180 time for calcul the mask position with numpy : 0.0008985996246337891 nb_pixel_total : 38199 time to create 1 rle with old method : 0.045682430267333984 length of segment : 176 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 12382 time to create 1 rle with old method : 0.01586294174194336 length of segment : 120 time for calcul the mask position with numpy : 0.0007460117340087891 nb_pixel_total : 24720 time to create 1 rle with old method : 0.0358891487121582 length of segment : 127 time for calcul the mask position with numpy : 0.0006875991821289062 nb_pixel_total : 7420 time to create 1 rle with old method : 0.009202718734741211 length of segment : 196 time for calcul the mask position with numpy : 0.0007517337799072266 nb_pixel_total : 24101 time to create 1 rle with old method : 0.02808070182800293 length of segment : 234 time for calcul the mask position with numpy : 0.005109310150146484 nb_pixel_total : 240138 time to create 1 rle with new method : 0.0070819854736328125 length of segment : 610 time for calcul the mask position with numpy : 0.0034291744232177734 nb_pixel_total : 112272 time to create 1 rle with old method : 0.1307837963104248 length of segment : 423 time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 17820 time to create 1 rle with old method : 0.02147531509399414 length of segment : 141 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 13758 time to create 1 rle with old method : 0.01670360565185547 length of segment : 119 time for calcul the mask position with numpy : 0.0005898475646972656 nb_pixel_total : 14939 time to create 1 rle with old method : 0.01815652847290039 length of segment : 187 time for calcul the mask position with numpy : 0.003118276596069336 nb_pixel_total : 123581 time to create 1 rle with old method : 0.1472477912902832 length of segment : 445 time for calcul the mask position with numpy : 0.001039266586303711 nb_pixel_total : 32229 time to create 1 rle with old method : 0.038445234298706055 length of segment : 238 time for calcul the mask position with numpy : 0.0005929470062255859 nb_pixel_total : 12572 time to create 1 rle with old method : 0.01578998565673828 length of segment : 169 time for calcul the mask position with numpy : 0.028717994689941406 nb_pixel_total : 1570124 time to create 1 rle with new method : 0.046445369720458984 length of segment : 903 time for calcul the mask position with numpy : 0.857311487197876 nb_pixel_total : 5136275 time to create 1 rle with new method : 0.9109110832214355 length of segment : 4317 time for calcul the mask position with numpy : 0.22854995727539062 nb_pixel_total : 2898474 time to create 1 rle with new method : 0.17439818382263184 length of segment : 2517 time spent for convertir_results : 12.219803810119629 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 56 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 50.540212869644165 time spend to save output : 0.10391736030578613 total time spend for step 1 : 50.64413022994995 step2:mask_detect Tue May 6 22:42:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 22:42:21.039698: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 22:42:21.067450: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 22:42:21.069826: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5cfc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 22:42:21.069859: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 22:42:21.074521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 22:42:21.332434: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2e365360 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 22:42:21.332489: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 22:42:21.333941: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:42:21.334565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:42:21.338471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:42:21.341981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:42:21.342575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:42:21.345709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:42:21.346938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:42:21.351939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:42:21.353477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:42:21.353581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:42:21.354349: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 22:42:21.354365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 22:42:21.354374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 22:42:21.355754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 22:42:21.472427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:42:21.472525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:42:21.472551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:42:21.472574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:42:21.472596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:42:21.472618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:42:21.472640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:42:21.472662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:42:21.474328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:42:21.475673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 22:42:21.475726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 22:42:21.475762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:42:21.475786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 22:42:21.475808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 22:42:21.475830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 22:42:21.475852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 22:42:21.475875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 22:42:21.477220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 22:42:21.477261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 22:42:21.477271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 22:42:21.477279: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 22:42:21.478694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 22:42:34.196225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 22:42:34.362593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 2364138 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.008114814758300781 nb_pixel_total : 261397 time to create 1 rle with new method : 0.014037370681762695 length of segment : 465 time for calcul the mask position with numpy : 0.003912687301635742 nb_pixel_total : 191539 time to create 1 rle with new method : 0.010137319564819336 length of segment : 538 time for calcul the mask position with numpy : 0.002714395523071289 nb_pixel_total : 140169 time to create 1 rle with old method : 0.15796589851379395 length of segment : 439 time for calcul the mask position with numpy : 0.0038781166076660156 nb_pixel_total : 223484 time to create 1 rle with new method : 0.010701894760131836 length of segment : 963 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 49769 time to create 1 rle with old method : 0.059990644454956055 length of segment : 150 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 27934 time to create 1 rle with old method : 0.0326235294342041 length of segment : 210 time for calcul the mask position with numpy : 0.002486705780029297 nb_pixel_total : 121893 time to create 1 rle with old method : 0.1466681957244873 length of segment : 338 time for calcul the mask position with numpy : 0.0022306442260742188 nb_pixel_total : 93939 time to create 1 rle with old method : 0.10899186134338379 length of segment : 462 time for calcul the mask position with numpy : 0.005092144012451172 nb_pixel_total : 305952 time to create 1 rle with new method : 0.014224767684936523 length of segment : 682 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 43559 time to create 1 rle with old method : 0.0518343448638916 length of segment : 218 time for calcul the mask position with numpy : 0.002328157424926758 nb_pixel_total : 82573 time to create 1 rle with old method : 0.09738826751708984 length of segment : 355 time for calcul the mask position with numpy : 0.001529693603515625 nb_pixel_total : 88899 time to create 1 rle with old method : 0.10108804702758789 length of segment : 352 time for calcul the mask position with numpy : 0.0007965564727783203 nb_pixel_total : 50381 time to create 1 rle with old method : 0.05892157554626465 length of segment : 264 time for calcul the mask position with numpy : 0.0016074180603027344 nb_pixel_total : 77268 time to create 1 rle with old method : 0.09018564224243164 length of segment : 271 time for calcul the mask position with numpy : 0.0046541690826416016 nb_pixel_total : 219595 time to create 1 rle with new method : 0.010915994644165039 length of segment : 635 time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 28419 time to create 1 rle with old method : 0.034013986587524414 length of segment : 202 time for calcul the mask position with numpy : 0.0004971027374267578 nb_pixel_total : 23947 time to create 1 rle with old method : 0.028606176376342773 length of segment : 152 time for calcul the mask position with numpy : 0.001280069351196289 nb_pixel_total : 58791 time to create 1 rle with old method : 0.06802797317504883 length of segment : 338 time for calcul the mask position with numpy : 0.0020439624786376953 nb_pixel_total : 127873 time to create 1 rle with old method : 0.14548397064208984 length of segment : 653 time for calcul the mask position with numpy : 0.009716510772705078 nb_pixel_total : 619805 time to create 1 rle with new method : 0.023550987243652344 length of segment : 859 time for calcul the mask position with numpy : 0.005113124847412109 nb_pixel_total : 276022 time to create 1 rle with new method : 0.013477087020874023 length of segment : 576 time for calcul the mask position with numpy : 0.003264188766479492 nb_pixel_total : 168031 time to create 1 rle with new method : 0.007982015609741211 length of segment : 402 time for calcul the mask position with numpy : 0.015083789825439453 nb_pixel_total : 753944 time to create 1 rle with new method : 0.04331803321838379 length of segment : 898 time for calcul the mask position with numpy : 0.002081632614135742 nb_pixel_total : 96543 time to create 1 rle with old method : 0.13226580619812012 length of segment : 333 time for calcul the mask position with numpy : 0.025409221649169922 nb_pixel_total : 1232201 time to create 1 rle with new method : 0.08237004280090332 length of segment : 1935 time for calcul the mask position with numpy : 0.0013048648834228516 nb_pixel_total : 16817 time to create 1 rle with old method : 0.02038741111755371 length of segment : 179 time for calcul the mask position with numpy : 0.003399372100830078 nb_pixel_total : 173270 time to create 1 rle with new method : 0.009175300598144531 length of segment : 628 time for calcul the mask position with numpy : 0.0021533966064453125 nb_pixel_total : 96630 time to create 1 rle with old method : 0.12813854217529297 length of segment : 324 time for calcul the mask position with numpy : 0.0017342567443847656 nb_pixel_total : 97000 time to create 1 rle with old method : 0.11822032928466797 length of segment : 251 time for calcul the mask position with numpy : 0.0017819404602050781 nb_pixel_total : 95214 time to create 1 rle with old method : 0.10792994499206543 length of segment : 397 time for calcul the mask position with numpy : 0.0012569427490234375 nb_pixel_total : 59924 time to create 1 rle with old method : 0.06738591194152832 length of segment : 254 time for calcul the mask position with numpy : 0.0016765594482421875 nb_pixel_total : 87461 time to create 1 rle with old method : 0.1026155948638916 length of segment : 254 time for calcul the mask position with numpy : 0.01540827751159668 nb_pixel_total : 511566 time to create 1 rle with new method : 0.06183648109436035 length of segment : 929 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 17283 time to create 1 rle with old method : 0.023298263549804688 length of segment : 142 time for calcul the mask position with numpy : 0.019812583923339844 nb_pixel_total : 665585 time to create 1 rle with new method : 0.0584406852722168 length of segment : 1122 time for calcul the mask position with numpy : 0.0007088184356689453 nb_pixel_total : 36099 time to create 1 rle with old method : 0.042604923248291016 length of segment : 226 time for calcul the mask position with numpy : 0.007628917694091797 nb_pixel_total : 408043 time to create 1 rle with new method : 0.017832040786743164 length of segment : 547 time for calcul the mask position with numpy : 0.003237485885620117 nb_pixel_total : 161457 time to create 1 rle with new method : 0.010184049606323242 length of segment : 556 time for calcul the mask position with numpy : 0.0022330284118652344 nb_pixel_total : 111004 time to create 1 rle with old method : 0.1277320384979248 length of segment : 312 time for calcul the mask position with numpy : 0.0014007091522216797 nb_pixel_total : 58741 time to create 1 rle with old method : 0.06958651542663574 length of segment : 382 time for calcul the mask position with numpy : 0.01688361167907715 nb_pixel_total : 785241 time to create 1 rle with new method : 0.05712532997131348 length of segment : 1003 time for calcul the mask position with numpy : 0.0022420883178710938 nb_pixel_total : 95951 time to create 1 rle with old method : 0.11009430885314941 length of segment : 394 time for calcul the mask position with numpy : 0.0013194084167480469 nb_pixel_total : 82060 time to create 1 rle with old method : 0.10172224044799805 length of segment : 423 time for calcul the mask position with numpy : 0.00754547119140625 nb_pixel_total : 311656 time to create 1 rle with new method : 0.02316737174987793 length of segment : 807 time for calcul the mask position with numpy : 0.00453495979309082 nb_pixel_total : 268033 time to create 1 rle with new method : 0.011999845504760742 length of segment : 557 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 29638 time to create 1 rle with old method : 0.036023855209350586 length of segment : 112 time for calcul the mask position with numpy : 0.006124019622802734 nb_pixel_total : 309779 time to create 1 rle with new method : 0.014942407608032227 length of segment : 800 time for calcul the mask position with numpy : 0.002262592315673828 nb_pixel_total : 95665 time to create 1 rle with old method : 0.11164617538452148 length of segment : 383 time for calcul the mask position with numpy : 0.0012946128845214844 nb_pixel_total : 53917 time to create 1 rle with old method : 0.06389689445495605 length of segment : 354 time for calcul the mask position with numpy : 0.0019259452819824219 nb_pixel_total : 81425 time to create 1 rle with old method : 0.11737775802612305 length of segment : 454 time for calcul the mask position with numpy : 0.003103494644165039 nb_pixel_total : 151914 time to create 1 rle with new method : 0.0076138973236083984 length of segment : 406 time for calcul the mask position with numpy : 0.006779193878173828 nb_pixel_total : 298338 time to create 1 rle with new method : 0.0196075439453125 length of segment : 891 time for calcul the mask position with numpy : 0.0019271373748779297 nb_pixel_total : 78350 time to create 1 rle with old method : 0.09111976623535156 length of segment : 289 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 45128 time to create 1 rle with old method : 0.0667262077331543 length of segment : 157 time for calcul the mask position with numpy : 0.0017566680908203125 nb_pixel_total : 79652 time to create 1 rle with old method : 0.08841896057128906 length of segment : 330 time for calcul the mask position with numpy : 0.0006470680236816406 nb_pixel_total : 32805 time to create 1 rle with old method : 0.038646697998046875 length of segment : 190 time for calcul the mask position with numpy : 0.0008025169372558594 nb_pixel_total : 45711 time to create 1 rle with old method : 0.05241131782531738 length of segment : 207 time for calcul the mask position with numpy : 0.00464320182800293 nb_pixel_total : 267934 time to create 1 rle with new method : 0.010664939880371094 length of segment : 558 time for calcul the mask position with numpy : 0.0011754035949707031 nb_pixel_total : 55450 time to create 1 rle with old method : 0.06498312950134277 length of segment : 311 time for calcul the mask position with numpy : 0.0008928775787353516 nb_pixel_total : 50199 time to create 1 rle with old method : 0.058336496353149414 length of segment : 167 time for calcul the mask position with numpy : 0.002989530563354492 nb_pixel_total : 163925 time to create 1 rle with new method : 0.00863957405090332 length of segment : 576 time for calcul the mask position with numpy : 0.0008525848388671875 nb_pixel_total : 35842 time to create 1 rle with old method : 0.0442960262298584 length of segment : 191 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 47154 time to create 1 rle with old method : 0.05648350715637207 length of segment : 371 time for calcul the mask position with numpy : 0.004645824432373047 nb_pixel_total : 178226 time to create 1 rle with new method : 0.013291597366333008 length of segment : 380 time for calcul the mask position with numpy : 0.014120817184448242 nb_pixel_total : 726555 time to create 1 rle with new method : 0.03546261787414551 length of segment : 705 time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 17814 time to create 1 rle with old method : 0.021098852157592773 length of segment : 137 time for calcul the mask position with numpy : 0.002785205841064453 nb_pixel_total : 113835 time to create 1 rle with old method : 0.132951021194458 length of segment : 279 time for calcul the mask position with numpy : 0.006536960601806641 nb_pixel_total : 186744 time to create 1 rle with new method : 0.02231287956237793 length of segment : 1121 time for calcul the mask position with numpy : 0.0035212039947509766 nb_pixel_total : 155002 time to create 1 rle with new method : 0.00733184814453125 length of segment : 380 time for calcul the mask position with numpy : 0.0014653205871582031 nb_pixel_total : 46228 time to create 1 rle with old method : 0.05443000793457031 length of segment : 254 time for calcul the mask position with numpy : 0.012899398803710938 nb_pixel_total : 666551 time to create 1 rle with new method : 0.03424715995788574 length of segment : 1000 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 52557 time to create 1 rle with old method : 0.06054234504699707 length of segment : 279 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 66512 time to create 1 rle with old method : 0.07811665534973145 length of segment : 398 time for calcul the mask position with numpy : 0.011687994003295898 nb_pixel_total : 701341 time to create 1 rle with new method : 0.02718663215637207 length of segment : 703 time for calcul the mask position with numpy : 0.0033292770385742188 nb_pixel_total : 197847 time to create 1 rle with new method : 0.009402036666870117 length of segment : 508 time for calcul the mask position with numpy : 0.0014500617980957031 nb_pixel_total : 69911 time to create 1 rle with old method : 0.0780496597290039 length of segment : 234 time for calcul the mask position with numpy : 0.0015482902526855469 nb_pixel_total : 48348 time to create 1 rle with old method : 0.058365821838378906 length of segment : 219 time for calcul the mask position with numpy : 0.0020079612731933594 nb_pixel_total : 73046 time to create 1 rle with old method : 0.0867917537689209 length of segment : 470 time for calcul the mask position with numpy : 0.001969575881958008 nb_pixel_total : 80286 time to create 1 rle with old method : 0.09157800674438477 length of segment : 468 time for calcul the mask position with numpy : 0.0016798973083496094 nb_pixel_total : 88785 time to create 1 rle with old method : 0.10307717323303223 length of segment : 303 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 18676 time to create 1 rle with old method : 0.02177739143371582 length of segment : 151 time for calcul the mask position with numpy : 0.008077621459960938 nb_pixel_total : 409311 time to create 1 rle with new method : 0.020370006561279297 length of segment : 701 time for calcul the mask position with numpy : 0.0005679130554199219 nb_pixel_total : 29524 time to create 1 rle with old method : 0.03464102745056152 length of segment : 126 time for calcul the mask position with numpy : 0.0012216567993164062 nb_pixel_total : 53906 time to create 1 rle with old method : 0.06247591972351074 length of segment : 279 time for calcul the mask position with numpy : 0.0006363391876220703 nb_pixel_total : 30312 time to create 1 rle with old method : 0.03437066078186035 length of segment : 266 time for calcul the mask position with numpy : 0.0017843246459960938 nb_pixel_total : 102399 time to create 1 rle with old method : 0.1337583065032959 length of segment : 184 time for calcul the mask position with numpy : 0.0024535655975341797 nb_pixel_total : 104183 time to create 1 rle with old method : 0.12221169471740723 length of segment : 319 time for calcul the mask position with numpy : 0.001531839370727539 nb_pixel_total : 66315 time to create 1 rle with old method : 0.07973122596740723 length of segment : 226 time for calcul the mask position with numpy : 0.0015192031860351562 nb_pixel_total : 72571 time to create 1 rle with old method : 0.08612298965454102 length of segment : 269 time for calcul the mask position with numpy : 0.01094818115234375 nb_pixel_total : 566168 time to create 1 rle with new method : 0.027599573135375977 length of segment : 1021 time for calcul the mask position with numpy : 0.0016093254089355469 nb_pixel_total : 65762 time to create 1 rle with old method : 0.07823967933654785 length of segment : 367 time for calcul the mask position with numpy : 0.0021827220916748047 nb_pixel_total : 100530 time to create 1 rle with old method : 0.14294815063476562 length of segment : 309 time for calcul the mask position with numpy : 0.001733541488647461 nb_pixel_total : 77559 time to create 1 rle with old method : 0.08929824829101562 length of segment : 622 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 14694 time to create 1 rle with old method : 0.017391204833984375 length of segment : 142 time for calcul the mask position with numpy : 0.004338979721069336 nb_pixel_total : 185464 time to create 1 rle with new method : 0.012620210647583008 length of segment : 674 time for calcul the mask position with numpy : 0.0019593238830566406 nb_pixel_total : 113536 time to create 1 rle with old method : 0.1264488697052002 length of segment : 389 time for calcul the mask position with numpy : 0.0058825016021728516 nb_pixel_total : 369286 time to create 1 rle with new method : 0.013409137725830078 length of segment : 1139 time for calcul the mask position with numpy : 0.002295255661010742 nb_pixel_total : 121075 time to create 1 rle with old method : 0.1650078296661377 length of segment : 358 time for calcul the mask position with numpy : 0.005013227462768555 nb_pixel_total : 327763 time to create 1 rle with new method : 0.013070106506347656 length of segment : 1246 time for calcul the mask position with numpy : 0.0044095516204833984 nb_pixel_total : 144175 time to create 1 rle with old method : 0.16062140464782715 length of segment : 2150 time for calcul the mask position with numpy : 0.0008790493011474609 nb_pixel_total : 45897 time to create 1 rle with old method : 0.052932024002075195 length of segment : 252 time for calcul the mask position with numpy : 0.02422308921813965 nb_pixel_total : 1212243 time to create 1 rle with new method : 0.06563448905944824 length of segment : 1630 time for calcul the mask position with numpy : 0.0015461444854736328 nb_pixel_total : 58225 time to create 1 rle with old method : 0.07805228233337402 length of segment : 325 time for calcul the mask position with numpy : 0.00797128677368164 nb_pixel_total : 314924 time to create 1 rle with new method : 0.02304363250732422 length of segment : 893 time for calcul the mask position with numpy : 0.0026504993438720703 nb_pixel_total : 87836 time to create 1 rle with old method : 0.10357522964477539 length of segment : 313 time for calcul the mask position with numpy : 0.0024547576904296875 nb_pixel_total : 100243 time to create 1 rle with old method : 0.11446809768676758 length of segment : 440 time for calcul the mask position with numpy : 0.0030717849731445312 nb_pixel_total : 158837 time to create 1 rle with new method : 0.00870203971862793 length of segment : 418 time for calcul the mask position with numpy : 0.003773212432861328 nb_pixel_total : 196326 time to create 1 rle with new method : 0.010191679000854492 length of segment : 513 time for calcul the mask position with numpy : 0.005940675735473633 nb_pixel_total : 191629 time to create 1 rle with new method : 0.018485546112060547 length of segment : 944 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 12191 time to create 1 rle with old method : 0.014772891998291016 length of segment : 135 time for calcul the mask position with numpy : 0.0016145706176757812 nb_pixel_total : 74631 time to create 1 rle with old method : 0.08445596694946289 length of segment : 487 time for calcul the mask position with numpy : 0.0006086826324462891 nb_pixel_total : 29722 time to create 1 rle with old method : 0.03528165817260742 length of segment : 209 time for calcul the mask position with numpy : 0.0016214847564697266 nb_pixel_total : 64864 time to create 1 rle with old method : 0.09006977081298828 length of segment : 302 time for calcul the mask position with numpy : 0.0009250640869140625 nb_pixel_total : 43029 time to create 1 rle with old method : 0.04870867729187012 length of segment : 279 time for calcul the mask position with numpy : 0.002070188522338867 nb_pixel_total : 101465 time to create 1 rle with old method : 0.11359858512878418 length of segment : 478 time for calcul the mask position with numpy : 0.01564502716064453 nb_pixel_total : 690626 time to create 1 rle with new method : 0.04285240173339844 length of segment : 1170 time for calcul the mask position with numpy : 0.004986286163330078 nb_pixel_total : 267790 time to create 1 rle with new method : 0.011722087860107422 length of segment : 601 time for calcul the mask position with numpy : 0.0008039474487304688 nb_pixel_total : 35474 time to create 1 rle with old method : 0.04172515869140625 length of segment : 206 time for calcul the mask position with numpy : 0.0023729801177978516 nb_pixel_total : 88169 time to create 1 rle with old method : 0.11664700508117676 length of segment : 443 time for calcul the mask position with numpy : 0.001352548599243164 nb_pixel_total : 43803 time to create 1 rle with old method : 0.05089521408081055 length of segment : 233 time for calcul the mask position with numpy : 0.0019249916076660156 nb_pixel_total : 104651 time to create 1 rle with old method : 0.11684226989746094 length of segment : 600 time for calcul the mask position with numpy : 0.003938198089599609 nb_pixel_total : 191325 time to create 1 rle with new method : 0.011390209197998047 length of segment : 645 time for calcul the mask position with numpy : 0.026834726333618164 nb_pixel_total : 1220453 time to create 1 rle with new method : 0.06938028335571289 length of segment : 1785 time for calcul the mask position with numpy : 0.0023462772369384766 nb_pixel_total : 110975 time to create 1 rle with old method : 0.12491059303283691 length of segment : 349 time for calcul the mask position with numpy : 0.0007255077362060547 nb_pixel_total : 40132 time to create 1 rle with old method : 0.045978546142578125 length of segment : 228 time for calcul the mask position with numpy : 0.0021250247955322266 nb_pixel_total : 97092 time to create 1 rle with old method : 0.10731387138366699 length of segment : 347 time for calcul the mask position with numpy : 0.005052328109741211 nb_pixel_total : 273207 time to create 1 rle with new method : 0.01401209831237793 length of segment : 646 time for calcul the mask position with numpy : 0.008315801620483398 nb_pixel_total : 493645 time to create 1 rle with new method : 0.022352933883666992 length of segment : 972 time for calcul the mask position with numpy : 0.0003113746643066406 nb_pixel_total : 14215 time to create 1 rle with old method : 0.01568150520324707 length of segment : 118 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 34244 time to create 1 rle with old method : 0.038459062576293945 length of segment : 212 time for calcul the mask position with numpy : 0.005890846252441406 nb_pixel_total : 323815 time to create 1 rle with new method : 0.017975568771362305 length of segment : 732 time for calcul the mask position with numpy : 0.0007081031799316406 nb_pixel_total : 36469 time to create 1 rle with old method : 0.03968477249145508 length of segment : 294 time for calcul the mask position with numpy : 0.002401113510131836 nb_pixel_total : 158195 time to create 1 rle with new method : 0.006289243698120117 length of segment : 306 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 46344 time to create 1 rle with old method : 0.05186891555786133 length of segment : 186 time for calcul the mask position with numpy : 0.0006608963012695312 nb_pixel_total : 34449 time to create 1 rle with old method : 0.03843426704406738 length of segment : 207 time for calcul the mask position with numpy : 0.0017642974853515625 nb_pixel_total : 85714 time to create 1 rle with old method : 0.0972280502319336 length of segment : 591 time for calcul the mask position with numpy : 0.0012462139129638672 nb_pixel_total : 53817 time to create 1 rle with old method : 0.06176257133483887 length of segment : 393 time for calcul the mask position with numpy : 0.0018999576568603516 nb_pixel_total : 91067 time to create 1 rle with old method : 0.1027522087097168 length of segment : 584 time for calcul the mask position with numpy : 0.0015921592712402344 nb_pixel_total : 92122 time to create 1 rle with old method : 0.10401701927185059 length of segment : 343 time for calcul the mask position with numpy : 0.002140045166015625 nb_pixel_total : 85437 time to create 1 rle with old method : 0.10099172592163086 length of segment : 607 time for calcul the mask position with numpy : 0.0030105113983154297 nb_pixel_total : 84433 time to create 1 rle with old method : 0.14473199844360352 length of segment : 444 time for calcul the mask position with numpy : 0.0006177425384521484 nb_pixel_total : 29067 time to create 1 rle with old method : 0.03476834297180176 length of segment : 177 time for calcul the mask position with numpy : 0.005152463912963867 nb_pixel_total : 284685 time to create 1 rle with new method : 0.013376712799072266 length of segment : 620 time for calcul the mask position with numpy : 0.004175901412963867 nb_pixel_total : 208700 time to create 1 rle with new method : 0.0116729736328125 length of segment : 622 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 304963 time to create 1 rle with new method : 0.018503665924072266 length of segment : 730 time for calcul the mask position with numpy : 0.000978708267211914 nb_pixel_total : 53230 time to create 1 rle with old method : 0.06354475021362305 length of segment : 224 time for calcul the mask position with numpy : 0.0008716583251953125 nb_pixel_total : 48057 time to create 1 rle with old method : 0.055884599685668945 length of segment : 205 time for calcul the mask position with numpy : 0.0012662410736083984 nb_pixel_total : 53969 time to create 1 rle with old method : 0.06118440628051758 length of segment : 237 time for calcul the mask position with numpy : 0.0022194385528564453 nb_pixel_total : 128139 time to create 1 rle with old method : 0.14658284187316895 length of segment : 271 time for calcul the mask position with numpy : 0.0012750625610351562 nb_pixel_total : 51782 time to create 1 rle with old method : 0.05977916717529297 length of segment : 257 time for calcul the mask position with numpy : 0.002111196517944336 nb_pixel_total : 106469 time to create 1 rle with old method : 0.12639617919921875 length of segment : 524 time for calcul the mask position with numpy : 0.0012733936309814453 nb_pixel_total : 68864 time to create 1 rle with old method : 0.07923698425292969 length of segment : 239 time for calcul the mask position with numpy : 0.002486705780029297 nb_pixel_total : 138317 time to create 1 rle with old method : 0.15848255157470703 length of segment : 928 time for calcul the mask position with numpy : 0.006510019302368164 nb_pixel_total : 245334 time to create 1 rle with new method : 0.0178375244140625 length of segment : 799 time for calcul the mask position with numpy : 0.0023467540740966797 nb_pixel_total : 123362 time to create 1 rle with old method : 0.13950562477111816 length of segment : 537 time for calcul the mask position with numpy : 0.0013561248779296875 nb_pixel_total : 71513 time to create 1 rle with old method : 0.08507466316223145 length of segment : 287 time for calcul the mask position with numpy : 0.0019736289978027344 nb_pixel_total : 80180 time to create 1 rle with old method : 0.0951695442199707 length of segment : 336 time for calcul the mask position with numpy : 0.000993967056274414 nb_pixel_total : 57245 time to create 1 rle with old method : 0.06536197662353516 length of segment : 207 time for calcul the mask position with numpy : 0.0009105205535888672 nb_pixel_total : 43632 time to create 1 rle with old method : 0.050879716873168945 length of segment : 234 time for calcul the mask position with numpy : 0.0038268566131591797 nb_pixel_total : 113144 time to create 1 rle with old method : 0.12881970405578613 length of segment : 460 time for calcul the mask position with numpy : 0.0011518001556396484 nb_pixel_total : 62275 time to create 1 rle with old method : 0.07189702987670898 length of segment : 227 time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 39102 time to create 1 rle with old method : 0.046579599380493164 length of segment : 252 time for calcul the mask position with numpy : 0.0010156631469726562 nb_pixel_total : 47571 time to create 1 rle with old method : 0.05484724044799805 length of segment : 257 time for calcul the mask position with numpy : 0.0008428096771240234 nb_pixel_total : 39871 time to create 1 rle with old method : 0.045609474182128906 length of segment : 183 time for calcul the mask position with numpy : 0.0023839473724365234 nb_pixel_total : 119286 time to create 1 rle with old method : 0.13645386695861816 length of segment : 295 time for calcul the mask position with numpy : 0.0015594959259033203 nb_pixel_total : 75604 time to create 1 rle with old method : 0.08656454086303711 length of segment : 341 time for calcul the mask position with numpy : 0.0007772445678710938 nb_pixel_total : 34703 time to create 1 rle with old method : 0.0547938346862793 length of segment : 236 time for calcul the mask position with numpy : 0.0009911060333251953 nb_pixel_total : 37513 time to create 1 rle with old method : 0.043916940689086914 length of segment : 295 time for calcul the mask position with numpy : 0.0040967464447021484 nb_pixel_total : 204040 time to create 1 rle with new method : 0.011178970336914062 length of segment : 491 time for calcul the mask position with numpy : 0.0015363693237304688 nb_pixel_total : 55284 time to create 1 rle with old method : 0.06495404243469238 length of segment : 269 time for calcul the mask position with numpy : 0.009365081787109375 nb_pixel_total : 458131 time to create 1 rle with new method : 0.02344822883605957 length of segment : 824 time for calcul the mask position with numpy : 0.023479223251342773 nb_pixel_total : 998931 time to create 1 rle with new method : 0.07172513008117676 length of segment : 2004 time for calcul the mask position with numpy : 0.0037527084350585938 nb_pixel_total : 137339 time to create 1 rle with old method : 0.159898042678833 length of segment : 448 time for calcul the mask position with numpy : 0.002215147018432617 nb_pixel_total : 115063 time to create 1 rle with old method : 0.12869977951049805 length of segment : 614 time for calcul the mask position with numpy : 0.004564762115478516 nb_pixel_total : 205308 time to create 1 rle with new method : 0.013653755187988281 length of segment : 817 time for calcul the mask position with numpy : 0.006713151931762695 nb_pixel_total : 258505 time to create 1 rle with new method : 0.019708871841430664 length of segment : 1097 time for calcul the mask position with numpy : 0.007980823516845703 nb_pixel_total : 311868 time to create 1 rle with new method : 0.020308732986450195 length of segment : 733 time for calcul the mask position with numpy : 0.008481264114379883 nb_pixel_total : 470528 time to create 1 rle with new method : 0.022251129150390625 length of segment : 885 time for calcul the mask position with numpy : 0.005099773406982422 nb_pixel_total : 302805 time to create 1 rle with new method : 0.013231277465820312 length of segment : 645 time for calcul the mask position with numpy : 0.004518032073974609 nb_pixel_total : 234567 time to create 1 rle with new method : 0.012689352035522461 length of segment : 669 time for calcul the mask position with numpy : 0.0003886222839355469 nb_pixel_total : 14595 time to create 1 rle with old method : 0.01734161376953125 length of segment : 140 time for calcul the mask position with numpy : 0.0010797977447509766 nb_pixel_total : 44989 time to create 1 rle with old method : 0.05303072929382324 length of segment : 176 time for calcul the mask position with numpy : 0.00548553466796875 nb_pixel_total : 276287 time to create 1 rle with new method : 0.01697254180908203 length of segment : 697 time for calcul the mask position with numpy : 0.0065975189208984375 nb_pixel_total : 319035 time to create 1 rle with new method : 0.0181734561920166 length of segment : 607 time for calcul the mask position with numpy : 0.0006978511810302734 nb_pixel_total : 21910 time to create 1 rle with old method : 0.030730724334716797 length of segment : 137 time for calcul the mask position with numpy : 0.0031118392944335938 nb_pixel_total : 172306 time to create 1 rle with new method : 0.007913351058959961 length of segment : 326 time for calcul the mask position with numpy : 0.015950441360473633 nb_pixel_total : 389463 time to create 1 rle with new method : 0.06404829025268555 length of segment : 818 time for calcul the mask position with numpy : 0.0007872581481933594 nb_pixel_total : 34561 time to create 1 rle with old method : 0.040818214416503906 length of segment : 194 time for calcul the mask position with numpy : 0.00685882568359375 nb_pixel_total : 287628 time to create 1 rle with new method : 0.018830299377441406 length of segment : 486 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 20218 time to create 1 rle with old method : 0.023908376693725586 length of segment : 129 time for calcul the mask position with numpy : 0.0013051033020019531 nb_pixel_total : 42999 time to create 1 rle with old method : 0.05355477333068848 length of segment : 352 time for calcul the mask position with numpy : 0.008050203323364258 nb_pixel_total : 336360 time to create 1 rle with new method : 0.022745847702026367 length of segment : 680 time for calcul the mask position with numpy : 0.0027031898498535156 nb_pixel_total : 194604 time to create 1 rle with new method : 0.0068912506103515625 length of segment : 409 time for calcul the mask position with numpy : 0.0008149147033691406 nb_pixel_total : 40340 time to create 1 rle with old method : 0.045130014419555664 length of segment : 252 time for calcul the mask position with numpy : 0.0015177726745605469 nb_pixel_total : 62059 time to create 1 rle with old method : 0.0850832462310791 length of segment : 318 time for calcul the mask position with numpy : 0.0004096031188964844 nb_pixel_total : 5078 time to create 1 rle with old method : 0.0060884952545166016 length of segment : 155 time for calcul the mask position with numpy : 0.0011608600616455078 nb_pixel_total : 51442 time to create 1 rle with old method : 0.05732083320617676 length of segment : 191 time for calcul the mask position with numpy : 0.001699209213256836 nb_pixel_total : 85493 time to create 1 rle with old method : 0.0989377498626709 length of segment : 496 time for calcul the mask position with numpy : 0.00038361549377441406 nb_pixel_total : 10246 time to create 1 rle with old method : 0.012151479721069336 length of segment : 186 time for calcul the mask position with numpy : 0.0009169578552246094 nb_pixel_total : 33163 time to create 1 rle with old method : 0.03926396369934082 length of segment : 259 time for calcul the mask position with numpy : 0.0009303092956542969 nb_pixel_total : 35831 time to create 1 rle with old method : 0.051492929458618164 length of segment : 320 time for calcul the mask position with numpy : 0.001428365707397461 nb_pixel_total : 68945 time to create 1 rle with old method : 0.07840704917907715 length of segment : 203 time for calcul the mask position with numpy : 0.0007483959197998047 nb_pixel_total : 34058 time to create 1 rle with old method : 0.03837156295776367 length of segment : 204 time for calcul the mask position with numpy : 0.005285739898681641 nb_pixel_total : 265673 time to create 1 rle with new method : 0.014925718307495117 length of segment : 1098 time for calcul the mask position with numpy : 0.0013370513916015625 nb_pixel_total : 55268 time to create 1 rle with old method : 0.06460285186767578 length of segment : 249 time for calcul the mask position with numpy : 0.004011869430541992 nb_pixel_total : 151089 time to create 1 rle with new method : 0.012553930282592773 length of segment : 544 time for calcul the mask position with numpy : 0.0011706352233886719 nb_pixel_total : 41218 time to create 1 rle with old method : 0.04752492904663086 length of segment : 383 time for calcul the mask position with numpy : 0.0021600723266601562 nb_pixel_total : 3154 time to create 1 rle with old method : 0.004399538040161133 length of segment : 221 time for calcul the mask position with numpy : 0.019598960876464844 nb_pixel_total : 538789 time to create 1 rle with new method : 0.06441974639892578 length of segment : 1502 time for calcul the mask position with numpy : 0.0020067691802978516 nb_pixel_total : 100486 time to create 1 rle with old method : 0.1163482666015625 length of segment : 315 time for calcul the mask position with numpy : 0.0033173561096191406 nb_pixel_total : 168775 time to create 1 rle with new method : 0.010680198669433594 length of segment : 354 time for calcul the mask position with numpy : 0.00185394287109375 nb_pixel_total : 96156 time to create 1 rle with old method : 0.11178803443908691 length of segment : 374 time for calcul the mask position with numpy : 0.0019652843475341797 nb_pixel_total : 97182 time to create 1 rle with old method : 0.10976839065551758 length of segment : 317 time for calcul the mask position with numpy : 0.009274721145629883 nb_pixel_total : 501928 time to create 1 rle with new method : 0.02559828758239746 length of segment : 1162 time for calcul the mask position with numpy : 0.0034072399139404297 nb_pixel_total : 165035 time to create 1 rle with new method : 0.008088111877441406 length of segment : 694 time for calcul the mask position with numpy : 0.0005557537078857422 nb_pixel_total : 884 time to create 1 rle with old method : 0.0011942386627197266 length of segment : 52 time for calcul the mask position with numpy : 0.004424333572387695 nb_pixel_total : 218529 time to create 1 rle with new method : 0.01402902603149414 length of segment : 574 time for calcul the mask position with numpy : 0.004381656646728516 nb_pixel_total : 210065 time to create 1 rle with new method : 0.012462377548217773 length of segment : 576 time for calcul the mask position with numpy : 0.0011072158813476562 nb_pixel_total : 53711 time to create 1 rle with old method : 0.06204104423522949 length of segment : 383 time for calcul the mask position with numpy : 0.0009801387786865234 nb_pixel_total : 59230 time to create 1 rle with old method : 0.06771230697631836 length of segment : 197 time for calcul the mask position with numpy : 0.008820772171020508 nb_pixel_total : 324265 time to create 1 rle with new method : 0.032243967056274414 length of segment : 1197 time for calcul the mask position with numpy : 0.001669168472290039 nb_pixel_total : 86019 time to create 1 rle with old method : 0.10190176963806152 length of segment : 422 time for calcul the mask position with numpy : 0.006607770919799805 nb_pixel_total : 302272 time to create 1 rle with new method : 0.01822042465209961 length of segment : 726 time for calcul the mask position with numpy : 0.001744985580444336 nb_pixel_total : 90642 time to create 1 rle with old method : 0.10177087783813477 length of segment : 374 time for calcul the mask position with numpy : 0.013524532318115234 nb_pixel_total : 406149 time to create 1 rle with new method : 0.042552947998046875 length of segment : 668 time for calcul the mask position with numpy : 0.34683704376220703 nb_pixel_total : 5446814 time to create 1 rle with new method : 1.2997212409973145 length of segment : 5554 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 20777 time to create 1 rle with old method : 0.02429676055908203 length of segment : 123 time for calcul the mask position with numpy : 0.23174691200256348 nb_pixel_total : 4786890 time to create 1 rle with new method : 0.3906421661376953 length of segment : 2278 time for calcul the mask position with numpy : 0.013525962829589844 nb_pixel_total : 749849 time to create 1 rle with new method : 0.03867650032043457 length of segment : 1547 time for calcul the mask position with numpy : 0.033925533294677734 nb_pixel_total : 2747962 time to create 1 rle with new method : 0.19226431846618652 length of segment : 1296 time for calcul the mask position with numpy : 0.022470951080322266 nb_pixel_total : 1904663 time to create 1 rle with new method : 0.05582451820373535 length of segment : 990 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 15451 time to create 1 rle with old method : 0.018939733505249023 length of segment : 77 time for calcul the mask position with numpy : 0.00025272369384765625 nb_pixel_total : 16593 time to create 1 rle with old method : 0.02021479606628418 length of segment : 84 time for calcul the mask position with numpy : 0.00025916099548339844 nb_pixel_total : 16699 time to create 1 rle with old method : 0.02060556411743164 length of segment : 83 time spent for convertir_results : 41.09144902229309 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 290 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 123.21562147140503 time spend to save output : 0.18806099891662598 total time spend for step 2 : 123.40368247032166 step3:blur_detection Tue May 6 22:44:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 3396.413624889299 (4160, 3120) 2397.008330113544 (4160, 3120) 1063.5541864861912 (4160, 3120) 2309.046559119176 (4160, 3120) 307.41366627401385 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.01205587387084961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.013338327407836914 save missing photos in datou_result : time spend for datou_step_exec : 0.91145920753479 time spend to save output : 0.029958009719848633 total time spend for step 3 : 0.9414172172546387 step4:brightness Tue May 6 22:44:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746564086_2361572_1356446088_4573a622c08f81af7e7fb522fdb243f9.jpg treat image : temp/1746564086_2361572_1356446064_1453b931967bd8c6b6ecf68fbfc16efd.jpg treat image : temp/1746564086_2361572_1356445493_d59705c4f3e9847e434fcbb268f4c982.jpg treat image : temp/1746564086_2361572_1356445457_821288f153406ab5ae7c78e3dee49df3.jpg treat image : temp/1746564086_2361572_1356445406_a10fcb1642e532b9797b9e594417cc6d.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.013386011123657227 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.017266511917114258 save missing photos in datou_result : time spend for datou_step_exec : 7.355197906494141 time spend to save output : 0.0350499153137207 total time spend for step 4 : 7.390247821807861 step5:rle_unique_nms_with_priority Tue May 6 22:44:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 290 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 58 nb_hashtags : 10 time to prepare the origin masks : 39.40814924240112 time for calcul the mask position with numpy : 0.6084601879119873 nb_pixel_total : 4893738 time to create 1 rle with new method : 1.5413949489593506 time for calcul the mask position with numpy : 0.05084705352783203 nb_pixel_total : 9678 time to create 1 rle with old method : 0.010549068450927734 time for calcul the mask position with numpy : 0.055761098861694336 nb_pixel_total : 605354 time to create 1 rle with new method : 0.8962969779968262 time for calcul the mask position with numpy : 0.05715131759643555 nb_pixel_total : 654324 time to create 1 rle with new method : 1.3315176963806152 time for calcul the mask position with numpy : 0.056529998779296875 nb_pixel_total : 1597 time to create 1 rle with old method : 0.0027136802673339844 time for calcul the mask position with numpy : 0.05419731140136719 nb_pixel_total : 139459 time to create 1 rle with old method : 0.159315824508667 time for calcul the mask position with numpy : 0.050139427185058594 nb_pixel_total : 121599 time to create 1 rle with old method : 0.13779640197753906 time for calcul the mask position with numpy : 0.04912972450256348 nb_pixel_total : 46802 time to create 1 rle with old method : 0.053560495376586914 time for calcul the mask position with numpy : 0.0522618293762207 nb_pixel_total : 78136 time to create 1 rle with old method : 0.0893104076385498 time for calcul the mask position with numpy : 0.05565452575683594 nb_pixel_total : 725991 time to create 1 rle with new method : 1.0243008136749268 time for calcul the mask position with numpy : 0.05183124542236328 nb_pixel_total : 26953 time to create 1 rle with old method : 0.029819011688232422 time for calcul the mask position with numpy : 0.05199265480041504 nb_pixel_total : 24411 time to create 1 rle with old method : 0.027447938919067383 time for calcul the mask position with numpy : 0.051639556884765625 nb_pixel_total : 50254 time to create 1 rle with old method : 0.05708122253417969 time for calcul the mask position with numpy : 0.05138731002807617 nb_pixel_total : 7150 time to create 1 rle with old method : 0.008463621139526367 time for calcul the mask position with numpy : 0.05166292190551758 nb_pixel_total : 41666 time to create 1 rle with old method : 0.045473337173461914 time for calcul the mask position with numpy : 0.049752235412597656 nb_pixel_total : 43419 time to create 1 rle with old method : 0.046380043029785156 time for calcul the mask position with numpy : 0.05565142631530762 nb_pixel_total : 1222496 time to create 1 rle with new method : 0.8772151470184326 time for calcul the mask position with numpy : 0.049015045166015625 nb_pixel_total : 15986 time to create 1 rle with old method : 0.017292022705078125 time for calcul the mask position with numpy : 0.049547433853149414 nb_pixel_total : 96468 time to create 1 rle with old method : 0.10339903831481934 time for calcul the mask position with numpy : 0.05104494094848633 nb_pixel_total : 484142 time to create 1 rle with new method : 0.8269946575164795 time for calcul the mask position with numpy : 0.05044221878051758 nb_pixel_total : 29993 time to create 1 rle with old method : 0.03397059440612793 time for calcul the mask position with numpy : 0.05181598663330078 nb_pixel_total : 58633 time to create 1 rle with old method : 0.06441116333007812 time for calcul the mask position with numpy : 0.051250457763671875 nb_pixel_total : 308291 time to create 1 rle with new method : 0.8158247470855713 time for calcul the mask position with numpy : 0.05355048179626465 nb_pixel_total : 22263 time to create 1 rle with old method : 0.028684377670288086 time for calcul the mask position with numpy : 0.06139826774597168 nb_pixel_total : 305597 time to create 1 rle with new method : 0.9974370002746582 time for calcul the mask position with numpy : 0.05046415328979492 nb_pixel_total : 88678 time to create 1 rle with old method : 0.09514045715332031 time for calcul the mask position with numpy : 0.053910017013549805 nb_pixel_total : 223342 time to create 1 rle with new method : 0.7689027786254883 time for calcul the mask position with numpy : 0.05358409881591797 nb_pixel_total : 37490 time to create 1 rle with old method : 0.043981075286865234 time for calcul the mask position with numpy : 0.053421735763549805 nb_pixel_total : 23373 time to create 1 rle with old method : 0.02793264389038086 time for calcul the mask position with numpy : 0.05473136901855469 nb_pixel_total : 76730 time to create 1 rle with old method : 0.09361410140991211 time for calcul the mask position with numpy : 0.052736520767211914 nb_pixel_total : 87198 time to create 1 rle with old method : 0.10001659393310547 time for calcul the mask position with numpy : 0.05253934860229492 nb_pixel_total : 197424 time to create 1 rle with new method : 1.3615562915802002 time for calcul the mask position with numpy : 0.052121877670288086 nb_pixel_total : 2005 time to create 1 rle with old method : 0.0025539398193359375 time for calcul the mask position with numpy : 0.05086207389831543 nb_pixel_total : 113381 time to create 1 rle with old method : 0.1272716522216797 time for calcul the mask position with numpy : 0.05184316635131836 nb_pixel_total : 275262 time to create 1 rle with new method : 1.9632601737976074 time for calcul the mask position with numpy : 0.060054779052734375 nb_pixel_total : 27766 time to create 1 rle with old method : 0.034383535385131836 time for calcul the mask position with numpy : 0.05559229850769043 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0015418529510498047 time for calcul the mask position with numpy : 0.05808544158935547 nb_pixel_total : 172871 time to create 1 rle with new method : 1.5631797313690186 time for calcul the mask position with numpy : 0.05159425735473633 nb_pixel_total : 23515 time to create 1 rle with old method : 0.026897192001342773 time for calcul the mask position with numpy : 0.05423569679260254 nb_pixel_total : 191118 time to create 1 rle with new method : 1.2288126945495605 time for calcul the mask position with numpy : 0.05157303810119629 nb_pixel_total : 3322 time to create 1 rle with old method : 0.004387855529785156 time for calcul the mask position with numpy : 0.05208873748779297 nb_pixel_total : 93664 time to create 1 rle with old method : 0.11179232597351074 time for calcul the mask position with numpy : 0.05331587791442871 nb_pixel_total : 9633 time to create 1 rle with old method : 0.011460304260253906 time for calcul the mask position with numpy : 0.054155588150024414 nb_pixel_total : 229346 time to create 1 rle with new method : 1.8659064769744873 time for calcul the mask position with numpy : 0.050327301025390625 nb_pixel_total : 19361 time to create 1 rle with old method : 0.0208740234375 time for calcul the mask position with numpy : 0.04981112480163574 nb_pixel_total : 16707 time to create 1 rle with old method : 0.01883077621459961 time for calcul the mask position with numpy : 0.051262855529785156 nb_pixel_total : 950 time to create 1 rle with old method : 0.0011632442474365234 time for calcul the mask position with numpy : 0.05208587646484375 nb_pixel_total : 96135 time to create 1 rle with old method : 0.10754227638244629 time for calcul the mask position with numpy : 0.05303001403808594 nb_pixel_total : 17211 time to create 1 rle with old method : 0.020182371139526367 time for calcul the mask position with numpy : 0.05372023582458496 nb_pixel_total : 33941 time to create 1 rle with old method : 0.03989386558532715 time for calcul the mask position with numpy : 0.055295705795288086 nb_pixel_total : 39229 time to create 1 rle with old method : 0.051372528076171875 time for calcul the mask position with numpy : 0.05340409278869629 nb_pixel_total : 82641 time to create 1 rle with old method : 0.09493136405944824 time for calcul the mask position with numpy : 0.05389833450317383 nb_pixel_total : 261014 time to create 1 rle with new method : 1.0397779941558838 time for calcul the mask position with numpy : 0.051984548568725586 nb_pixel_total : 16952 time to create 1 rle with old method : 0.01949000358581543 time for calcul the mask position with numpy : 0.053461313247680664 nb_pixel_total : 210067 time to create 1 rle with new method : 1.0216429233551025 time for calcul the mask position with numpy : 0.052847862243652344 nb_pixel_total : 167638 time to create 1 rle with new method : 0.8326511383056641 time for calcul the mask position with numpy : 0.052800655364990234 nb_pixel_total : 12485 time to create 1 rle with old method : 0.014380693435668945 time for calcul the mask position with numpy : 0.053493499755859375 nb_pixel_total : 96225 time to create 1 rle with old method : 0.11020398139953613 time for calcul the mask position with numpy : 0.053174734115600586 nb_pixel_total : 16921 time to create 1 rle with old method : 0.019638776779174805 create new chi : 26.45983099937439 time to delete rle : 0.029996395111083984 batch 1 Loaded 59 chid ids of type : 4855 Number RLEs to save : 46381 TO DO : save crop sub photo not yet done ! save time : 2.8576645851135254 nb_obj : 69 nb_hashtags : 8 time to prepare the origin masks : 44.96603560447693 time for calcul the mask position with numpy : 0.4284989833831787 nb_pixel_total : 6603571 time to create 1 rle with new method : 2.3200881481170654 time for calcul the mask position with numpy : 0.056166887283325195 nb_pixel_total : 3735 time to create 1 rle with old method : 0.004883289337158203 time for calcul the mask position with numpy : 0.0547335147857666 nb_pixel_total : 112158 time to create 1 rle with old method : 0.1355295181274414 time for calcul the mask position with numpy : 0.057053565979003906 nb_pixel_total : 33523 time to create 1 rle with old method : 0.04553627967834473 time for calcul the mask position with numpy : 0.0749201774597168 nb_pixel_total : 493629 time to create 1 rle with new method : 0.9569194316864014 time for calcul the mask position with numpy : 0.050375938415527344 nb_pixel_total : 233 time to create 1 rle with old method : 0.0007364749908447266 time for calcul the mask position with numpy : 0.0498809814453125 nb_pixel_total : 90075 time to create 1 rle with old method : 0.10288357734680176 time for calcul the mask position with numpy : 0.05199480056762695 nb_pixel_total : 17045 time to create 1 rle with old method : 0.01973724365234375 time for calcul the mask position with numpy : 0.05543851852416992 nb_pixel_total : 267643 time to create 1 rle with new method : 0.9927568435668945 time for calcul the mask position with numpy : 0.05276918411254883 nb_pixel_total : 54214 time to create 1 rle with old method : 0.06651926040649414 time for calcul the mask position with numpy : 0.05343008041381836 nb_pixel_total : 59985 time to create 1 rle with old method : 0.0693662166595459 time for calcul the mask position with numpy : 0.05304884910583496 nb_pixel_total : 148245 time to create 1 rle with old method : 0.16701006889343262 time for calcul the mask position with numpy : 0.0526881217956543 nb_pixel_total : 10296 time to create 1 rle with old method : 0.012346506118774414 time for calcul the mask position with numpy : 0.05239415168762207 nb_pixel_total : 78061 time to create 1 rle with old method : 0.09243202209472656 time for calcul the mask position with numpy : 0.061147451400756836 nb_pixel_total : 46931 time to create 1 rle with old method : 0.0720207691192627 time for calcul the mask position with numpy : 0.0581820011138916 nb_pixel_total : 15212 time to create 1 rle with old method : 0.017251968383789062 time for calcul the mask position with numpy : 0.052337646484375 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006437301635742188 time for calcul the mask position with numpy : 0.05259537696838379 nb_pixel_total : 41942 time to create 1 rle with old method : 0.04645037651062012 time for calcul the mask position with numpy : 0.052513837814331055 nb_pixel_total : 2862 time to create 1 rle with old method : 0.0035521984100341797 time for calcul the mask position with numpy : 0.05434060096740723 nb_pixel_total : 2123 time to create 1 rle with old method : 0.0027091503143310547 time for calcul the mask position with numpy : 0.05764055252075195 nb_pixel_total : 44562 time to create 1 rle with old method : 0.06084251403808594 time for calcul the mask position with numpy : 0.052100419998168945 nb_pixel_total : 29385 time to create 1 rle with old method : 0.033721923828125 time for calcul the mask position with numpy : 0.05354619026184082 nb_pixel_total : 50029 time to create 1 rle with old method : 0.05714011192321777 time for calcul the mask position with numpy : 0.05157780647277832 nb_pixel_total : 144 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.05200910568237305 nb_pixel_total : 38042 time to create 1 rle with old method : 0.04233384132385254 time for calcul the mask position with numpy : 0.05173468589782715 nb_pixel_total : 115618 time to create 1 rle with old method : 0.13197994232177734 time for calcul the mask position with numpy : 0.05190157890319824 nb_pixel_total : 293269 time to create 1 rle with new method : 1.1658437252044678 time for calcul the mask position with numpy : 0.05201005935668945 nb_pixel_total : 32706 time to create 1 rle with old method : 0.037132978439331055 time for calcul the mask position with numpy : 0.050252437591552734 nb_pixel_total : 3553 time to create 1 rle with old method : 0.0038743019104003906 time for calcul the mask position with numpy : 0.050506591796875 nb_pixel_total : 53712 time to create 1 rle with old method : 0.05977797508239746 time for calcul the mask position with numpy : 0.0512242317199707 nb_pixel_total : 48209 time to create 1 rle with old method : 0.054302215576171875 time for calcul the mask position with numpy : 0.05137968063354492 nb_pixel_total : 33397 time to create 1 rle with old method : 0.03862619400024414 time for calcul the mask position with numpy : 0.0529937744140625 nb_pixel_total : 139922 time to create 1 rle with old method : 0.160003662109375 time for calcul the mask position with numpy : 0.05217432975769043 nb_pixel_total : 95465 time to create 1 rle with old method : 0.10712671279907227 time for calcul the mask position with numpy : 0.051805973052978516 nb_pixel_total : 120520 time to create 1 rle with old method : 0.1410062313079834 time for calcul the mask position with numpy : 0.05286216735839844 nb_pixel_total : 113438 time to create 1 rle with old method : 0.12796759605407715 time for calcul the mask position with numpy : 0.05672025680541992 nb_pixel_total : 66068 time to create 1 rle with old method : 0.08794140815734863 time for calcul the mask position with numpy : 0.052776336669921875 nb_pixel_total : 82647 time to create 1 rle with old method : 0.09441328048706055 time for calcul the mask position with numpy : 0.052398681640625 nb_pixel_total : 6145 time to create 1 rle with old method : 0.007732391357421875 time for calcul the mask position with numpy : 0.05268359184265137 nb_pixel_total : 65680 time to create 1 rle with old method : 0.07602715492248535 time for calcul the mask position with numpy : 0.05801248550415039 nb_pixel_total : 653407 time to create 1 rle with new method : 0.7556502819061279 time for calcul the mask position with numpy : 0.052490949630737305 nb_pixel_total : 18619 time to create 1 rle with old method : 0.021379470825195312 time for calcul the mask position with numpy : 0.053380727767944336 nb_pixel_total : 120873 time to create 1 rle with old method : 0.13790512084960938 time for calcul the mask position with numpy : 0.05249142646789551 nb_pixel_total : 30194 time to create 1 rle with old method : 0.034294843673706055 time for calcul the mask position with numpy : 0.052664995193481445 nb_pixel_total : 81398 time to create 1 rle with old method : 0.08909225463867188 time for calcul the mask position with numpy : 0.05185103416442871 nb_pixel_total : 5387 time to create 1 rle with old method : 0.006570577621459961 time for calcul the mask position with numpy : 0.05149221420288086 nb_pixel_total : 22285 time to create 1 rle with old method : 0.02509140968322754 time for calcul the mask position with numpy : 0.057514190673828125 nb_pixel_total : 723989 time to create 1 rle with new method : 0.9933092594146729 time for calcul the mask position with numpy : 0.05823469161987305 nb_pixel_total : 2346 time to create 1 rle with old method : 0.003958702087402344 time for calcul the mask position with numpy : 0.052390336990356445 nb_pixel_total : 45714 time to create 1 rle with old method : 0.05509018898010254 time for calcul the mask position with numpy : 0.05406785011291504 nb_pixel_total : 162107 time to create 1 rle with new method : 0.9015469551086426 time for calcul the mask position with numpy : 0.05475187301635742 nb_pixel_total : 154450 time to create 1 rle with new method : 0.7806453704833984 time for calcul the mask position with numpy : 0.05507063865661621 nb_pixel_total : 298386 time to create 1 rle with new method : 0.8506767749786377 time for calcul the mask position with numpy : 0.051386117935180664 nb_pixel_total : 49870 time to create 1 rle with old method : 0.05364584922790527 time for calcul the mask position with numpy : 0.050101280212402344 nb_pixel_total : 1310 time to create 1 rle with old method : 0.0016977787017822266 time for calcul the mask position with numpy : 0.05242586135864258 nb_pixel_total : 2086 time to create 1 rle with old method : 0.002662181854248047 time for calcul the mask position with numpy : 0.05225491523742676 nb_pixel_total : 8746 time to create 1 rle with old method : 0.009895563125610352 time for calcul the mask position with numpy : 0.050664424896240234 nb_pixel_total : 159067 time to create 1 rle with new method : 0.6827974319458008 time for calcul the mask position with numpy : 0.053436279296875 nb_pixel_total : 287083 time to create 1 rle with new method : 0.9749486446380615 time for calcul the mask position with numpy : 0.052054643630981445 nb_pixel_total : 75786 time to create 1 rle with old method : 0.08557796478271484 time for calcul the mask position with numpy : 0.05021238327026367 nb_pixel_total : 45625 time to create 1 rle with old method : 0.049016714096069336 time for calcul the mask position with numpy : 0.049772024154663086 nb_pixel_total : 9035 time to create 1 rle with old method : 0.010174036026000977 time for calcul the mask position with numpy : 0.05236482620239258 nb_pixel_total : 183683 time to create 1 rle with new method : 0.8966250419616699 time for calcul the mask position with numpy : 0.050441741943359375 nb_pixel_total : 9129 time to create 1 rle with old method : 0.015034914016723633 time for calcul the mask position with numpy : 0.06208014488220215 nb_pixel_total : 1403 time to create 1 rle with old method : 0.002492189407348633 time for calcul the mask position with numpy : 0.051705121994018555 nb_pixel_total : 103784 time to create 1 rle with old method : 0.1137232780456543 time for calcul the mask position with numpy : 0.050219058990478516 nb_pixel_total : 9141 time to create 1 rle with old method : 0.01014566421508789 time for calcul the mask position with numpy : 0.050208091735839844 nb_pixel_total : 79513 time to create 1 rle with old method : 0.08870792388916016 time for calcul the mask position with numpy : 0.05151820182800293 nb_pixel_total : 108526 time to create 1 rle with old method : 0.11800169944763184 time for calcul the mask position with numpy : 0.05042290687561035 nb_pixel_total : 11743 time to create 1 rle with old method : 0.013724565505981445 create new chi : 19.987314462661743 time to delete rle : 0.004060029983520508 batch 1 Loaded 70 chid ids of type : 4855 Number RLEs to save : 48040 TO DO : save crop sub photo not yet done ! save time : 2.9956161975860596 nb_obj : 62 nb_hashtags : 8 time to prepare the origin masks : 38.478641748428345 time for calcul the mask position with numpy : 0.5165314674377441 nb_pixel_total : 5694529 time to create 1 rle with new method : 1.4531142711639404 time for calcul the mask position with numpy : 0.05199384689331055 nb_pixel_total : 30897 time to create 1 rle with old method : 0.034677743911743164 time for calcul the mask position with numpy : 0.05265378952026367 nb_pixel_total : 53807 time to create 1 rle with old method : 0.05937004089355469 time for calcul the mask position with numpy : 0.05505871772766113 nb_pixel_total : 110582 time to create 1 rle with old method : 0.12489080429077148 time for calcul the mask position with numpy : 0.052634477615356445 nb_pixel_total : 948 time to create 1 rle with old method : 0.0013318061828613281 time for calcul the mask position with numpy : 0.05285072326660156 nb_pixel_total : 38427 time to create 1 rle with old method : 0.05843067169189453 time for calcul the mask position with numpy : 0.06452655792236328 nb_pixel_total : 957978 time to create 1 rle with new method : 1.261270523071289 time for calcul the mask position with numpy : 0.053930044174194336 nb_pixel_total : 87489 time to create 1 rle with old method : 0.1168358325958252 time for calcul the mask position with numpy : 0.06014895439147949 nb_pixel_total : 5938 time to create 1 rle with old method : 0.007402896881103516 time for calcul the mask position with numpy : 0.051607370376586914 nb_pixel_total : 14035 time to create 1 rle with old method : 0.01732802391052246 time for calcul the mask position with numpy : 0.054177284240722656 nb_pixel_total : 122521 time to create 1 rle with old method : 0.14081025123596191 time for calcul the mask position with numpy : 0.05313301086425781 nb_pixel_total : 58719 time to create 1 rle with old method : 0.06668233871459961 time for calcul the mask position with numpy : 0.05392813682556152 nb_pixel_total : 194760 time to create 1 rle with new method : 0.9348623752593994 time for calcul the mask position with numpy : 0.05658102035522461 nb_pixel_total : 686793 time to create 1 rle with new method : 0.9551308155059814 time for calcul the mask position with numpy : 0.05146932601928711 nb_pixel_total : 43640 time to create 1 rle with old method : 0.04784345626831055 time for calcul the mask position with numpy : 0.057016611099243164 nb_pixel_total : 153743 time to create 1 rle with new method : 1.1733992099761963 time for calcul the mask position with numpy : 0.05288958549499512 nb_pixel_total : 3862 time to create 1 rle with old method : 0.0047760009765625 time for calcul the mask position with numpy : 0.054201602935791016 nb_pixel_total : 226570 time to create 1 rle with new method : 0.966660737991333 time for calcul the mask position with numpy : 0.05349421501159668 nb_pixel_total : 191564 time to create 1 rle with new method : 0.8190722465515137 time for calcul the mask position with numpy : 0.05071401596069336 nb_pixel_total : 3714 time to create 1 rle with old method : 0.004339694976806641 time for calcul the mask position with numpy : 0.05151009559631348 nb_pixel_total : 5795 time to create 1 rle with old method : 0.006664752960205078 time for calcul the mask position with numpy : 0.05178403854370117 nb_pixel_total : 84114 time to create 1 rle with old method : 0.09426665306091309 time for calcul the mask position with numpy : 0.05108022689819336 nb_pixel_total : 41061 time to create 1 rle with old method : 0.04622507095336914 time for calcul the mask position with numpy : 0.05083107948303223 nb_pixel_total : 57997 time to create 1 rle with old method : 0.06400609016418457 time for calcul the mask position with numpy : 0.05038189888000488 nb_pixel_total : 267355 time to create 1 rle with new method : 0.7273437976837158 time for calcul the mask position with numpy : 0.05240464210510254 nb_pixel_total : 35317 time to create 1 rle with old method : 0.03905153274536133 time for calcul the mask position with numpy : 0.05222129821777344 nb_pixel_total : 51629 time to create 1 rle with old method : 0.05674552917480469 time for calcul the mask position with numpy : 0.05028080940246582 nb_pixel_total : 86691 time to create 1 rle with old method : 0.09561562538146973 time for calcul the mask position with numpy : 0.05089092254638672 nb_pixel_total : 96464 time to create 1 rle with old method : 0.10657525062561035 time for calcul the mask position with numpy : 0.05273747444152832 nb_pixel_total : 34381 time to create 1 rle with old method : 0.05569338798522949 time for calcul the mask position with numpy : 0.05646800994873047 nb_pixel_total : 2106 time to create 1 rle with old method : 0.0023665428161621094 time for calcul the mask position with numpy : 0.05126953125 nb_pixel_total : 28952 time to create 1 rle with old method : 0.03194141387939453 time for calcul the mask position with numpy : 0.051682233810424805 nb_pixel_total : 40091 time to create 1 rle with old method : 0.046189308166503906 time for calcul the mask position with numpy : 0.05147266387939453 nb_pixel_total : 12048 time to create 1 rle with old method : 0.014386892318725586 time for calcul the mask position with numpy : 0.062338829040527344 nb_pixel_total : 1211044 time to create 1 rle with new method : 0.7932631969451904 time for calcul the mask position with numpy : 0.05265402793884277 nb_pixel_total : 102005 time to create 1 rle with old method : 0.11310815811157227 time for calcul the mask position with numpy : 0.052170515060424805 nb_pixel_total : 104513 time to create 1 rle with old method : 0.11582541465759277 time for calcul the mask position with numpy : 0.051398515701293945 nb_pixel_total : 5434 time to create 1 rle with old method : 0.0064830780029296875 time for calcul the mask position with numpy : 0.05090975761413574 nb_pixel_total : 38147 time to create 1 rle with old method : 0.04245591163635254 time for calcul the mask position with numpy : 0.05292010307312012 nb_pixel_total : 53646 time to create 1 rle with old method : 0.060152530670166016 time for calcul the mask position with numpy : 0.056559085845947266 nb_pixel_total : 313434 time to create 1 rle with new method : 0.7920093536376953 time for calcul the mask position with numpy : 0.05275321006774902 nb_pixel_total : 304250 time to create 1 rle with new method : 0.7487919330596924 time for calcul the mask position with numpy : 0.05204415321350098 nb_pixel_total : 8816 time to create 1 rle with old method : 0.010127782821655273 time for calcul the mask position with numpy : 0.0510401725769043 nb_pixel_total : 53031 time to create 1 rle with old method : 0.05956411361694336 time for calcul the mask position with numpy : 0.05249357223510742 nb_pixel_total : 77488 time to create 1 rle with old method : 0.08663225173950195 time for calcul the mask position with numpy : 0.050592899322509766 nb_pixel_total : 78501 time to create 1 rle with old method : 0.11453628540039062 time for calcul the mask position with numpy : 0.05156993865966797 nb_pixel_total : 11634 time to create 1 rle with old method : 0.013258695602416992 time for calcul the mask position with numpy : 0.050760507583618164 nb_pixel_total : 133663 time to create 1 rle with old method : 0.148728609085083 time for calcul the mask position with numpy : 0.05185222625732422 nb_pixel_total : 2520 time to create 1 rle with old method : 0.0029938220977783203 time for calcul the mask position with numpy : 0.052153825759887695 nb_pixel_total : 106968 time to create 1 rle with old method : 0.11783671379089355 time for calcul the mask position with numpy : 0.051744699478149414 nb_pixel_total : 35142 time to create 1 rle with old method : 0.039678096771240234 time for calcul the mask position with numpy : 0.04956841468811035 nb_pixel_total : 88070 time to create 1 rle with old method : 0.09709405899047852 time for calcul the mask position with numpy : 0.051599979400634766 nb_pixel_total : 16237 time to create 1 rle with old method : 0.018887758255004883 time for calcul the mask position with numpy : 0.053139686584472656 nb_pixel_total : 108464 time to create 1 rle with old method : 0.12024545669555664 time for calcul the mask position with numpy : 0.0523982048034668 nb_pixel_total : 6461 time to create 1 rle with old method : 0.007856130599975586 time for calcul the mask position with numpy : 0.05295133590698242 nb_pixel_total : 269368 time to create 1 rle with new method : 0.8739805221557617 time for calcul the mask position with numpy : 0.053424835205078125 nb_pixel_total : 22471 time to create 1 rle with old method : 0.025806665420532227 time for calcul the mask position with numpy : 0.05217146873474121 nb_pixel_total : 21470 time to create 1 rle with old method : 0.024637937545776367 time for calcul the mask position with numpy : 0.051982879638671875 nb_pixel_total : 156796 time to create 1 rle with new method : 0.7902185916900635 time for calcul the mask position with numpy : 0.04984760284423828 nb_pixel_total : 64672 time to create 1 rle with old method : 0.07015466690063477 time for calcul the mask position with numpy : 0.050093650817871094 nb_pixel_total : 45835 time to create 1 rle with old method : 0.1016378402709961 time for calcul the mask position with numpy : 0.050638675689697266 nb_pixel_total : 14200 time to create 1 rle with old method : 0.015683889389038086 time for calcul the mask position with numpy : 0.05201244354248047 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004911422729492188 create new chi : 19.360047578811646 time to delete rle : 0.005096912384033203 batch 1 Loaded 63 chid ids of type : 4855 Number RLEs to save : 50589 TO DO : save crop sub photo not yet done ! save time : 3.103424549102783 nb_obj : 79 nb_hashtags : 11 time to prepare the origin masks : 53.60466408729553 time for calcul the mask position with numpy : 0.4061129093170166 nb_pixel_total : 5145898 time to create 1 rle with new method : 1.2122135162353516 time for calcul the mask position with numpy : 0.05155801773071289 nb_pixel_total : 97929 time to create 1 rle with old method : 0.10558676719665527 time for calcul the mask position with numpy : 0.05134224891662598 nb_pixel_total : 85378 time to create 1 rle with old method : 0.09028148651123047 time for calcul the mask position with numpy : 0.04966545104980469 nb_pixel_total : 136423 time to create 1 rle with old method : 0.14371228218078613 time for calcul the mask position with numpy : 0.05013608932495117 nb_pixel_total : 167551 time to create 1 rle with new method : 0.8558332920074463 time for calcul the mask position with numpy : 0.05680489540100098 nb_pixel_total : 4966 time to create 1 rle with old method : 0.00841522216796875 time for calcul the mask position with numpy : 0.056166648864746094 nb_pixel_total : 44739 time to create 1 rle with old method : 0.04953742027282715 time for calcul the mask position with numpy : 0.051096200942993164 nb_pixel_total : 80294 time to create 1 rle with old method : 0.10298371315002441 time for calcul the mask position with numpy : 0.05720949172973633 nb_pixel_total : 328409 time to create 1 rle with new method : 0.8335258960723877 time for calcul the mask position with numpy : 0.05197334289550781 nb_pixel_total : 10204 time to create 1 rle with old method : 0.011522293090820312 time for calcul the mask position with numpy : 0.05220794677734375 nb_pixel_total : 35701 time to create 1 rle with old method : 0.04027962684631348 time for calcul the mask position with numpy : 0.0530393123626709 nb_pixel_total : 187270 time to create 1 rle with new method : 1.0447003841400146 time for calcul the mask position with numpy : 0.05320119857788086 nb_pixel_total : 39762 time to create 1 rle with old method : 0.04534411430358887 time for calcul the mask position with numpy : 0.050693511962890625 nb_pixel_total : 12305 time to create 1 rle with old method : 0.014261007308959961 time for calcul the mask position with numpy : 0.051883697509765625 nb_pixel_total : 150871 time to create 1 rle with new method : 0.7269790172576904 time for calcul the mask position with numpy : 0.050299882888793945 nb_pixel_total : 114528 time to create 1 rle with old method : 0.12415194511413574 time for calcul the mask position with numpy : 0.05109739303588867 nb_pixel_total : 15758 time to create 1 rle with old method : 0.017540454864501953 time for calcul the mask position with numpy : 0.048874855041503906 nb_pixel_total : 47408 time to create 1 rle with old method : 0.051775217056274414 time for calcul the mask position with numpy : 0.053754568099975586 nb_pixel_total : 34414 time to create 1 rle with old method : 0.05698084831237793 time for calcul the mask position with numpy : 0.05411958694458008 nb_pixel_total : 17747 time to create 1 rle with old method : 0.0218961238861084 time for calcul the mask position with numpy : 0.05173993110656738 nb_pixel_total : 21826 time to create 1 rle with old method : 0.02521514892578125 time for calcul the mask position with numpy : 0.051390886306762695 nb_pixel_total : 14561 time to create 1 rle with old method : 0.01681685447692871 time for calcul the mask position with numpy : 0.05252647399902344 nb_pixel_total : 13676 time to create 1 rle with old method : 0.015644550323486328 time for calcul the mask position with numpy : 0.05419445037841797 nb_pixel_total : 302413 time to create 1 rle with new method : 0.7986865043640137 time for calcul the mask position with numpy : 0.057706356048583984 nb_pixel_total : 38924 time to create 1 rle with old method : 0.05508160591125488 time for calcul the mask position with numpy : 0.05398058891296387 nb_pixel_total : 457047 time to create 1 rle with new method : 0.8601295948028564 time for calcul the mask position with numpy : 0.05242776870727539 nb_pixel_total : 55126 time to create 1 rle with old method : 0.061467885971069336 time for calcul the mask position with numpy : 0.050835609436035156 nb_pixel_total : 41132 time to create 1 rle with old method : 0.045488834381103516 time for calcul the mask position with numpy : 0.05019044876098633 nb_pixel_total : 45 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.05173230171203613 nb_pixel_total : 3378 time to create 1 rle with old method : 0.004047870635986328 time for calcul the mask position with numpy : 0.0511629581451416 nb_pixel_total : 189237 time to create 1 rle with new method : 0.8806014060974121 time for calcul the mask position with numpy : 0.05225944519042969 nb_pixel_total : 38086 time to create 1 rle with old method : 0.04314780235290527 time for calcul the mask position with numpy : 0.05185079574584961 nb_pixel_total : 24044 time to create 1 rle with old method : 0.026906967163085938 time for calcul the mask position with numpy : 0.05164694786071777 nb_pixel_total : 2803 time to create 1 rle with old method : 0.003439664840698242 time for calcul the mask position with numpy : 0.05101609230041504 nb_pixel_total : 878 time to create 1 rle with old method : 0.0010149478912353516 time for calcul the mask position with numpy : 0.052251338958740234 nb_pixel_total : 111956 time to create 1 rle with old method : 0.12651872634887695 time for calcul the mask position with numpy : 0.05289769172668457 nb_pixel_total : 42953 time to create 1 rle with old method : 0.048917293548583984 time for calcul the mask position with numpy : 0.061005592346191406 nb_pixel_total : 62156 time to create 1 rle with old method : 0.07794666290283203 time for calcul the mask position with numpy : 0.05202221870422363 nb_pixel_total : 4154 time to create 1 rle with old method : 0.004744052886962891 time for calcul the mask position with numpy : 0.051663875579833984 nb_pixel_total : 7334 time to create 1 rle with old method : 0.008389711380004883 time for calcul the mask position with numpy : 0.0525059700012207 nb_pixel_total : 311259 time to create 1 rle with new method : 0.882906436920166 time for calcul the mask position with numpy : 0.05146646499633789 nb_pixel_total : 178 time to create 1 rle with old method : 0.00029730796813964844 time for calcul the mask position with numpy : 0.05134725570678711 nb_pixel_total : 75477 time to create 1 rle with old method : 0.0849454402923584 time for calcul the mask position with numpy : 0.0506746768951416 nb_pixel_total : 579 time to create 1 rle with old method : 0.0007798671722412109 time for calcul the mask position with numpy : 0.04983019828796387 nb_pixel_total : 24674 time to create 1 rle with old method : 0.027354001998901367 time for calcul the mask position with numpy : 0.05103874206542969 nb_pixel_total : 119054 time to create 1 rle with old method : 0.1314067840576172 time for calcul the mask position with numpy : 0.05349469184875488 nb_pixel_total : 275657 time to create 1 rle with new method : 0.7651262283325195 time for calcul the mask position with numpy : 0.05095505714416504 nb_pixel_total : 14822 time to create 1 rle with old method : 0.017314910888671875 time for calcul the mask position with numpy : 0.052980899810791016 nb_pixel_total : 239762 time to create 1 rle with new method : 0.7342379093170166 time for calcul the mask position with numpy : 0.05284619331359863 nb_pixel_total : 56664 time to create 1 rle with old method : 0.06436562538146973 time for calcul the mask position with numpy : 0.05258440971374512 nb_pixel_total : 18301 time to create 1 rle with old method : 0.02123713493347168 time for calcul the mask position with numpy : 0.054756879806518555 nb_pixel_total : 202661 time to create 1 rle with new method : 0.8823773860931396 time for calcul the mask position with numpy : 0.06042742729187012 nb_pixel_total : 994015 time to create 1 rle with new method : 0.8140475749969482 time for calcul the mask position with numpy : 0.05425310134887695 nb_pixel_total : 469709 time to create 1 rle with new method : 0.8538322448730469 time for calcul the mask position with numpy : 0.051468849182128906 nb_pixel_total : 12274 time to create 1 rle with old method : 0.014684915542602539 time for calcul the mask position with numpy : 0.05248856544494629 nb_pixel_total : 195339 time to create 1 rle with new method : 0.5217545032501221 time for calcul the mask position with numpy : 0.05337023735046387 nb_pixel_total : 92642 time to create 1 rle with old method : 0.10372328758239746 time for calcul the mask position with numpy : 0.053633689880371094 nb_pixel_total : 552 time to create 1 rle with old method : 0.0013723373413085938 time for calcul the mask position with numpy : 0.06116175651550293 nb_pixel_total : 37458 time to create 1 rle with old method : 0.04248046875 time for calcul the mask position with numpy : 0.05225062370300293 nb_pixel_total : 35143 time to create 1 rle with old method : 0.03929400444030762 time for calcul the mask position with numpy : 0.05177664756774902 nb_pixel_total : 103293 time to create 1 rle with old method : 0.11772990226745605 time for calcul the mask position with numpy : 0.05193686485290527 nb_pixel_total : 902 time to create 1 rle with old method : 0.0013051033020019531 time for calcul the mask position with numpy : 0.0517578125 nb_pixel_total : 42738 time to create 1 rle with old method : 0.04972052574157715 time for calcul the mask position with numpy : 0.05193901062011719 nb_pixel_total : 44281 time to create 1 rle with old method : 0.057062625885009766 time for calcul the mask position with numpy : 0.057466745376586914 nb_pixel_total : 174751 time to create 1 rle with new method : 0.7305238246917725 time for calcul the mask position with numpy : 0.05066537857055664 nb_pixel_total : 3516 time to create 1 rle with old method : 0.004441499710083008 time for calcul the mask position with numpy : 0.05266141891479492 nb_pixel_total : 203002 time to create 1 rle with new method : 0.9200963973999023 time for calcul the mask position with numpy : 0.05233454704284668 nb_pixel_total : 53679 time to create 1 rle with old method : 0.06041574478149414 time for calcul the mask position with numpy : 0.05222296714782715 nb_pixel_total : 115695 time to create 1 rle with old method : 0.1392056941986084 time for calcul the mask position with numpy : 0.05408048629760742 nb_pixel_total : 161846 time to create 1 rle with new method : 0.8303408622741699 time for calcul the mask position with numpy : 0.05339646339416504 nb_pixel_total : 90954 time to create 1 rle with old method : 0.10340213775634766 time for calcul the mask position with numpy : 0.055006980895996094 nb_pixel_total : 302164 time to create 1 rle with new method : 0.8415322303771973 time for calcul the mask position with numpy : 0.05211210250854492 nb_pixel_total : 33970 time to create 1 rle with old method : 0.048792123794555664 time for calcul the mask position with numpy : 0.06006503105163574 nb_pixel_total : 1 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.05258011817932129 nb_pixel_total : 133528 time to create 1 rle with old method : 0.15259909629821777 time for calcul the mask position with numpy : 0.05200076103210449 nb_pixel_total : 17549 time to create 1 rle with old method : 0.020165205001831055 time for calcul the mask position with numpy : 0.05315828323364258 nb_pixel_total : 70113 time to create 1 rle with old method : 0.07980537414550781 time for calcul the mask position with numpy : 0.051964521408081055 nb_pixel_total : 14651 time to create 1 rle with old method : 0.01726698875427246 time for calcul the mask position with numpy : 0.05304074287414551 nb_pixel_total : 46947 time to create 1 rle with old method : 0.07639455795288086 time for calcul the mask position with numpy : 0.052033424377441406 nb_pixel_total : 116 time to create 1 rle with old method : 0.0004801750183105469 create new chi : 24.18154788017273 time to delete rle : 0.007034778594970703 batch 1 Loaded 80 chid ids of type : 4855 Number RLEs to save : 58173 TO DO : save crop sub photo not yet done ! save time : 3.2033965587615967 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 19.080458641052246 time for calcul the mask position with numpy : 0.08793973922729492 nb_pixel_total : 1430969 time to create 1 rle with new method : 1.5083012580871582 time for calcul the mask position with numpy : 0.037885427474975586 nb_pixel_total : 255210 time to create 1 rle with new method : 1.0986685752868652 time for calcul the mask position with numpy : 0.04375958442687988 nb_pixel_total : 1020918 time to create 1 rle with new method : 1.0309529304504395 time for calcul the mask position with numpy : 0.23748254776000977 nb_pixel_total : 2272345 time to create 1 rle with new method : 1.1613960266113281 time for calcul the mask position with numpy : 0.07211732864379883 nb_pixel_total : 1465018 time to create 1 rle with new method : 1.3782498836517334 time for calcul the mask position with numpy : 0.07237958908081055 nb_pixel_total : 1125833 time to create 1 rle with new method : 1.146122694015503 time for calcul the mask position with numpy : 0.46547865867614746 nb_pixel_total : 5408907 time to create 1 rle with new method : 1.150841474533081 create new chi : 9.788304090499878 time to delete rle : 0.0029234886169433594 batch 1 Loaded 7 chid ids of type : 4855 Number RLEs to save : 26068 TO DO : save crop sub photo not yet done ! save time : 1.455549955368042 map_output_result : {1356446088: (0.3984669514834567, 'Should be the crop_list due to order', 0.5106671727516221), 1356446064: (0.3984669514834567, 'Should be the crop_list due to order', 0.3690764926591208), 1356445493: (0.3984669514834567, 'Should be the crop_list due to order', 0.5921696212932439), 1356445457: (0.3984669514834567, 'Should be the crop_list due to order', 0.5204214707132966), 1356445406: (0.3984669514834567, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 5 /1356446088.Didn't retrieve data . /1356446064.Didn't retrieve data . /1356445493.Didn't retrieve data . /1356445457.Didn't retrieve data . /1356445406.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01247262954711914 save_final save missing photos in datou_result : time spend for datou_step_exec : 310.1979331970215 time spend to save output : 0.012906551361083984 total time spend for step 5 : 310.21083974838257 step6:crop_condition Tue May 6 22:49:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 279 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3015255 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564599_2361572 we have uploaded 23 photos in the portfolio 3015255 time of upload the photos Elapsed time : 6.912489175796509 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564637_2361572 we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.61524748802185 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3015255 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564660_2361572 we have uploaded 23 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.771373510360718 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564672_2361572 we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.8195641040802 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3015255 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564688_2361572 we have uploaded 14 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.304525852203369 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564694_2361572 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.2635416984558105 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3015255 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564743_2361572 we have uploaded 37 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.349766969680786 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564760_2361572 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.4699082374572754 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3015255 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564765_2361572 we have uploaded 7 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.830559253692627 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3015255 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746564915_2361572 we have uploaded 28 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.736357688903809 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 201 /1356484755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356484778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356486995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356487717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356488673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 608 time used for this insertion : 0.0570826530456543 save_final save missing photos in datou_result : time spend for datou_step_exec : 346.3729679584503 time spend to save output : 0.2806856632232666 total time spend for step 6 : 346.6536536216736 step7:ventilate_hashtags_in_portfolio Tue May 6 22:55:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22731302 get user id for portfolio 22731302 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22736613,22736614,22736615,22736616,22736617,22736622,22736624,22736625,22736626,22736627,22736628,22736629,22736631,22736632,22736633,22736634,22736635,22736636,22736637,22736638?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22731302 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 1 /22731302. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013949155807495117 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.29630446434021 time spend to save output : 0.014147758483886719 total time spend for step 7 : 4.310452222824097 step8:final Tue May 6 22:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356446088: ('0.5070817592326927',), 1356446064: ('0.5070817592326927',), 1356445493: ('0.5070817592326927',), 1356445457: ('0.5070817592326927',), 1356445406: ('0.5070817592326927',)} new output for save of step final : {1356446088: ('0.5070817592326927',), 1356446064: ('0.5070817592326927',), 1356445493: ('0.5070817592326927',), 1356445457: ('0.5070817592326927',), 1356445406: ('0.5070817592326927',)} [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 5 /1356446088.Didn't retrieve data . /1356446064.Didn't retrieve data . /1356445493.Didn't retrieve data . /1356445457.Didn't retrieve data . /1356445406.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.011794805526733398 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11077094078063965 time spend to save output : 0.012228250503540039 total time spend for step 8 : 0.12299919128417969 step9:velours_tree Tue May 6 22:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3503756523132324 time spend to save output : 4.9114227294921875e-05 total time spend for step 9 : 0.35042476654052734 step10:send_mail_cod Tue May 6 22:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22731302_06-05-2025_22_55_31.pdf 22736587 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227365871746564931 22736588 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227365881746564933 22736589 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227365891746564935 22736590 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227365901746564936 22736591 imagette227365911746564937 22736592 imagette227365921746564937 22736593 imagette227365931746564937 22736594 imagette227365941746564937 22736595 imagette227365951746564937 22736596 imagette227365961746564937 22736597 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227365971746564937 22736598 change filename to text .change filename to text .change filename to text .change filename to text .imagette227365981746564938 22736599 imagette227365991746564938 22736600 imagette227366001746564938 22736601 imagette227366011746564938 22736602 imagette227366021746564938 22736603 imagette227366031746564938 22736604 change filename to text .imagette227366041746564938 22736605 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227366051746564939 22736607 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227366071746564939 22736608 imagette227366081746564941 22736609 imagette227366091746564941 22736610 imagette227366101746564941 22736611 imagette227366111746564941 22736612 imagette227366121746564941 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22731302 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22736613,22736614,22736615,22736616,22736617,22736622,22736624,22736625,22736626,22736627,22736628,22736629,22736631,22736632,22736633,22736634,22736635,22736636,22736637,22736638?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22731302 your option no_mail is active, we will not send the real mail to your client args[1356446088] : ((1356446088, 3396.413624889299, 492609224), (1356446088, -0.2916178789411884, 496442774), '0.5070817592326927') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356446064] : ((1356446064, 2397.008330113544, 492609224), (1356446064, -0.3939260028864529, 496442774), '0.5070817592326927') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356445493] : ((1356445493, 1063.5541864861912, 2107751945), (1356445493, -0.21523270463443878, 496442774), '0.5070817592326927') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356445457] : ((1356445457, 2309.046559119176, 492609224), (1356445457, -0.24409830392719728, 496442774), '0.5070817592326927') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356445406] : ((1356445406, 307.41366627401385, 492688767), (1356445406, -1.1439963094382846, 501862349), '0.5070817592326927') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5070817592326927 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731302_06-05-2025_22_55_31.pdf results_Auto_P22731302_06-05-2025_22_55_31.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731302_06-05-2025_22_55_31.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22731302','results_Auto_P22731302_06-05-2025_22_55_31.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731302_06-05-2025_22_55_31.pdf','pdf','','2.47','0.5070817592326927') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013816595077514648 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.125160694122314 time spend to save output : 0.014015436172485352 total time spend for step 10 : 14.1391761302948 step11:split_time_score Tue May 6 22:55:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('34', 4), ('35', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06052025 22731302 Nombre de photos uploadées : 5 / 23040 (0%) 06052025 22731302 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 06052025 22731302 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 9.059906005859375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00039458274841308594 elapsed_time : insert_dashboard_record_day_entry 0.032172441482543945 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731301 order by id desc limit 1 Qualite : 0.5070817592326927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731302_06-05-2025_22_55_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731302 AND mptpi.`type`=4855 To do Qualite : 0.6386387749089113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731303_06-05-2025_22_14_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731303 AND mptpi.`type`=4855 To do Qualite : 0.5753207720446533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22731304_06-05-2025_21_53_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22731304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22731304 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06052025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356446088, 1356446064, 1356445493, 1356445457, 1356445406] Looping around the photos to save general results len do output : 1 /22731302Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446088', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356446064', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445493', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445457', None, None, None, None, None, '2799187') ('4741', None, None, None, None, None, None, None, '2799187') ('4741', '22731302', '1356445406', None, None, None, None, None, '2799187') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.016307592391967773 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3555588722229004 time spend to save output : 0.01645493507385254 total time spend for step 11 : 2.372013807296753 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 583.84user 223.22system 14:23.91elapsed 93%CPU (0avgtext+0avgdata 7071984maxresident)k 1620304inputs+681640outputs (24978major+42992139minor)pagefaults 0swaps