python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3832904 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2827974'] with mtr_portfolio_ids : ['22889869'] and first list_photo_ids : [] new path : /proc/3832904/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.5890820026397705 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon May 12 20:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-12 20:41:34.042421: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-12 20:41:34.067274: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-12 20:41:34.069322: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0824000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-12 20:41:34.069370: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-12 20:41:34.072999: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-12 20:41:34.304071: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb728840 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-12 20:41:34.304114: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-12 20:41:34.305227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:41:34.305593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:41:34.308616: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:41:34.311195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:41:34.311677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:41:34.315120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:41:34.316640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:41:34.320729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:41:34.321799: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:41:34.321857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:41:34.322441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-12 20:41:34.322456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-12 20:41:34.322464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-12 20:41:34.323490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-12 20:41:34.604139: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:41:34.604230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:41:34.604259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:41:34.604285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:41:34.604310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:41:34.604335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:41:34.604360: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:41:34.604385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:41:34.606031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:41:34.607443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:41:34.607489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:41:34.607514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:41:34.607537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:41:34.607575: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:41:34.607599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:41:34.607622: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:41:34.607644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:41:34.608661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:41:34.608686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-12 20:41:34.608693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-12 20:41:34.608701: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-12 20:41:34.609679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-12 20:41:46.759756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:41:46.938850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 3833126 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.0023391246795654297 nb_pixel_total : 90467 time to create 1 rle with old method : 0.10570788383483887 length of segment : 321 time for calcul the mask position with numpy : 1.0137338638305664 nb_pixel_total : 1646017 time to create 1 rle with new method : 0.8131892681121826 length of segment : 963 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 32884 time to create 1 rle with old method : 0.042090654373168945 length of segment : 176 time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 17886 time to create 1 rle with old method : 0.020476818084716797 length of segment : 124 time for calcul the mask position with numpy : 0.0006196498870849609 nb_pixel_total : 18921 time to create 1 rle with old method : 0.022234678268432617 length of segment : 199 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 20018 time to create 1 rle with old method : 0.028001785278320312 length of segment : 218 time for calcul the mask position with numpy : 0.004537105560302734 nb_pixel_total : 253547 time to create 1 rle with new method : 0.010442733764648438 length of segment : 644 time for calcul the mask position with numpy : 0.0003705024719238281 nb_pixel_total : 15582 time to create 1 rle with old method : 0.018311023712158203 length of segment : 89 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 11523 time to create 1 rle with old method : 0.013663291931152344 length of segment : 287 time for calcul the mask position with numpy : 0.0002758502960205078 nb_pixel_total : 11721 time to create 1 rle with old method : 0.013348102569580078 length of segment : 157 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 18520 time to create 1 rle with old method : 0.025101423263549805 length of segment : 156 time for calcul the mask position with numpy : 0.0006544589996337891 nb_pixel_total : 11586 time to create 1 rle with old method : 0.014692544937133789 length of segment : 163 time for calcul the mask position with numpy : 0.0016543865203857422 nb_pixel_total : 106266 time to create 1 rle with old method : 0.12206625938415527 length of segment : 290 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 4699 time to create 1 rle with old method : 0.008104085922241211 length of segment : 80 time for calcul the mask position with numpy : 0.003091096878051758 nb_pixel_total : 59542 time to create 1 rle with old method : 0.07286763191223145 length of segment : 369 time for calcul the mask position with numpy : 0.00341033935546875 nb_pixel_total : 72345 time to create 1 rle with old method : 0.08797621726989746 length of segment : 389 time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 8474 time to create 1 rle with old method : 0.010156393051147461 length of segment : 106 time for calcul the mask position with numpy : 0.005615711212158203 nb_pixel_total : 116757 time to create 1 rle with old method : 0.1321403980255127 length of segment : 403 time for calcul the mask position with numpy : 0.01967144012451172 nb_pixel_total : 537842 time to create 1 rle with new method : 0.15638470649719238 length of segment : 1344 time for calcul the mask position with numpy : 0.0006723403930664062 nb_pixel_total : 18087 time to create 1 rle with old method : 0.021199941635131836 length of segment : 154 time for calcul the mask position with numpy : 0.003587007522583008 nb_pixel_total : 84920 time to create 1 rle with old method : 0.0976717472076416 length of segment : 452 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 21953 time to create 1 rle with old method : 0.026148557662963867 length of segment : 147 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 13269 time to create 1 rle with old method : 0.015418291091918945 length of segment : 198 time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 4399 time to create 1 rle with old method : 0.005765676498413086 length of segment : 75 time for calcul the mask position with numpy : 0.001688241958618164 nb_pixel_total : 41725 time to create 1 rle with old method : 0.04755806922912598 length of segment : 237 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 12761 time to create 1 rle with old method : 0.015362977981567383 length of segment : 120 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 26157 time to create 1 rle with old method : 0.030452966690063477 length of segment : 152 time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 3521 time to create 1 rle with old method : 0.004505634307861328 length of segment : 45 time for calcul the mask position with numpy : 0.0004818439483642578 nb_pixel_total : 17909 time to create 1 rle with old method : 0.02091240882873535 length of segment : 178 time for calcul the mask position with numpy : 0.00032901763916015625 nb_pixel_total : 12924 time to create 1 rle with old method : 0.015488862991333008 length of segment : 117 time for calcul the mask position with numpy : 0.0012099742889404297 nb_pixel_total : 33091 time to create 1 rle with old method : 0.03760385513305664 length of segment : 194 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 11866 time to create 1 rle with old method : 0.01371145248413086 length of segment : 82 time for calcul the mask position with numpy : 0.001691579818725586 nb_pixel_total : 43351 time to create 1 rle with old method : 0.04964804649353027 length of segment : 216 time for calcul the mask position with numpy : 0.01663494110107422 nb_pixel_total : 567839 time to create 1 rle with new method : 0.01854562759399414 length of segment : 441 time for calcul the mask position with numpy : 0.0037088394165039062 nb_pixel_total : 100813 time to create 1 rle with old method : 0.11454534530639648 length of segment : 691 time for calcul the mask position with numpy : 0.00542140007019043 nb_pixel_total : 78571 time to create 1 rle with old method : 0.1034245491027832 length of segment : 405 time for calcul the mask position with numpy : 0.004700183868408203 nb_pixel_total : 130356 time to create 1 rle with old method : 0.1483469009399414 length of segment : 332 time for calcul the mask position with numpy : 0.014306306838989258 nb_pixel_total : 548455 time to create 1 rle with new method : 0.021183490753173828 length of segment : 832 time for calcul the mask position with numpy : 0.0018532276153564453 nb_pixel_total : 58386 time to create 1 rle with old method : 0.06737422943115234 length of segment : 386 time for calcul the mask position with numpy : 0.001117706298828125 nb_pixel_total : 25467 time to create 1 rle with old method : 0.029603242874145508 length of segment : 200 time for calcul the mask position with numpy : 0.015446186065673828 nb_pixel_total : 524240 time to create 1 rle with new method : 0.03009510040283203 length of segment : 616 time for calcul the mask position with numpy : 0.0012586116790771484 nb_pixel_total : 31343 time to create 1 rle with old method : 0.051077842712402344 length of segment : 150 time for calcul the mask position with numpy : 0.0015726089477539062 nb_pixel_total : 46722 time to create 1 rle with old method : 0.053961992263793945 length of segment : 195 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 31106 time to create 1 rle with old method : 0.03550887107849121 length of segment : 202 time for calcul the mask position with numpy : 0.0014903545379638672 nb_pixel_total : 43112 time to create 1 rle with old method : 0.04984235763549805 length of segment : 278 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 22835 time to create 1 rle with old method : 0.026304960250854492 length of segment : 190 time for calcul the mask position with numpy : 0.0005505084991455078 nb_pixel_total : 14315 time to create 1 rle with old method : 0.016974210739135742 length of segment : 131 time for calcul the mask position with numpy : 0.001340627670288086 nb_pixel_total : 42134 time to create 1 rle with old method : 0.04848122596740723 length of segment : 223 time for calcul the mask position with numpy : 0.0025408267974853516 nb_pixel_total : 88478 time to create 1 rle with old method : 0.1237785816192627 length of segment : 303 time for calcul the mask position with numpy : 0.0008127689361572266 nb_pixel_total : 22183 time to create 1 rle with old method : 0.025942564010620117 length of segment : 223 time for calcul the mask position with numpy : 0.00017380714416503906 nb_pixel_total : 5193 time to create 1 rle with old method : 0.00615692138671875 length of segment : 120 time for calcul the mask position with numpy : 0.0013456344604492188 nb_pixel_total : 34579 time to create 1 rle with old method : 0.040522098541259766 length of segment : 244 time for calcul the mask position with numpy : 0.001789093017578125 nb_pixel_total : 28094 time to create 1 rle with old method : 0.04785346984863281 length of segment : 296 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 4992 time to create 1 rle with old method : 0.005982637405395508 length of segment : 77 time for calcul the mask position with numpy : 0.0013322830200195312 nb_pixel_total : 27707 time to create 1 rle with old method : 0.03163909912109375 length of segment : 252 time for calcul the mask position with numpy : 0.0019073486328125 nb_pixel_total : 55091 time to create 1 rle with old method : 0.06419134140014648 length of segment : 310 time for calcul the mask position with numpy : 0.0009775161743164062 nb_pixel_total : 26361 time to create 1 rle with old method : 0.04302477836608887 length of segment : 287 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 12901 time to create 1 rle with old method : 0.015276193618774414 length of segment : 95 time for calcul the mask position with numpy : 0.001302957534790039 nb_pixel_total : 13436 time to create 1 rle with old method : 0.01609206199645996 length of segment : 168 time for calcul the mask position with numpy : 0.0019352436065673828 nb_pixel_total : 44224 time to create 1 rle with old method : 0.05084586143493652 length of segment : 278 time for calcul the mask position with numpy : 0.0003876686096191406 nb_pixel_total : 11900 time to create 1 rle with old method : 0.015351533889770508 length of segment : 127 time for calcul the mask position with numpy : 0.0016138553619384766 nb_pixel_total : 26070 time to create 1 rle with old method : 0.030210018157958984 length of segment : 254 time for calcul the mask position with numpy : 0.0009603500366210938 nb_pixel_total : 17802 time to create 1 rle with old method : 0.020130157470703125 length of segment : 237 time for calcul the mask position with numpy : 0.0012886524200439453 nb_pixel_total : 31786 time to create 1 rle with old method : 0.03522610664367676 length of segment : 266 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 51730 time to create 1 rle with old method : 0.058933258056640625 length of segment : 281 time for calcul the mask position with numpy : 0.004365205764770508 nb_pixel_total : 83820 time to create 1 rle with old method : 0.09318780899047852 length of segment : 438 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 4830 time to create 1 rle with old method : 0.0055217742919921875 length of segment : 115 time for calcul the mask position with numpy : 0.0016291141510009766 nb_pixel_total : 37321 time to create 1 rle with old method : 0.04343676567077637 length of segment : 235 time for calcul the mask position with numpy : 0.0002262592315673828 nb_pixel_total : 8700 time to create 1 rle with old method : 0.01044917106628418 length of segment : 86 time for calcul the mask position with numpy : 0.025682687759399414 nb_pixel_total : 1031682 time to create 1 rle with new method : 0.0818183422088623 length of segment : 1527 time for calcul the mask position with numpy : 0.0728158950805664 nb_pixel_total : 1381349 time to create 1 rle with new method : 0.453582763671875 length of segment : 1230 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 22786 time to create 1 rle with old method : 0.026337623596191406 length of segment : 291 time for calcul the mask position with numpy : 0.0009794235229492188 nb_pixel_total : 31049 time to create 1 rle with old method : 0.03555607795715332 length of segment : 218 time for calcul the mask position with numpy : 0.001493215560913086 nb_pixel_total : 59600 time to create 1 rle with old method : 0.06742382049560547 length of segment : 311 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 16675 time to create 1 rle with old method : 0.0206298828125 length of segment : 177 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 27786 time to create 1 rle with old method : 0.03357410430908203 length of segment : 239 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 45796 time to create 1 rle with old method : 0.05867958068847656 length of segment : 283 time for calcul the mask position with numpy : 0.001405954360961914 nb_pixel_total : 48367 time to create 1 rle with old method : 0.07532930374145508 length of segment : 417 time for calcul the mask position with numpy : 0.004043102264404297 nb_pixel_total : 202778 time to create 1 rle with new method : 0.010062694549560547 length of segment : 360 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 29070 time to create 1 rle with old method : 0.032689809799194336 length of segment : 216 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 5503 time to create 1 rle with old method : 0.00631260871887207 length of segment : 167 time for calcul the mask position with numpy : 0.0004773139953613281 nb_pixel_total : 25479 time to create 1 rle with old method : 0.03009033203125 length of segment : 190 time for calcul the mask position with numpy : 0.0010409355163574219 nb_pixel_total : 39734 time to create 1 rle with old method : 0.04476618766784668 length of segment : 240 time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 6420 time to create 1 rle with old method : 0.007559537887573242 length of segment : 113 time for calcul the mask position with numpy : 0.0018951892852783203 nb_pixel_total : 35828 time to create 1 rle with old method : 0.05605483055114746 length of segment : 235 time for calcul the mask position with numpy : 0.00081634521484375 nb_pixel_total : 31639 time to create 1 rle with old method : 0.03661775588989258 length of segment : 230 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 19961 time to create 1 rle with old method : 0.02298283576965332 length of segment : 197 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 37873 time to create 1 rle with old method : 0.04248619079589844 length of segment : 234 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 18068 time to create 1 rle with old method : 0.02021026611328125 length of segment : 157 time for calcul the mask position with numpy : 0.007163047790527344 nb_pixel_total : 250474 time to create 1 rle with new method : 0.011426448822021484 length of segment : 590 time for calcul the mask position with numpy : 0.0030214786529541016 nb_pixel_total : 90902 time to create 1 rle with old method : 0.11548280715942383 length of segment : 437 time for calcul the mask position with numpy : 0.0015971660614013672 nb_pixel_total : 55771 time to create 1 rle with old method : 0.06856179237365723 length of segment : 247 time for calcul the mask position with numpy : 0.0021202564239501953 nb_pixel_total : 68063 time to create 1 rle with old method : 0.08196425437927246 length of segment : 284 time for calcul the mask position with numpy : 0.0007717609405517578 nb_pixel_total : 25913 time to create 1 rle with old method : 0.02952098846435547 length of segment : 155 time for calcul the mask position with numpy : 0.001432657241821289 nb_pixel_total : 40341 time to create 1 rle with old method : 0.06330418586730957 length of segment : 252 time for calcul the mask position with numpy : 0.003629446029663086 nb_pixel_total : 70502 time to create 1 rle with old method : 0.09488511085510254 length of segment : 406 time for calcul the mask position with numpy : 0.017772674560546875 nb_pixel_total : 654691 time to create 1 rle with new method : 0.03766632080078125 length of segment : 459 time for calcul the mask position with numpy : 0.0011174678802490234 nb_pixel_total : 29296 time to create 1 rle with old method : 0.034244537353515625 length of segment : 196 time for calcul the mask position with numpy : 0.0013208389282226562 nb_pixel_total : 45203 time to create 1 rle with old method : 0.05146074295043945 length of segment : 192 time for calcul the mask position with numpy : 0.01428675651550293 nb_pixel_total : 458403 time to create 1 rle with new method : 0.018488645553588867 length of segment : 474 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 7371 time to create 1 rle with old method : 0.01021885871887207 length of segment : 123 time for calcul the mask position with numpy : 0.0016942024230957031 nb_pixel_total : 28182 time to create 1 rle with old method : 0.03254818916320801 length of segment : 454 time for calcul the mask position with numpy : 0.0040853023529052734 nb_pixel_total : 7499 time to create 1 rle with old method : 0.010004281997680664 length of segment : 252 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 1516 time to create 1 rle with old method : 0.00206756591796875 length of segment : 44 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 5440 time to create 1 rle with old method : 0.006605625152587891 length of segment : 80 time for calcul the mask position with numpy : 0.00030684471130371094 nb_pixel_total : 10260 time to create 1 rle with old method : 0.01241755485534668 length of segment : 76 time for calcul the mask position with numpy : 0.0012958049774169922 nb_pixel_total : 48554 time to create 1 rle with old method : 0.05570101737976074 length of segment : 279 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 165 time to create 1 rle with old method : 0.00026297569274902344 length of segment : 19 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 5776 time to create 1 rle with old method : 0.006865501403808594 length of segment : 87 time for calcul the mask position with numpy : 0.00048661231994628906 nb_pixel_total : 14027 time to create 1 rle with old method : 0.016387462615966797 length of segment : 103 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 8061 time to create 1 rle with old method : 0.00971078872680664 length of segment : 107 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 5680 time to create 1 rle with old method : 0.006827831268310547 length of segment : 77 time for calcul the mask position with numpy : 0.0009667873382568359 nb_pixel_total : 14945 time to create 1 rle with old method : 0.019275426864624023 length of segment : 146 time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 4945 time to create 1 rle with old method : 0.0060350894927978516 length of segment : 151 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 5476 time to create 1 rle with old method : 0.006977081298828125 length of segment : 59 time for calcul the mask position with numpy : 0.0006666183471679688 nb_pixel_total : 8093 time to create 1 rle with old method : 0.009963274002075195 length of segment : 101 time for calcul the mask position with numpy : 0.0014035701751708984 nb_pixel_total : 45010 time to create 1 rle with old method : 0.05443978309631348 length of segment : 362 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 15546 time to create 1 rle with old method : 0.01779913902282715 length of segment : 196 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 104 time to create 1 rle with old method : 0.00019431114196777344 length of segment : 28 time for calcul the mask position with numpy : 0.00164031982421875 nb_pixel_total : 70872 time to create 1 rle with old method : 0.07940077781677246 length of segment : 339 time for calcul the mask position with numpy : 0.029450178146362305 nb_pixel_total : 1502071 time to create 1 rle with new method : 0.4388711452484131 length of segment : 1120 time for calcul the mask position with numpy : 0.0023093223571777344 nb_pixel_total : 95343 time to create 1 rle with old method : 0.10911154747009277 length of segment : 267 time for calcul the mask position with numpy : 0.0018384456634521484 nb_pixel_total : 61847 time to create 1 rle with old method : 0.07424330711364746 length of segment : 329 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 7977 time to create 1 rle with old method : 0.011719226837158203 length of segment : 174 time for calcul the mask position with numpy : 0.0009279251098632812 nb_pixel_total : 26553 time to create 1 rle with old method : 0.0302731990814209 length of segment : 192 time for calcul the mask position with numpy : 0.0005908012390136719 nb_pixel_total : 21056 time to create 1 rle with old method : 0.024034738540649414 length of segment : 173 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 18281 time to create 1 rle with old method : 0.02129983901977539 length of segment : 109 time for calcul the mask position with numpy : 0.0042417049407958984 nb_pixel_total : 143577 time to create 1 rle with old method : 0.16124939918518066 length of segment : 487 time for calcul the mask position with numpy : 0.0008485317230224609 nb_pixel_total : 28786 time to create 1 rle with old method : 0.032724618911743164 length of segment : 286 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 20315 time to create 1 rle with old method : 0.02327418327331543 length of segment : 111 time for calcul the mask position with numpy : 0.0004177093505859375 nb_pixel_total : 10090 time to create 1 rle with old method : 0.011849641799926758 length of segment : 126 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 17105 time to create 1 rle with old method : 0.019750356674194336 length of segment : 119 time for calcul the mask position with numpy : 0.0008823871612548828 nb_pixel_total : 41728 time to create 1 rle with old method : 0.04774212837219238 length of segment : 201 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 17179 time to create 1 rle with old method : 0.020547151565551758 length of segment : 110 time for calcul the mask position with numpy : 0.25226378440856934 nb_pixel_total : 2911557 time to create 1 rle with new method : 0.6664843559265137 length of segment : 1809 time for calcul the mask position with numpy : 0.004494905471801758 nb_pixel_total : 255367 time to create 1 rle with new method : 0.01434183120727539 length of segment : 1016 time for calcul the mask position with numpy : 0.4344336986541748 nb_pixel_total : 3551573 time to create 1 rle with new method : 0.9814357757568359 length of segment : 3155 time spent for convertir_results : 21.069055795669556 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 137 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 76.82269072532654 time spend to save output : 0.12465977668762207 total time spend for step 1 : 76.94735050201416 step2:mask_detect Mon May 12 20:42:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-12 20:42:50.993947: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-12 20:42:51.023151: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-12 20:42:51.025013: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0808000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-12 20:42:51.025086: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-12 20:42:51.028528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-12 20:42:51.275752: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xbb3c100 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-12 20:42:51.275810: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-12 20:42:51.277131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:42:51.277657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:42:51.280942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:42:51.284264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:42:51.284849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:42:51.288838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:42:51.290103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:42:51.295537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:42:51.313252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:42:51.313386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:42:51.314144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-12 20:42:51.314164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-12 20:42:51.314175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-12 20:42:51.315620: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5042 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-12 20:42:51.435571: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:42:51.435701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:42:51.435726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:42:51.435748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:42:51.435769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:42:51.435789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:42:51.435824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:42:51.435846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:42:51.437079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:42:51.438702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-12 20:42:51.438818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-12 20:42:51.438843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:42:51.438862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-12 20:42:51.438882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-12 20:42:51.438941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-12 20:42:51.438966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-12 20:42:51.438987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-12 20:42:51.440113: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-12 20:42:51.440158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-12 20:42:51.440168: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-12 20:42:51.440177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-12 20:42:51.441249: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5042 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-12 20:43:03.913343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-12 20:43:04.092248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 3836636 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 15 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0012936592102050781 nb_pixel_total : 28007 time to create 1 rle with old method : 0.043721914291381836 length of segment : 171 time for calcul the mask position with numpy : 0.023273944854736328 nb_pixel_total : 189621 time to create 1 rle with new method : 0.011597394943237305 length of segment : 443 time for calcul the mask position with numpy : 0.003621816635131836 nb_pixel_total : 190815 time to create 1 rle with new method : 0.009648799896240234 length of segment : 415 time for calcul the mask position with numpy : 0.0014050006866455078 nb_pixel_total : 65147 time to create 1 rle with old method : 0.07424712181091309 length of segment : 287 time for calcul the mask position with numpy : 0.001348733901977539 nb_pixel_total : 55865 time to create 1 rle with old method : 0.06466102600097656 length of segment : 288 time for calcul the mask position with numpy : 0.006404876708984375 nb_pixel_total : 349967 time to create 1 rle with new method : 0.01871347427368164 length of segment : 720 time for calcul the mask position with numpy : 0.0020155906677246094 nb_pixel_total : 111602 time to create 1 rle with old method : 0.12696242332458496 length of segment : 394 time for calcul the mask position with numpy : 0.000751495361328125 nb_pixel_total : 40549 time to create 1 rle with old method : 0.04681849479675293 length of segment : 159 time for calcul the mask position with numpy : 0.005338191986083984 nb_pixel_total : 389714 time to create 1 rle with new method : 0.012255191802978516 length of segment : 376 time for calcul the mask position with numpy : 0.003849029541015625 nb_pixel_total : 144161 time to create 1 rle with old method : 0.17920756340026855 length of segment : 371 time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 47608 time to create 1 rle with old method : 0.054154157638549805 length of segment : 305 time for calcul the mask position with numpy : 0.0016796588897705078 nb_pixel_total : 87418 time to create 1 rle with old method : 0.09856557846069336 length of segment : 433 time for calcul the mask position with numpy : 0.0019423961639404297 nb_pixel_total : 109843 time to create 1 rle with old method : 0.12373661994934082 length of segment : 310 time for calcul the mask position with numpy : 0.0011341571807861328 nb_pixel_total : 49341 time to create 1 rle with old method : 0.054318904876708984 length of segment : 306 time for calcul the mask position with numpy : 0.0017507076263427734 nb_pixel_total : 101502 time to create 1 rle with old method : 0.11352705955505371 length of segment : 268 time for calcul the mask position with numpy : 0.002169370651245117 nb_pixel_total : 142634 time to create 1 rle with old method : 0.16089200973510742 length of segment : 399 time for calcul the mask position with numpy : 0.0006802082061767578 nb_pixel_total : 39876 time to create 1 rle with old method : 0.045560359954833984 length of segment : 229 time for calcul the mask position with numpy : 0.004450798034667969 nb_pixel_total : 320536 time to create 1 rle with new method : 0.02757573127746582 length of segment : 405 time for calcul the mask position with numpy : 0.002231597900390625 nb_pixel_total : 97334 time to create 1 rle with old method : 0.11010146141052246 length of segment : 404 time for calcul the mask position with numpy : 0.0007054805755615234 nb_pixel_total : 31106 time to create 1 rle with old method : 0.03583502769470215 length of segment : 200 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 15689 time to create 1 rle with old method : 0.0186007022857666 length of segment : 146 time for calcul the mask position with numpy : 0.0005862712860107422 nb_pixel_total : 30175 time to create 1 rle with old method : 0.03520822525024414 length of segment : 178 time for calcul the mask position with numpy : 0.0028390884399414062 nb_pixel_total : 168155 time to create 1 rle with new method : 0.005789518356323242 length of segment : 514 time for calcul the mask position with numpy : 0.0016717910766601562 nb_pixel_total : 95049 time to create 1 rle with old method : 0.13408517837524414 length of segment : 246 time for calcul the mask position with numpy : 0.002489328384399414 nb_pixel_total : 161820 time to create 1 rle with new method : 0.006657600402832031 length of segment : 540 time for calcul the mask position with numpy : 0.006747722625732422 nb_pixel_total : 489644 time to create 1 rle with new method : 0.022537946701049805 length of segment : 654 time for calcul the mask position with numpy : 0.014046192169189453 nb_pixel_total : 291475 time to create 1 rle with new method : 0.01722121238708496 length of segment : 731 time for calcul the mask position with numpy : 0.0063822269439697266 nb_pixel_total : 71096 time to create 1 rle with old method : 0.08180427551269531 length of segment : 505 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 46117 time to create 1 rle with old method : 0.05298423767089844 length of segment : 191 time for calcul the mask position with numpy : 0.0024144649505615234 nb_pixel_total : 155354 time to create 1 rle with new method : 0.0058498382568359375 length of segment : 439 time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 32970 time to create 1 rle with old method : 0.05386757850646973 length of segment : 188 time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 34077 time to create 1 rle with old method : 0.0399317741394043 length of segment : 179 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 14341 time to create 1 rle with old method : 0.01636815071105957 length of segment : 292 time for calcul the mask position with numpy : 0.0010616779327392578 nb_pixel_total : 48455 time to create 1 rle with old method : 0.05579113960266113 length of segment : 154 time for calcul the mask position with numpy : 0.00733637809753418 nb_pixel_total : 503743 time to create 1 rle with new method : 0.017081022262573242 length of segment : 666 time for calcul the mask position with numpy : 0.0009753704071044922 nb_pixel_total : 41454 time to create 1 rle with old method : 0.047373056411743164 length of segment : 233 time for calcul the mask position with numpy : 0.003062009811401367 nb_pixel_total : 170133 time to create 1 rle with new method : 0.009673595428466797 length of segment : 452 time for calcul the mask position with numpy : 0.0015559196472167969 nb_pixel_total : 99951 time to create 1 rle with old method : 0.11317038536071777 length of segment : 286 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 2160 time to create 1 rle with old method : 0.0030694007873535156 length of segment : 106 time for calcul the mask position with numpy : 0.004900217056274414 nb_pixel_total : 367530 time to create 1 rle with new method : 0.011615991592407227 length of segment : 423 time for calcul the mask position with numpy : 0.0038738250732421875 nb_pixel_total : 253420 time to create 1 rle with new method : 0.010349750518798828 length of segment : 370 time for calcul the mask position with numpy : 0.018074750900268555 nb_pixel_total : 880876 time to create 1 rle with new method : 0.3399052619934082 length of segment : 949 time for calcul the mask position with numpy : 0.0019712448120117188 nb_pixel_total : 98334 time to create 1 rle with old method : 0.10769200325012207 length of segment : 348 time for calcul the mask position with numpy : 0.0011889934539794922 nb_pixel_total : 65620 time to create 1 rle with old method : 0.0736079216003418 length of segment : 272 time for calcul the mask position with numpy : 0.0037446022033691406 nb_pixel_total : 178191 time to create 1 rle with new method : 0.010404109954833984 length of segment : 479 time for calcul the mask position with numpy : 0.0024924278259277344 nb_pixel_total : 136229 time to create 1 rle with old method : 0.1518092155456543 length of segment : 454 time for calcul the mask position with numpy : 0.0013818740844726562 nb_pixel_total : 61042 time to create 1 rle with old method : 0.06925034523010254 length of segment : 253 time for calcul the mask position with numpy : 0.0029420852661132812 nb_pixel_total : 167634 time to create 1 rle with new method : 0.007782459259033203 length of segment : 297 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 23343 time to create 1 rle with old method : 0.03197503089904785 length of segment : 247 time for calcul the mask position with numpy : 0.0007903575897216797 nb_pixel_total : 30835 time to create 1 rle with old method : 0.036277055740356445 length of segment : 146 time for calcul the mask position with numpy : 0.0008211135864257812 nb_pixel_total : 37484 time to create 1 rle with old method : 0.04278731346130371 length of segment : 377 time for calcul the mask position with numpy : 0.01107025146484375 nb_pixel_total : 483247 time to create 1 rle with new method : 0.17339563369750977 length of segment : 1391 time for calcul the mask position with numpy : 0.0010356903076171875 nb_pixel_total : 41636 time to create 1 rle with old method : 0.04824090003967285 length of segment : 248 time for calcul the mask position with numpy : 0.002707958221435547 nb_pixel_total : 125607 time to create 1 rle with old method : 0.140455961227417 length of segment : 426 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 26145 time to create 1 rle with old method : 0.03045487403869629 length of segment : 159 time for calcul the mask position with numpy : 0.015312433242797852 nb_pixel_total : 716691 time to create 1 rle with new method : 0.05299878120422363 length of segment : 1166 time for calcul the mask position with numpy : 0.0011687278747558594 nb_pixel_total : 51736 time to create 1 rle with old method : 0.05802488327026367 length of segment : 242 time for calcul the mask position with numpy : 0.01055145263671875 nb_pixel_total : 436632 time to create 1 rle with new method : 0.030185699462890625 length of segment : 770 time for calcul the mask position with numpy : 0.0011022090911865234 nb_pixel_total : 44306 time to create 1 rle with old method : 0.05028128623962402 length of segment : 255 time for calcul the mask position with numpy : 0.002287149429321289 nb_pixel_total : 113974 time to create 1 rle with old method : 0.12669730186462402 length of segment : 456 time for calcul the mask position with numpy : 0.0006740093231201172 nb_pixel_total : 35918 time to create 1 rle with old method : 0.04053449630737305 length of segment : 201 time for calcul the mask position with numpy : 0.0031731128692626953 nb_pixel_total : 37897 time to create 1 rle with old method : 0.04355001449584961 length of segment : 335 time for calcul the mask position with numpy : 0.0031464099884033203 nb_pixel_total : 164766 time to create 1 rle with new method : 0.008837699890136719 length of segment : 490 time for calcul the mask position with numpy : 0.0007615089416503906 nb_pixel_total : 23132 time to create 1 rle with old method : 0.026127099990844727 length of segment : 158 time for calcul the mask position with numpy : 0.0006783008575439453 nb_pixel_total : 24101 time to create 1 rle with old method : 0.02741265296936035 length of segment : 269 time for calcul the mask position with numpy : 0.001468658447265625 nb_pixel_total : 84787 time to create 1 rle with old method : 0.09310531616210938 length of segment : 319 time for calcul the mask position with numpy : 0.004641532897949219 nb_pixel_total : 242824 time to create 1 rle with new method : 0.012526988983154297 length of segment : 388 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 18703 time to create 1 rle with old method : 0.021853208541870117 length of segment : 207 time for calcul the mask position with numpy : 0.005762338638305664 nb_pixel_total : 286512 time to create 1 rle with new method : 0.017031192779541016 length of segment : 917 time for calcul the mask position with numpy : 0.001348257064819336 nb_pixel_total : 78921 time to create 1 rle with old method : 0.08792304992675781 length of segment : 296 time for calcul the mask position with numpy : 0.008990764617919922 nb_pixel_total : 446561 time to create 1 rle with new method : 0.024108409881591797 length of segment : 656 time for calcul the mask position with numpy : 0.0011844635009765625 nb_pixel_total : 23692 time to create 1 rle with old method : 0.027451276779174805 length of segment : 270 time for calcul the mask position with numpy : 0.001306295394897461 nb_pixel_total : 68535 time to create 1 rle with old method : 0.07404303550720215 length of segment : 374 time for calcul the mask position with numpy : 0.0010094642639160156 nb_pixel_total : 43527 time to create 1 rle with old method : 0.048151493072509766 length of segment : 270 time for calcul the mask position with numpy : 0.001047372817993164 nb_pixel_total : 50196 time to create 1 rle with old method : 0.05687093734741211 length of segment : 264 time for calcul the mask position with numpy : 0.001596212387084961 nb_pixel_total : 65217 time to create 1 rle with old method : 0.09068679809570312 length of segment : 465 time for calcul the mask position with numpy : 0.0028460025787353516 nb_pixel_total : 144646 time to create 1 rle with old method : 0.1609358787536621 length of segment : 330 time for calcul the mask position with numpy : 0.0014638900756835938 nb_pixel_total : 67249 time to create 1 rle with old method : 0.0747673511505127 length of segment : 335 time for calcul the mask position with numpy : 0.0016067028045654297 nb_pixel_total : 90063 time to create 1 rle with old method : 0.09732341766357422 length of segment : 307 time for calcul the mask position with numpy : 0.0012054443359375 nb_pixel_total : 50214 time to create 1 rle with old method : 0.05731678009033203 length of segment : 296 time for calcul the mask position with numpy : 0.0012218952178955078 nb_pixel_total : 50154 time to create 1 rle with old method : 0.05613446235656738 length of segment : 211 time for calcul the mask position with numpy : 0.004564046859741211 nb_pixel_total : 177767 time to create 1 rle with new method : 0.014015913009643555 length of segment : 1000 time for calcul the mask position with numpy : 0.020457983016967773 nb_pixel_total : 661976 time to create 1 rle with new method : 0.19284486770629883 length of segment : 740 time for calcul the mask position with numpy : 0.0062656402587890625 nb_pixel_total : 344437 time to create 1 rle with new method : 0.014717817306518555 length of segment : 602 time for calcul the mask position with numpy : 0.0009887218475341797 nb_pixel_total : 25843 time to create 1 rle with old method : 0.02897167205810547 length of segment : 342 time for calcul the mask position with numpy : 0.005080223083496094 nb_pixel_total : 194531 time to create 1 rle with new method : 0.015412330627441406 length of segment : 926 time for calcul the mask position with numpy : 0.002373218536376953 nb_pixel_total : 115524 time to create 1 rle with old method : 0.12934660911560059 length of segment : 282 time for calcul the mask position with numpy : 0.0011188983917236328 nb_pixel_total : 52704 time to create 1 rle with old method : 0.05932116508483887 length of segment : 250 time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 5566 time to create 1 rle with old method : 0.006563663482666016 length of segment : 120 time for calcul the mask position with numpy : 0.003806591033935547 nb_pixel_total : 207522 time to create 1 rle with new method : 0.01146388053894043 length of segment : 518 time for calcul the mask position with numpy : 0.0008087158203125 nb_pixel_total : 41835 time to create 1 rle with old method : 0.04671072959899902 length of segment : 218 time for calcul the mask position with numpy : 0.0008561611175537109 nb_pixel_total : 39057 time to create 1 rle with old method : 0.04436302185058594 length of segment : 188 time for calcul the mask position with numpy : 0.0031659603118896484 nb_pixel_total : 157009 time to create 1 rle with new method : 0.00926971435546875 length of segment : 519 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 54572 time to create 1 rle with old method : 0.06158113479614258 length of segment : 227 time for calcul the mask position with numpy : 0.003410816192626953 nb_pixel_total : 174828 time to create 1 rle with new method : 0.012297630310058594 length of segment : 357 time for calcul the mask position with numpy : 0.018286943435668945 nb_pixel_total : 738833 time to create 1 rle with new method : 0.09682464599609375 length of segment : 1194 time for calcul the mask position with numpy : 0.0009715557098388672 nb_pixel_total : 46051 time to create 1 rle with old method : 0.053019046783447266 length of segment : 484 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 430468 time to create 1 rle with new method : 0.04085183143615723 length of segment : 925 time for calcul the mask position with numpy : 0.0027806758880615234 nb_pixel_total : 155793 time to create 1 rle with new method : 0.007962942123413086 length of segment : 316 time for calcul the mask position with numpy : 0.0009653568267822266 nb_pixel_total : 36297 time to create 1 rle with old method : 0.04209446907043457 length of segment : 188 time for calcul the mask position with numpy : 0.0021114349365234375 nb_pixel_total : 133128 time to create 1 rle with old method : 0.1497361660003662 length of segment : 615 time for calcul the mask position with numpy : 0.0015468597412109375 nb_pixel_total : 82454 time to create 1 rle with old method : 0.09304642677307129 length of segment : 282 time for calcul the mask position with numpy : 0.0012657642364501953 nb_pixel_total : 65920 time to create 1 rle with old method : 0.07521653175354004 length of segment : 266 time for calcul the mask position with numpy : 0.00113677978515625 nb_pixel_total : 55104 time to create 1 rle with old method : 0.06595563888549805 length of segment : 244 time for calcul the mask position with numpy : 0.0025010108947753906 nb_pixel_total : 127747 time to create 1 rle with old method : 0.16852545738220215 length of segment : 421 time for calcul the mask position with numpy : 0.0010218620300292969 nb_pixel_total : 44845 time to create 1 rle with old method : 0.051927804946899414 length of segment : 216 time for calcul the mask position with numpy : 0.0014371871948242188 nb_pixel_total : 76646 time to create 1 rle with old method : 0.08683061599731445 length of segment : 348 time for calcul the mask position with numpy : 0.0010895729064941406 nb_pixel_total : 38718 time to create 1 rle with old method : 0.044457197189331055 length of segment : 253 time for calcul the mask position with numpy : 0.002564668655395508 nb_pixel_total : 147985 time to create 1 rle with old method : 0.167341947555542 length of segment : 481 time for calcul the mask position with numpy : 0.0054836273193359375 nb_pixel_total : 217419 time to create 1 rle with new method : 0.0159456729888916 length of segment : 506 time for calcul the mask position with numpy : 0.012144088745117188 nb_pixel_total : 566661 time to create 1 rle with new method : 0.039844512939453125 length of segment : 902 time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 10370 time to create 1 rle with old method : 0.01205897331237793 length of segment : 285 time for calcul the mask position with numpy : 0.00758671760559082 nb_pixel_total : 396795 time to create 1 rle with new method : 0.01843547821044922 length of segment : 570 time for calcul the mask position with numpy : 0.002937793731689453 nb_pixel_total : 128963 time to create 1 rle with old method : 0.17061543464660645 length of segment : 474 time for calcul the mask position with numpy : 0.0002396106719970703 nb_pixel_total : 8107 time to create 1 rle with old method : 0.009493589401245117 length of segment : 130 time for calcul the mask position with numpy : 0.0022552013397216797 nb_pixel_total : 117589 time to create 1 rle with old method : 0.13142776489257812 length of segment : 380 time for calcul the mask position with numpy : 0.015587091445922852 nb_pixel_total : 501118 time to create 1 rle with new method : 0.710338830947876 length of segment : 809 time for calcul the mask position with numpy : 0.0039637088775634766 nb_pixel_total : 291521 time to create 1 rle with new method : 0.009195327758789062 length of segment : 540 time for calcul the mask position with numpy : 0.0010170936584472656 nb_pixel_total : 60185 time to create 1 rle with old method : 0.06867647171020508 length of segment : 293 time for calcul the mask position with numpy : 0.017584800720214844 nb_pixel_total : 415488 time to create 1 rle with new method : 0.554079532623291 length of segment : 610 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 8808 time to create 1 rle with old method : 0.014807939529418945 length of segment : 141 time for calcul the mask position with numpy : 0.0029964447021484375 nb_pixel_total : 59681 time to create 1 rle with old method : 0.06806516647338867 length of segment : 467 time for calcul the mask position with numpy : 0.002800464630126953 nb_pixel_total : 150131 time to create 1 rle with new method : 0.0069158077239990234 length of segment : 329 time for calcul the mask position with numpy : 0.0046575069427490234 nb_pixel_total : 202853 time to create 1 rle with new method : 0.01209568977355957 length of segment : 474 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 15157 time to create 1 rle with old method : 0.01749730110168457 length of segment : 139 time for calcul the mask position with numpy : 0.0002818107604980469 nb_pixel_total : 13449 time to create 1 rle with old method : 0.015794754028320312 length of segment : 90 time for calcul the mask position with numpy : 0.0005853176116943359 nb_pixel_total : 25197 time to create 1 rle with old method : 0.029165983200073242 length of segment : 154 time for calcul the mask position with numpy : 0.003091096878051758 nb_pixel_total : 135975 time to create 1 rle with old method : 0.15314817428588867 length of segment : 532 time for calcul the mask position with numpy : 0.0010523796081542969 nb_pixel_total : 52153 time to create 1 rle with old method : 0.06005048751831055 length of segment : 212 time for calcul the mask position with numpy : 0.013190984725952148 nb_pixel_total : 566832 time to create 1 rle with new method : 0.06721019744873047 length of segment : 830 time for calcul the mask position with numpy : 0.001958608627319336 nb_pixel_total : 104700 time to create 1 rle with old method : 0.11862611770629883 length of segment : 368 time for calcul the mask position with numpy : 0.0021102428436279297 nb_pixel_total : 82311 time to create 1 rle with old method : 0.09452223777770996 length of segment : 281 time for calcul the mask position with numpy : 0.0026929378509521484 nb_pixel_total : 109326 time to create 1 rle with old method : 0.1507124900817871 length of segment : 380 time for calcul the mask position with numpy : 0.009325265884399414 nb_pixel_total : 334129 time to create 1 rle with new method : 0.030606508255004883 length of segment : 899 time for calcul the mask position with numpy : 0.0024683475494384766 nb_pixel_total : 109347 time to create 1 rle with old method : 0.12259697914123535 length of segment : 339 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 12748 time to create 1 rle with old method : 0.014914989471435547 length of segment : 152 time for calcul the mask position with numpy : 0.0016100406646728516 nb_pixel_total : 71202 time to create 1 rle with old method : 0.08070683479309082 length of segment : 458 time for calcul the mask position with numpy : 0.02007603645324707 nb_pixel_total : 816004 time to create 1 rle with new method : 0.7013552188873291 length of segment : 1009 time for calcul the mask position with numpy : 0.0007796287536621094 nb_pixel_total : 28212 time to create 1 rle with old method : 0.03290295600891113 length of segment : 219 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 25880 time to create 1 rle with old method : 0.030041217803955078 length of segment : 218 time for calcul the mask position with numpy : 0.0017154216766357422 nb_pixel_total : 68363 time to create 1 rle with old method : 0.0799868106842041 length of segment : 286 time for calcul the mask position with numpy : 0.007815837860107422 nb_pixel_total : 411593 time to create 1 rle with new method : 0.01857733726501465 length of segment : 552 time for calcul the mask position with numpy : 0.0006361007690429688 nb_pixel_total : 14942 time to create 1 rle with old method : 0.022824525833129883 length of segment : 116 time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 7724 time to create 1 rle with old method : 0.008993387222290039 length of segment : 122 time for calcul the mask position with numpy : 0.0010159015655517578 nb_pixel_total : 38768 time to create 1 rle with old method : 0.050069332122802734 length of segment : 227 time for calcul the mask position with numpy : 0.005886554718017578 nb_pixel_total : 269368 time to create 1 rle with new method : 0.018047094345092773 length of segment : 802 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 35084 time to create 1 rle with old method : 0.04124760627746582 length of segment : 153 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 43468 time to create 1 rle with old method : 0.04906797409057617 length of segment : 263 time for calcul the mask position with numpy : 0.0019290447235107422 nb_pixel_total : 101970 time to create 1 rle with old method : 0.11581659317016602 length of segment : 346 time for calcul the mask position with numpy : 0.0013186931610107422 nb_pixel_total : 63551 time to create 1 rle with old method : 0.07839441299438477 length of segment : 310 time for calcul the mask position with numpy : 0.0014369487762451172 nb_pixel_total : 50177 time to create 1 rle with old method : 0.05761837959289551 length of segment : 232 time for calcul the mask position with numpy : 0.0020389556884765625 nb_pixel_total : 107881 time to create 1 rle with old method : 0.12171721458435059 length of segment : 343 time for calcul the mask position with numpy : 0.005091190338134766 nb_pixel_total : 202107 time to create 1 rle with new method : 0.013464212417602539 length of segment : 415 time for calcul the mask position with numpy : 0.007360696792602539 nb_pixel_total : 543377 time to create 1 rle with new method : 0.016277790069580078 length of segment : 382 time for calcul the mask position with numpy : 0.0010836124420166016 nb_pixel_total : 53925 time to create 1 rle with old method : 0.06188511848449707 length of segment : 236 time for calcul the mask position with numpy : 0.0073392391204833984 nb_pixel_total : 343417 time to create 1 rle with new method : 0.028363943099975586 length of segment : 748 time for calcul the mask position with numpy : 0.0007154941558837891 nb_pixel_total : 37650 time to create 1 rle with old method : 0.04291987419128418 length of segment : 210 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 40440 time to create 1 rle with old method : 0.04455399513244629 length of segment : 334 time for calcul the mask position with numpy : 0.004855155944824219 nb_pixel_total : 216905 time to create 1 rle with new method : 0.014232158660888672 length of segment : 513 time for calcul the mask position with numpy : 0.0032143592834472656 nb_pixel_total : 185034 time to create 1 rle with new method : 0.009164094924926758 length of segment : 530 time for calcul the mask position with numpy : 0.0011968612670898438 nb_pixel_total : 59322 time to create 1 rle with old method : 0.06679034233093262 length of segment : 369 time for calcul the mask position with numpy : 0.0013172626495361328 nb_pixel_total : 66998 time to create 1 rle with old method : 0.07660651206970215 length of segment : 275 time for calcul the mask position with numpy : 0.003325223922729492 nb_pixel_total : 170782 time to create 1 rle with new method : 0.010497331619262695 length of segment : 425 time for calcul the mask position with numpy : 0.013741016387939453 nb_pixel_total : 694458 time to create 1 rle with new method : 0.15622353553771973 length of segment : 755 time for calcul the mask position with numpy : 0.001888275146484375 nb_pixel_total : 85792 time to create 1 rle with old method : 0.10024881362915039 length of segment : 364 time for calcul the mask position with numpy : 0.002738475799560547 nb_pixel_total : 171402 time to create 1 rle with new method : 0.007167339324951172 length of segment : 368 time for calcul the mask position with numpy : 0.0013599395751953125 nb_pixel_total : 65677 time to create 1 rle with old method : 0.07431316375732422 length of segment : 410 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 57942 time to create 1 rle with old method : 0.06621503829956055 length of segment : 232 time for calcul the mask position with numpy : 0.0026166439056396484 nb_pixel_total : 127344 time to create 1 rle with old method : 0.14236760139465332 length of segment : 363 time for calcul the mask position with numpy : 0.0006666183471679688 nb_pixel_total : 29306 time to create 1 rle with old method : 0.03394317626953125 length of segment : 207 time for calcul the mask position with numpy : 0.006142854690551758 nb_pixel_total : 317207 time to create 1 rle with new method : 0.016179561614990234 length of segment : 460 time for calcul the mask position with numpy : 0.0022346973419189453 nb_pixel_total : 103362 time to create 1 rle with old method : 0.11671757698059082 length of segment : 278 time for calcul the mask position with numpy : 0.0011491775512695312 nb_pixel_total : 58251 time to create 1 rle with old method : 0.06693339347839355 length of segment : 288 time for calcul the mask position with numpy : 0.003152132034301758 nb_pixel_total : 110114 time to create 1 rle with old method : 0.12300825119018555 length of segment : 508 time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 62840 time to create 1 rle with old method : 0.07096552848815918 length of segment : 342 time for calcul the mask position with numpy : 0.015798091888427734 nb_pixel_total : 801993 time to create 1 rle with new method : 0.05914044380187988 length of segment : 791 time for calcul the mask position with numpy : 0.0007374286651611328 nb_pixel_total : 39666 time to create 1 rle with old method : 0.04379677772521973 length of segment : 240 time for calcul the mask position with numpy : 0.0010759830474853516 nb_pixel_total : 59038 time to create 1 rle with old method : 0.06770920753479004 length of segment : 285 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 24987 time to create 1 rle with old method : 0.0284421443939209 length of segment : 259 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 39874 time to create 1 rle with old method : 0.04626774787902832 length of segment : 200 time for calcul the mask position with numpy : 0.0037844181060791016 nb_pixel_total : 186102 time to create 1 rle with new method : 0.009974241256713867 length of segment : 362 time for calcul the mask position with numpy : 0.0012488365173339844 nb_pixel_total : 71410 time to create 1 rle with old method : 0.08128786087036133 length of segment : 231 time for calcul the mask position with numpy : 0.0013899803161621094 nb_pixel_total : 82189 time to create 1 rle with old method : 0.09269475936889648 length of segment : 354 time for calcul the mask position with numpy : 0.001064300537109375 nb_pixel_total : 47589 time to create 1 rle with old method : 0.05501866340637207 length of segment : 213 time for calcul the mask position with numpy : 0.002487659454345703 nb_pixel_total : 115962 time to create 1 rle with old method : 0.1320037841796875 length of segment : 319 time for calcul the mask position with numpy : 0.0006306171417236328 nb_pixel_total : 8761 time to create 1 rle with old method : 0.015452384948730469 length of segment : 195 time for calcul the mask position with numpy : 0.008952856063842773 nb_pixel_total : 299929 time to create 1 rle with new method : 0.04724597930908203 length of segment : 827 time for calcul the mask position with numpy : 0.0018274784088134766 nb_pixel_total : 101972 time to create 1 rle with old method : 0.11607670783996582 length of segment : 316 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 4818 time to create 1 rle with old method : 0.005690097808837891 length of segment : 113 time for calcul the mask position with numpy : 0.0013036727905273438 nb_pixel_total : 67551 time to create 1 rle with old method : 0.07740473747253418 length of segment : 252 time for calcul the mask position with numpy : 0.0009264945983886719 nb_pixel_total : 26176 time to create 1 rle with old method : 0.040308237075805664 length of segment : 202 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 16697 time to create 1 rle with old method : 0.01923847198486328 length of segment : 115 time for calcul the mask position with numpy : 0.003322124481201172 nb_pixel_total : 185512 time to create 1 rle with new method : 0.009004354476928711 length of segment : 546 time for calcul the mask position with numpy : 0.001634359359741211 nb_pixel_total : 72557 time to create 1 rle with old method : 0.08015966415405273 length of segment : 419 time for calcul the mask position with numpy : 0.0023641586303710938 nb_pixel_total : 145271 time to create 1 rle with old method : 0.16129088401794434 length of segment : 458 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 19321 time to create 1 rle with old method : 0.022324323654174805 length of segment : 176 time for calcul the mask position with numpy : 0.003154277801513672 nb_pixel_total : 125748 time to create 1 rle with old method : 0.14174365997314453 length of segment : 532 time for calcul the mask position with numpy : 0.0010516643524169922 nb_pixel_total : 51946 time to create 1 rle with old method : 0.058701276779174805 length of segment : 198 time for calcul the mask position with numpy : 0.0018355846405029297 nb_pixel_total : 73055 time to create 1 rle with old method : 0.08255887031555176 length of segment : 408 time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 16743 time to create 1 rle with old method : 0.019022464752197266 length of segment : 397 time for calcul the mask position with numpy : 0.003941535949707031 nb_pixel_total : 124685 time to create 1 rle with old method : 0.14162516593933105 length of segment : 1027 time for calcul the mask position with numpy : 0.0008389949798583984 nb_pixel_total : 42209 time to create 1 rle with old method : 0.0468134880065918 length of segment : 279 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 47597 time to create 1 rle with old method : 0.05512857437133789 length of segment : 188 time for calcul the mask position with numpy : 0.0019788742065429688 nb_pixel_total : 98747 time to create 1 rle with old method : 0.11064672470092773 length of segment : 359 time for calcul the mask position with numpy : 0.0005478858947753906 nb_pixel_total : 6219 time to create 1 rle with old method : 0.007909774780273438 length of segment : 173 time for calcul the mask position with numpy : 0.013687849044799805 nb_pixel_total : 668908 time to create 1 rle with new method : 0.08986330032348633 length of segment : 888 time for calcul the mask position with numpy : 0.0050809383392333984 nb_pixel_total : 266114 time to create 1 rle with new method : 0.02382349967956543 length of segment : 584 time for calcul the mask position with numpy : 0.0005948543548583984 nb_pixel_total : 36954 time to create 1 rle with old method : 0.04082441329956055 length of segment : 256 time for calcul the mask position with numpy : 0.0021855831146240234 nb_pixel_total : 153077 time to create 1 rle with new method : 0.006052255630493164 length of segment : 578 time for calcul the mask position with numpy : 0.0036580562591552734 nb_pixel_total : 191106 time to create 1 rle with new method : 0.012079477310180664 length of segment : 480 time for calcul the mask position with numpy : 0.0015494823455810547 nb_pixel_total : 73495 time to create 1 rle with old method : 0.0830230712890625 length of segment : 282 time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 45192 time to create 1 rle with old method : 0.05051374435424805 length of segment : 278 time for calcul the mask position with numpy : 0.0025429725646972656 nb_pixel_total : 140305 time to create 1 rle with old method : 0.15806865692138672 length of segment : 442 time for calcul the mask position with numpy : 0.0031218528747558594 nb_pixel_total : 150487 time to create 1 rle with new method : 0.008816957473754883 length of segment : 454 time for calcul the mask position with numpy : 0.003345012664794922 nb_pixel_total : 226267 time to create 1 rle with new method : 0.008304595947265625 length of segment : 305 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 33264 time to create 1 rle with old method : 0.03853607177734375 length of segment : 174 time for calcul the mask position with numpy : 0.0017848014831542969 nb_pixel_total : 101599 time to create 1 rle with old method : 0.11239957809448242 length of segment : 375 time for calcul the mask position with numpy : 0.0011513233184814453 nb_pixel_total : 54880 time to create 1 rle with old method : 0.0638117790222168 length of segment : 268 time for calcul the mask position with numpy : 0.001680612564086914 nb_pixel_total : 110887 time to create 1 rle with old method : 0.12061953544616699 length of segment : 363 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 31882 time to create 1 rle with old method : 0.03572869300842285 length of segment : 192 time for calcul the mask position with numpy : 0.0008487701416015625 nb_pixel_total : 48339 time to create 1 rle with old method : 0.05521512031555176 length of segment : 307 time for calcul the mask position with numpy : 0.000446319580078125 nb_pixel_total : 24745 time to create 1 rle with old method : 0.028404712677001953 length of segment : 146 time for calcul the mask position with numpy : 0.003066539764404297 nb_pixel_total : 192358 time to create 1 rle with new method : 0.007935523986816406 length of segment : 409 time for calcul the mask position with numpy : 0.0041961669921875 nb_pixel_total : 219062 time to create 1 rle with new method : 0.010655641555786133 length of segment : 511 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 28933 time to create 1 rle with old method : 0.03876066207885742 length of segment : 260 time for calcul the mask position with numpy : 0.024655818939208984 nb_pixel_total : 376801 time to create 1 rle with new method : 0.3663051128387451 length of segment : 1533 time for calcul the mask position with numpy : 0.008134603500366211 nb_pixel_total : 504256 time to create 1 rle with new method : 0.017709732055664062 length of segment : 615 time for calcul the mask position with numpy : 0.0029180049896240234 nb_pixel_total : 139105 time to create 1 rle with old method : 0.1633899211883545 length of segment : 392 time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 9470 time to create 1 rle with old method : 0.015781879425048828 length of segment : 131 time for calcul the mask position with numpy : 0.0009961128234863281 nb_pixel_total : 38832 time to create 1 rle with old method : 0.0507199764251709 length of segment : 330 time for calcul the mask position with numpy : 0.0016193389892578125 nb_pixel_total : 82982 time to create 1 rle with old method : 0.09380459785461426 length of segment : 374 time for calcul the mask position with numpy : 0.0005731582641601562 nb_pixel_total : 32840 time to create 1 rle with old method : 0.038069725036621094 length of segment : 215 time for calcul the mask position with numpy : 0.02372002601623535 nb_pixel_total : 1332053 time to create 1 rle with new method : 0.13302016258239746 length of segment : 1660 time for calcul the mask position with numpy : 0.006694793701171875 nb_pixel_total : 493161 time to create 1 rle with new method : 0.015723466873168945 length of segment : 617 time for calcul the mask position with numpy : 0.0015249252319335938 nb_pixel_total : 84376 time to create 1 rle with old method : 0.0940401554107666 length of segment : 369 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 46111 time to create 1 rle with old method : 0.050894975662231445 length of segment : 318 time for calcul the mask position with numpy : 0.0025217533111572266 nb_pixel_total : 89987 time to create 1 rle with old method : 0.09880399703979492 length of segment : 461 time for calcul the mask position with numpy : 0.0010254383087158203 nb_pixel_total : 56666 time to create 1 rle with old method : 0.06344771385192871 length of segment : 247 time for calcul the mask position with numpy : 0.0007898807525634766 nb_pixel_total : 39916 time to create 1 rle with old method : 0.04597067832946777 length of segment : 375 time for calcul the mask position with numpy : 0.005999088287353516 nb_pixel_total : 228186 time to create 1 rle with new method : 0.017878055572509766 length of segment : 803 time for calcul the mask position with numpy : 0.0019161701202392578 nb_pixel_total : 123153 time to create 1 rle with old method : 0.13471293449401855 length of segment : 477 time for calcul the mask position with numpy : 0.5236520767211914 nb_pixel_total : 7179205 time to create 1 rle with new method : 1.1726248264312744 length of segment : 3797 time for calcul the mask position with numpy : 0.011117935180664062 nb_pixel_total : 917065 time to create 1 rle with new method : 0.047005414962768555 length of segment : 793 time for calcul the mask position with numpy : 0.0015532970428466797 nb_pixel_total : 96397 time to create 1 rle with old method : 0.1076505184173584 length of segment : 671 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 7165 time to create 1 rle with old method : 0.00847768783569336 length of segment : 89 time for calcul the mask position with numpy : 0.0012502670288085938 nb_pixel_total : 113248 time to create 1 rle with old method : 0.12381315231323242 length of segment : 383 time for calcul the mask position with numpy : 0.004003047943115234 nb_pixel_total : 360827 time to create 1 rle with new method : 0.008446931838989258 length of segment : 465 time for calcul the mask position with numpy : 0.001308441162109375 nb_pixel_total : 100027 time to create 1 rle with old method : 0.11245036125183105 length of segment : 379 time spent for convertir_results : 42.08733248710632 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 385 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 119.09857368469238 time spend to save output : 0.18863892555236816 total time spend for step 2 : 119.28721261024475 step3:blur_detection Mon May 12 20:44:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (3120, 4160) 3770.4256844931706 (3120, 4160) 3524.6544553090457 (3120, 4160) 3302.9432031563097 (3120, 4160) 5268.757815833344 (3120, 4160) 998.3043450320747 (3120, 4160) 427.09759103342196 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.013501882553100586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.012380361557006836 save missing photos in datou_result : time spend for datou_step_exec : 3.9912362098693848 time spend to save output : 0.03026556968688965 total time spend for step 3 : 4.021501779556274 step4:brightness Mon May 12 20:44:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747075289_3832904_1357676358_e3ec3b0623fed15983e19557799f2113.jpg treat image : temp/1747075289_3832904_1357676347_bbe88840ed3defbb208a1a7145890287.jpg treat image : temp/1747075289_3832904_1357676341_0b95271b1be47a5ca86285dd778cf0c4.jpg treat image : temp/1747075289_3832904_1357676331_5842f997e9a6bbfe54ad1dfd737235f3.jpg treat image : temp/1747075289_3832904_1357676324_1c475f0f7c96220fee6c77fba5b8abf3.jpg treat image : temp/1747075289_3832904_1357676318_904eddcaa6e9550caf1ee48f3c18c5af.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 6 time used for this insertion : 0.013819694519042969 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 6 time used for this insertion : 0.012600421905517578 save missing photos in datou_result : time spend for datou_step_exec : 9.729343175888062 time spend to save output : 0.0316314697265625 total time spend for step 4 : 9.760974645614624 step5:rle_unique_nms_with_priority Mon May 12 20:45:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 385 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 70 nb_hashtags : 8 time to prepare the origin masks : 51.88385820388794 time for calcul the mask position with numpy : 1.6790449619293213 nb_pixel_total : 6679767 time to create 1 rle with new method : 1.7677767276763916 time for calcul the mask position with numpy : 0.05447745323181152 nb_pixel_total : 83432 time to create 1 rle with old method : 0.09169960021972656 time for calcul the mask position with numpy : 0.05248427391052246 nb_pixel_total : 14291 time to create 1 rle with old method : 0.01566600799560547 time for calcul the mask position with numpy : 0.05636239051818848 nb_pixel_total : 63680 time to create 1 rle with old method : 0.07543706893920898 time for calcul the mask position with numpy : 0.1857137680053711 nb_pixel_total : 1644289 time to create 1 rle with new method : 1.5061323642730713 time for calcul the mask position with numpy : 0.051419973373413086 nb_pixel_total : 18798 time to create 1 rle with old method : 0.020792722702026367 time for calcul the mask position with numpy : 0.052503108978271484 nb_pixel_total : 255178 time to create 1 rle with new method : 1.4889092445373535 time for calcul the mask position with numpy : 0.07005572319030762 nb_pixel_total : 327 time to create 1 rle with old method : 0.0007205009460449219 time for calcul the mask position with numpy : 0.06276202201843262 nb_pixel_total : 4669 time to create 1 rle with old method : 0.005384206771850586 time for calcul the mask position with numpy : 0.057489633560180664 nb_pixel_total : 2037 time to create 1 rle with old method : 0.0024023056030273438 time for calcul the mask position with numpy : 0.05359649658203125 nb_pixel_total : 10634 time to create 1 rle with old method : 0.012017488479614258 time for calcul the mask position with numpy : 0.05328726768493652 nb_pixel_total : 32824 time to create 1 rle with old method : 0.03665423393249512 time for calcul the mask position with numpy : 0.05383777618408203 nb_pixel_total : 259 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.05301809310913086 nb_pixel_total : 15517 time to create 1 rle with old method : 0.020145893096923828 time for calcul the mask position with numpy : 0.0519404411315918 nb_pixel_total : 11632 time to create 1 rle with old method : 0.013178110122680664 time for calcul the mask position with numpy : 0.054834842681884766 nb_pixel_total : 253362 time to create 1 rle with new method : 1.519261360168457 time for calcul the mask position with numpy : 0.052674055099487305 nb_pixel_total : 928 time to create 1 rle with old method : 0.0012323856353759766 time for calcul the mask position with numpy : 0.053087472915649414 nb_pixel_total : 18006 time to create 1 rle with old method : 0.02008676528930664 time for calcul the mask position with numpy : 0.05715370178222656 nb_pixel_total : 870 time to create 1 rle with old method : 0.0012123584747314453 time for calcul the mask position with numpy : 0.05560016632080078 nb_pixel_total : 12674 time to create 1 rle with old method : 0.01439046859741211 time for calcul the mask position with numpy : 0.05355262756347656 nb_pixel_total : 19952 time to create 1 rle with old method : 0.022309541702270508 time for calcul the mask position with numpy : 0.05314779281616211 nb_pixel_total : 21857 time to create 1 rle with old method : 0.02432537078857422 time for calcul the mask position with numpy : 0.062309980392456055 nb_pixel_total : 15724 time to create 1 rle with old method : 0.01802682876586914 time for calcul the mask position with numpy : 0.0533909797668457 nb_pixel_total : 18467 time to create 1 rle with old method : 0.020715713500976562 time for calcul the mask position with numpy : 0.05579996109008789 nb_pixel_total : 319774 time to create 1 rle with new method : 1.6796371936798096 time for calcul the mask position with numpy : 0.059931278228759766 nb_pixel_total : 14880 time to create 1 rle with old method : 0.025262832641601562 time for calcul the mask position with numpy : 0.06301522254943848 nb_pixel_total : 3625 time to create 1 rle with old method : 0.0049591064453125 time for calcul the mask position with numpy : 0.055058956146240234 nb_pixel_total : 49049 time to create 1 rle with old method : 0.05440878868103027 time for calcul the mask position with numpy : 0.05527186393737793 nb_pixel_total : 163067 time to create 1 rle with new method : 1.626002550125122 time for calcul the mask position with numpy : 0.054144859313964844 nb_pixel_total : 72096 time to create 1 rle with old method : 0.08176136016845703 time for calcul the mask position with numpy : 0.05378127098083496 nb_pixel_total : 48057 time to create 1 rle with old method : 0.054184675216674805 time for calcul the mask position with numpy : 0.053757429122924805 nb_pixel_total : 45904 time to create 1 rle with old method : 0.05170941352844238 time for calcul the mask position with numpy : 0.05316877365112305 nb_pixel_total : 15662 time to create 1 rle with old method : 0.017563343048095703 time for calcul the mask position with numpy : 0.05279874801635742 nb_pixel_total : 41596 time to create 1 rle with old method : 0.046372175216674805 time for calcul the mask position with numpy : 0.0535283088684082 nb_pixel_total : 59458 time to create 1 rle with old method : 0.0678858757019043 time for calcul the mask position with numpy : 0.053492069244384766 nb_pixel_total : 32788 time to create 1 rle with old method : 0.036427974700927734 time for calcul the mask position with numpy : 0.05311846733093262 nb_pixel_total : 1808 time to create 1 rle with old method : 0.0022988319396972656 time for calcul the mask position with numpy : 0.05395197868347168 nb_pixel_total : 189008 time to create 1 rle with new method : 1.6447758674621582 time for calcul the mask position with numpy : 0.05780982971191406 nb_pixel_total : 142457 time to create 1 rle with old method : 0.15874910354614258 time for calcul the mask position with numpy : 0.05361199378967285 nb_pixel_total : 109 time to create 1 rle with old method : 0.00017952919006347656 time for calcul the mask position with numpy : 0.053879499435424805 nb_pixel_total : 39767 time to create 1 rle with old method : 0.04397940635681152 time for calcul the mask position with numpy : 0.05323672294616699 nb_pixel_total : 17867 time to create 1 rle with old method : 0.02347421646118164 time for calcul the mask position with numpy : 0.05863833427429199 nb_pixel_total : 15738 time to create 1 rle with old method : 0.019073963165283203 time for calcul the mask position with numpy : 0.07137513160705566 nb_pixel_total : 99692 time to create 1 rle with old method : 0.14300227165222168 time for calcul the mask position with numpy : 0.06206083297729492 nb_pixel_total : 488817 time to create 1 rle with new method : 1.678051233291626 time for calcul the mask position with numpy : 0.051056623458862305 nb_pixel_total : 80125 time to create 1 rle with old method : 0.0923149585723877 time for calcul the mask position with numpy : 0.054596662521362305 nb_pixel_total : 64997 time to create 1 rle with old method : 0.07327556610107422 time for calcul the mask position with numpy : 0.05249333381652832 nb_pixel_total : 87047 time to create 1 rle with old method : 0.09482479095458984 time for calcul the mask position with numpy : 0.053043365478515625 nb_pixel_total : 111282 time to create 1 rle with old method : 0.12064838409423828 time for calcul the mask position with numpy : 0.05877995491027832 nb_pixel_total : 6603 time to create 1 rle with old method : 0.012233257293701172 time for calcul the mask position with numpy : 0.06566405296325684 nb_pixel_total : 321102 time to create 1 rle with new method : 1.1366231441497803 time for calcul the mask position with numpy : 0.05359172821044922 nb_pixel_total : 27887 time to create 1 rle with old method : 0.0337216854095459 time for calcul the mask position with numpy : 0.05463767051696777 nb_pixel_total : 47473 time to create 1 rle with old method : 0.05275607109069824 time for calcul the mask position with numpy : 0.05373954772949219 nb_pixel_total : 55328 time to create 1 rle with old method : 0.06393218040466309 time for calcul the mask position with numpy : 0.05703258514404297 nb_pixel_total : 40374 time to create 1 rle with old method : 0.04559016227722168 time for calcul the mask position with numpy : 0.05482220649719238 nb_pixel_total : 84957 time to create 1 rle with old method : 0.09644174575805664 time for calcul the mask position with numpy : 0.05483269691467285 nb_pixel_total : 10742 time to create 1 rle with old method : 0.01612401008605957 time for calcul the mask position with numpy : 0.06163287162780762 nb_pixel_total : 3467 time to create 1 rle with old method : 0.0056896209716796875 time for calcul the mask position with numpy : 0.06270027160644531 nb_pixel_total : 3360 time to create 1 rle with old method : 0.008569717407226562 time for calcul the mask position with numpy : 0.060388803482055664 nb_pixel_total : 168428 time to create 1 rle with new method : 1.1822340488433838 time for calcul the mask position with numpy : 0.05564546585083008 nb_pixel_total : 33860 time to create 1 rle with old method : 0.051642656326293945 time for calcul the mask position with numpy : 0.05466580390930176 nb_pixel_total : 11029 time to create 1 rle with old method : 0.013660430908203125 time for calcul the mask position with numpy : 0.05490732192993164 nb_pixel_total : 21737 time to create 1 rle with old method : 0.02452564239501953 time for calcul the mask position with numpy : 0.05509066581726074 nb_pixel_total : 319265 time to create 1 rle with new method : 1.1787474155426025 time for calcul the mask position with numpy : 0.05477309226989746 nb_pixel_total : 190565 time to create 1 rle with new method : 1.249694585800171 time for calcul the mask position with numpy : 0.05283832550048828 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.05435299873352051 nb_pixel_total : 105829 time to create 1 rle with old method : 0.1235957145690918 time for calcul the mask position with numpy : 0.0528101921081543 nb_pixel_total : 90234 time to create 1 rle with old method : 0.1239628791809082 time for calcul the mask position with numpy : 0.05112791061401367 nb_pixel_total : 11780 time to create 1 rle with old method : 0.013322830200195312 time for calcul the mask position with numpy : 0.052764892578125 nb_pixel_total : 17425 time to create 1 rle with old method : 0.019906997680664062 time for calcul the mask position with numpy : 0.05216860771179199 nb_pixel_total : 2779 time to create 1 rle with old method : 0.003236055374145508 create new chi : 26.262019157409668 time to delete rle : 0.03844571113586426 batch 1 Loaded 71 chid ids of type : 4855 Number RLEs to save : 37881 TO DO : save crop sub photo not yet done ! save time : 2.111924409866333 nb_obj : 95 nb_hashtags : 9 time to prepare the origin masks : 73.7138147354126 time for calcul the mask position with numpy : 0.2695953845977783 nb_pixel_total : 4694447 time to create 1 rle with new method : 1.6334693431854248 time for calcul the mask position with numpy : 0.0577397346496582 nb_pixel_total : 35606 time to create 1 rle with old method : 0.05284762382507324 time for calcul the mask position with numpy : 0.05475950241088867 nb_pixel_total : 20088 time to create 1 rle with old method : 0.023664236068725586 time for calcul the mask position with numpy : 0.05595827102661133 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003025531768798828 time for calcul the mask position with numpy : 0.0538632869720459 nb_pixel_total : 7486 time to create 1 rle with old method : 0.008476495742797852 time for calcul the mask position with numpy : 0.05257678031921387 nb_pixel_total : 4053 time to create 1 rle with old method : 0.004655361175537109 time for calcul the mask position with numpy : 0.05281949043273926 nb_pixel_total : 35370 time to create 1 rle with old method : 0.039740800857543945 time for calcul the mask position with numpy : 0.15547609329223633 nb_pixel_total : 566133 time to create 1 rle with new method : 1.2061803340911865 time for calcul the mask position with numpy : 0.055495262145996094 nb_pixel_total : 351756 time to create 1 rle with new method : 0.955319881439209 time for calcul the mask position with numpy : 0.05478334426879883 nb_pixel_total : 5145 time to create 1 rle with old method : 0.006345510482788086 time for calcul the mask position with numpy : 0.056427001953125 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003490447998046875 time for calcul the mask position with numpy : 0.06075310707092285 nb_pixel_total : 4533 time to create 1 rle with old method : 0.005515575408935547 time for calcul the mask position with numpy : 0.06176257133483887 nb_pixel_total : 492946 time to create 1 rle with new method : 1.0401830673217773 time for calcul the mask position with numpy : 0.05364227294921875 nb_pixel_total : 4000 time to create 1 rle with old method : 0.004915952682495117 time for calcul the mask position with numpy : 0.05636096000671387 nb_pixel_total : 502678 time to create 1 rle with new method : 1.4373855590820312 time for calcul the mask position with numpy : 0.05367302894592285 nb_pixel_total : 170128 time to create 1 rle with new method : 1.1077682971954346 time for calcul the mask position with numpy : 0.0604400634765625 nb_pixel_total : 37447 time to create 1 rle with old method : 0.04480457305908203 time for calcul the mask position with numpy : 0.054056406021118164 nb_pixel_total : 28135 time to create 1 rle with old method : 0.03242325782775879 time for calcul the mask position with numpy : 0.05558276176452637 nb_pixel_total : 30750 time to create 1 rle with old method : 0.03301596641540527 time for calcul the mask position with numpy : 0.05297994613647461 nb_pixel_total : 85716 time to create 1 rle with old method : 0.09459948539733887 time for calcul the mask position with numpy : 0.05264449119567871 nb_pixel_total : 774 time to create 1 rle with old method : 0.27728748321533203 time for calcul the mask position with numpy : 0.05313992500305176 nb_pixel_total : 27613 time to create 1 rle with old method : 0.03102564811706543 time for calcul the mask position with numpy : 0.052259206771850586 nb_pixel_total : 4962 time to create 1 rle with old method : 0.00541377067565918 time for calcul the mask position with numpy : 0.05321621894836426 nb_pixel_total : 129363 time to create 1 rle with old method : 0.15829896926879883 time for calcul the mask position with numpy : 0.07293462753295898 nb_pixel_total : 43170 time to create 1 rle with old method : 0.0502171516418457 time for calcul the mask position with numpy : 0.06165456771850586 nb_pixel_total : 410666 time to create 1 rle with new method : 1.3328542709350586 time for calcul the mask position with numpy : 0.05300593376159668 nb_pixel_total : 87893 time to create 1 rle with old method : 0.09726428985595703 time for calcul the mask position with numpy : 0.05477762222290039 nb_pixel_total : 4799 time to create 1 rle with old method : 0.005551338195800781 time for calcul the mask position with numpy : 0.053276777267456055 nb_pixel_total : 42058 time to create 1 rle with old method : 0.046172142028808594 time for calcul the mask position with numpy : 0.0525968074798584 nb_pixel_total : 25991 time to create 1 rle with old method : 0.028863906860351562 time for calcul the mask position with numpy : 0.053305625915527344 nb_pixel_total : 7167 time to create 1 rle with old method : 0.008491277694702148 time for calcul the mask position with numpy : 0.0559382438659668 nb_pixel_total : 10449 time to create 1 rle with old method : 0.012436389923095703 time for calcul the mask position with numpy : 0.053244829177856445 nb_pixel_total : 43033 time to create 1 rle with old method : 0.04799771308898926 time for calcul the mask position with numpy : 0.05303549766540527 nb_pixel_total : 40 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.05374598503112793 nb_pixel_total : 22987 time to create 1 rle with old method : 0.026067495346069336 time for calcul the mask position with numpy : 0.05284738540649414 nb_pixel_total : 5678 time to create 1 rle with old method : 0.006438255310058594 time for calcul the mask position with numpy : 0.05361461639404297 nb_pixel_total : 234231 time to create 1 rle with new method : 1.2461357116699219 time for calcul the mask position with numpy : 0.05222511291503906 nb_pixel_total : 13346 time to create 1 rle with old method : 0.01490330696105957 time for calcul the mask position with numpy : 0.05211329460144043 nb_pixel_total : 681 time to create 1 rle with old method : 0.0008821487426757812 time for calcul the mask position with numpy : 0.051596879959106445 nb_pixel_total : 21846 time to create 1 rle with old method : 0.024065732955932617 time for calcul the mask position with numpy : 0.05077075958251953 nb_pixel_total : 77849 time to create 1 rle with old method : 0.11154675483703613 time for calcul the mask position with numpy : 0.0537104606628418 nb_pixel_total : 285265 time to create 1 rle with new method : 1.2331933975219727 time for calcul the mask position with numpy : 0.05400872230529785 nb_pixel_total : 14260 time to create 1 rle with old method : 0.016144275665283203 time for calcul the mask position with numpy : 0.05457925796508789 nb_pixel_total : 23580 time to create 1 rle with old method : 0.02585434913635254 time for calcul the mask position with numpy : 0.05201244354248047 nb_pixel_total : 14079 time to create 1 rle with old method : 0.015599727630615234 time for calcul the mask position with numpy : 0.05222797393798828 nb_pixel_total : 703 time to create 1 rle with old method : 0.001069784164428711 time for calcul the mask position with numpy : 0.051459550857543945 nb_pixel_total : 41512 time to create 1 rle with old method : 0.0452117919921875 time for calcul the mask position with numpy : 0.05221366882324219 nb_pixel_total : 24050 time to create 1 rle with old method : 0.026184797286987305 time for calcul the mask position with numpy : 0.051337242126464844 nb_pixel_total : 22066 time to create 1 rle with old method : 0.024710416793823242 time for calcul the mask position with numpy : 0.051905155181884766 nb_pixel_total : 177860 time to create 1 rle with new method : 1.1622986793518066 time for calcul the mask position with numpy : 0.05386090278625488 nb_pixel_total : 64819 time to create 1 rle with old method : 0.07283568382263184 time for calcul the mask position with numpy : 0.052736759185791016 nb_pixel_total : 100372 time to create 1 rle with old method : 0.11013269424438477 time for calcul the mask position with numpy : 0.0523686408996582 nb_pixel_total : 43351 time to create 1 rle with old method : 0.053304195404052734 time for calcul the mask position with numpy : 0.053522348403930664 nb_pixel_total : 204132 time to create 1 rle with new method : 0.9597728252410889 time for calcul the mask position with numpy : 0.056366682052612305 nb_pixel_total : 494494 time to create 1 rle with new method : 1.2604022026062012 time for calcul the mask position with numpy : 0.051334381103515625 nb_pixel_total : 34498 time to create 1 rle with old method : 0.03728175163269043 time for calcul the mask position with numpy : 0.05155324935913086 nb_pixel_total : 2928 time to create 1 rle with old method : 0.003705263137817383 time for calcul the mask position with numpy : 0.052045345306396484 nb_pixel_total : 19389 time to create 1 rle with old method : 0.02187657356262207 time for calcul the mask position with numpy : 0.05244803428649902 nb_pixel_total : 4935 time to create 1 rle with old method : 0.0058498382568359375 time for calcul the mask position with numpy : 0.05311703681945801 nb_pixel_total : 40441 time to create 1 rle with old method : 0.04462265968322754 time for calcul the mask position with numpy : 0.05180931091308594 nb_pixel_total : 24138 time to create 1 rle with old method : 0.028030872344970703 time for calcul the mask position with numpy : 0.05331850051879883 nb_pixel_total : 17728 time to create 1 rle with old method : 0.019895553588867188 time for calcul the mask position with numpy : 0.05775928497314453 nb_pixel_total : 716036 time to create 1 rle with new method : 1.104680061340332 time for calcul the mask position with numpy : 0.05320096015930176 nb_pixel_total : 68472 time to create 1 rle with old method : 0.07692885398864746 time for calcul the mask position with numpy : 0.053299665451049805 nb_pixel_total : 5500 time to create 1 rle with old method : 0.006578922271728516 time for calcul the mask position with numpy : 0.05264401435852051 nb_pixel_total : 78326 time to create 1 rle with old method : 0.0850522518157959 time for calcul the mask position with numpy : 0.051091909408569336 nb_pixel_total : 22781 time to create 1 rle with old method : 0.024884939193725586 time for calcul the mask position with numpy : 0.05165863037109375 nb_pixel_total : 4157 time to create 1 rle with old method : 0.00450444221496582 time for calcul the mask position with numpy : 0.051038503646850586 nb_pixel_total : 25738 time to create 1 rle with old method : 0.027196884155273438 time for calcul the mask position with numpy : 0.05660247802734375 nb_pixel_total : 880210 time to create 1 rle with new method : 1.014284610748291 time for calcul the mask position with numpy : 0.05238056182861328 nb_pixel_total : 49823 time to create 1 rle with old method : 0.05410408973693848 time for calcul the mask position with numpy : 0.05331301689147949 nb_pixel_total : 53104 time to create 1 rle with old method : 0.06029200553894043 time for calcul the mask position with numpy : 0.055329322814941406 nb_pixel_total : 16491 time to create 1 rle with old method : 0.03191781044006348 time for calcul the mask position with numpy : 0.07334423065185547 nb_pixel_total : 18569 time to create 1 rle with old method : 0.03241109848022461 time for calcul the mask position with numpy : 0.06983041763305664 nb_pixel_total : 11875 time to create 1 rle with old method : 0.0222165584564209 time for calcul the mask position with numpy : 0.057791948318481445 nb_pixel_total : 135997 time to create 1 rle with old method : 0.15334630012512207 time for calcul the mask position with numpy : 0.052939653396606445 nb_pixel_total : 97987 time to create 1 rle with old method : 0.10689234733581543 time for calcul the mask position with numpy : 0.054407358169555664 nb_pixel_total : 31224 time to create 1 rle with old method : 0.03477978706359863 time for calcul the mask position with numpy : 0.055681705474853516 nb_pixel_total : 863 time to create 1 rle with old method : 0.001340627670288086 time for calcul the mask position with numpy : 0.06541919708251953 nb_pixel_total : 84554 time to create 1 rle with old method : 0.10928034782409668 time for calcul the mask position with numpy : 0.05482292175292969 nb_pixel_total : 38187 time to create 1 rle with old method : 0.04403114318847656 time for calcul the mask position with numpy : 0.05237770080566406 nb_pixel_total : 113614 time to create 1 rle with old method : 0.12351059913635254 time for calcul the mask position with numpy : 0.052332401275634766 nb_pixel_total : 81 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.0527803897857666 nb_pixel_total : 78731 time to create 1 rle with old method : 0.08690571784973145 time for calcul the mask position with numpy : 0.05419325828552246 nb_pixel_total : 165036 time to create 1 rle with new method : 1.5672366619110107 time for calcul the mask position with numpy : 0.0532684326171875 nb_pixel_total : 2367 time to create 1 rle with old method : 0.003270387649536133 time for calcul the mask position with numpy : 0.05495905876159668 nb_pixel_total : 60877 time to create 1 rle with old method : 0.06797933578491211 time for calcul the mask position with numpy : 0.054290771484375 nb_pixel_total : 68313 time to create 1 rle with old method : 0.09678936004638672 time for calcul the mask position with numpy : 0.056514739990234375 nb_pixel_total : 35764 time to create 1 rle with old method : 0.04007458686828613 time for calcul the mask position with numpy : 0.05382370948791504 nb_pixel_total : 2157 time to create 1 rle with old method : 0.0026836395263671875 time for calcul the mask position with numpy : 0.05332183837890625 nb_pixel_total : 54419 time to create 1 rle with old method : 0.06128644943237305 time for calcul the mask position with numpy : 0.05359387397766113 nb_pixel_total : 25439 time to create 1 rle with old method : 0.028654813766479492 time for calcul the mask position with numpy : 0.05571413040161133 nb_pixel_total : 45467 time to create 1 rle with old method : 0.0508573055267334 time for calcul the mask position with numpy : 0.05319476127624512 nb_pixel_total : 9363 time to create 1 rle with old method : 0.010667085647583008 time for calcul the mask position with numpy : 0.05709719657897949 nb_pixel_total : 26118 time to create 1 rle with old method : 0.042031288146972656 time for calcul the mask position with numpy : 0.05832672119140625 nb_pixel_total : 5518 time to create 1 rle with old method : 0.006684780120849609 create new chi : 27.847656965255737 time to delete rle : 0.005914926528930664 batch 1 Loaded 96 chid ids of type : 4855 Number RLEs to save : 53880 TO DO : save crop sub photo not yet done ! save time : 3.3802764415740967 nb_obj : 68 nb_hashtags : 9 time to prepare the origin masks : 56.223872423172 time for calcul the mask position with numpy : 1.3513116836547852 nb_pixel_total : 5291270 time to create 1 rle with new method : 1.4070136547088623 time for calcul the mask position with numpy : 0.05210113525390625 nb_pixel_total : 80522 time to create 1 rle with old method : 0.08790946006774902 time for calcul the mask position with numpy : 0.05393815040588379 nb_pixel_total : 58245 time to create 1 rle with old method : 0.06431245803833008 time for calcul the mask position with numpy : 0.08574438095092773 nb_pixel_total : 1032667 time to create 1 rle with new method : 1.277008056640625 time for calcul the mask position with numpy : 0.052532196044921875 nb_pixel_total : 27899 time to create 1 rle with old method : 0.03217959403991699 time for calcul the mask position with numpy : 0.0607757568359375 nb_pixel_total : 1273 time to create 1 rle with old method : 0.0024704933166503906 time for calcul the mask position with numpy : 0.05735921859741211 nb_pixel_total : 19553 time to create 1 rle with old method : 0.022799968719482422 time for calcul the mask position with numpy : 0.1441330909729004 nb_pixel_total : 1417118 time to create 1 rle with new method : 1.4094970226287842 time for calcul the mask position with numpy : 0.0523371696472168 nb_pixel_total : 88070 time to create 1 rle with old method : 0.09291267395019531 time for calcul the mask position with numpy : 0.0511472225189209 nb_pixel_total : 32339 time to create 1 rle with old method : 0.03419852256774902 time for calcul the mask position with numpy : 0.051816701889038086 nb_pixel_total : 23409 time to create 1 rle with old method : 0.025022029876708984 time for calcul the mask position with numpy : 0.05139565467834473 nb_pixel_total : 25499 time to create 1 rle with old method : 0.028318405151367188 time for calcul the mask position with numpy : 0.054891347885131836 nb_pixel_total : 589763 time to create 1 rle with new method : 1.239396095275879 time for calcul the mask position with numpy : 0.05301332473754883 nb_pixel_total : 334952 time to create 1 rle with new method : 1.1690669059753418 time for calcul the mask position with numpy : 0.052298545837402344 nb_pixel_total : 58830 time to create 1 rle with old method : 0.062410831451416016 time for calcul the mask position with numpy : 0.05103898048400879 nb_pixel_total : 760 time to create 1 rle with old method : 0.0008924007415771484 time for calcul the mask position with numpy : 0.051154136657714844 nb_pixel_total : 13409 time to create 1 rle with old method : 0.014206886291503906 time for calcul the mask position with numpy : 0.04981398582458496 nb_pixel_total : 69304 time to create 1 rle with old method : 0.07242751121520996 time for calcul the mask position with numpy : 0.04957890510559082 nb_pixel_total : 19874 time to create 1 rle with old method : 0.020628690719604492 time for calcul the mask position with numpy : 0.04969477653503418 nb_pixel_total : 45709 time to create 1 rle with old method : 0.047263383865356445 time for calcul the mask position with numpy : 0.04972124099731445 nb_pixel_total : 44653 time to create 1 rle with old method : 0.046332359313964844 time for calcul the mask position with numpy : 0.04990124702453613 nb_pixel_total : 947 time to create 1 rle with old method : 0.0011854171752929688 time for calcul the mask position with numpy : 0.04942941665649414 nb_pixel_total : 25397 time to create 1 rle with old method : 0.02596592903137207 time for calcul the mask position with numpy : 0.04968595504760742 nb_pixel_total : 54400 time to create 1 rle with old method : 0.056516408920288086 time for calcul the mask position with numpy : 0.05011463165283203 nb_pixel_total : 149798 time to create 1 rle with old method : 0.15976786613464355 time for calcul the mask position with numpy : 0.05162525177001953 nb_pixel_total : 29003 time to create 1 rle with old method : 0.030710935592651367 time for calcul the mask position with numpy : 0.05039834976196289 nb_pixel_total : 3578 time to create 1 rle with old method : 0.004011392593383789 time for calcul the mask position with numpy : 0.049916982650756836 nb_pixel_total : 10477 time to create 1 rle with old method : 0.011517524719238281 time for calcul the mask position with numpy : 0.04976463317871094 nb_pixel_total : 135156 time to create 1 rle with old method : 0.14000487327575684 time for calcul the mask position with numpy : 0.05022263526916504 nb_pixel_total : 10605 time to create 1 rle with old method : 0.011977672576904297 time for calcul the mask position with numpy : 0.05128026008605957 nb_pixel_total : 41431 time to create 1 rle with old method : 0.042266845703125 time for calcul the mask position with numpy : 0.05097603797912598 nb_pixel_total : 217107 time to create 1 rle with new method : 1.2644236087799072 time for calcul the mask position with numpy : 0.05408000946044922 nb_pixel_total : 712 time to create 1 rle with old method : 0.0010118484497070312 time for calcul the mask position with numpy : 0.050344228744506836 nb_pixel_total : 38615 time to create 1 rle with old method : 0.04105949401855469 time for calcul the mask position with numpy : 0.05094408988952637 nb_pixel_total : 343 time to create 1 rle with old method : 0.0007581710815429688 time for calcul the mask position with numpy : 0.0516047477722168 nb_pixel_total : 16640 time to create 1 rle with old method : 0.01753830909729004 time for calcul the mask position with numpy : 0.05021977424621582 nb_pixel_total : 2570 time to create 1 rle with old method : 0.002907991409301758 time for calcul the mask position with numpy : 0.05370140075683594 nb_pixel_total : 202139 time to create 1 rle with new method : 1.1662046909332275 time for calcul the mask position with numpy : 0.049798011779785156 nb_pixel_total : 59904 time to create 1 rle with old method : 0.06203413009643555 time for calcul the mask position with numpy : 0.05228424072265625 nb_pixel_total : 565815 time to create 1 rle with new method : 1.2036991119384766 time for calcul the mask position with numpy : 0.05121254920959473 nb_pixel_total : 25125 time to create 1 rle with old method : 0.026823997497558594 time for calcul the mask position with numpy : 0.05401468276977539 nb_pixel_total : 566078 time to create 1 rle with new method : 1.0683166980743408 time for calcul the mask position with numpy : 0.05057930946350098 nb_pixel_total : 127579 time to create 1 rle with old method : 0.13323354721069336 time for calcul the mask position with numpy : 0.04953408241271973 nb_pixel_total : 27749 time to create 1 rle with old method : 0.028784751892089844 time for calcul the mask position with numpy : 0.051138877868652344 nb_pixel_total : 10332 time to create 1 rle with old method : 0.011329889297485352 time for calcul the mask position with numpy : 0.05079030990600586 nb_pixel_total : 54959 time to create 1 rle with old method : 0.0577394962310791 time for calcul the mask position with numpy : 0.04980969429016113 nb_pixel_total : 14806 time to create 1 rle with old method : 0.01534128189086914 time for calcul the mask position with numpy : 0.04948067665100098 nb_pixel_total : 1744 time to create 1 rle with old method : 0.0018682479858398438 time for calcul the mask position with numpy : 0.04902148246765137 nb_pixel_total : 8092 time to create 1 rle with old method : 0.008452415466308594 time for calcul the mask position with numpy : 0.04910874366760254 nb_pixel_total : 2874 time to create 1 rle with old method : 0.003170013427734375 time for calcul the mask position with numpy : 0.049653053283691406 nb_pixel_total : 829 time to create 1 rle with old method : 0.0009849071502685547 time for calcul the mask position with numpy : 0.049672603607177734 nb_pixel_total : 68809 time to create 1 rle with old method : 0.07184171676635742 time for calcul the mask position with numpy : 0.053481340408325195 nb_pixel_total : 153630 time to create 1 rle with new method : 1.0835041999816895 time for calcul the mask position with numpy : 0.05240750312805176 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.05309605598449707 nb_pixel_total : 13511 time to create 1 rle with old method : 0.01769113540649414 time for calcul the mask position with numpy : 0.05942583084106445 nb_pixel_total : 368346 time to create 1 rle with new method : 1.3135194778442383 time for calcul the mask position with numpy : 0.05451345443725586 nb_pixel_total : 107149 time to create 1 rle with old method : 0.15291881561279297 time for calcul the mask position with numpy : 0.05944371223449707 nb_pixel_total : 3729 time to create 1 rle with old method : 0.0042417049407958984 time for calcul the mask position with numpy : 0.05390524864196777 nb_pixel_total : 60029 time to create 1 rle with old method : 0.06660223007202148 time for calcul the mask position with numpy : 0.05474090576171875 nb_pixel_total : 12677 time to create 1 rle with old method : 0.0187225341796875 time for calcul the mask position with numpy : 0.055344343185424805 nb_pixel_total : 117216 time to create 1 rle with old method : 0.14519095420837402 time for calcul the mask position with numpy : 0.056699514389038086 nb_pixel_total : 2859 time to create 1 rle with old method : 0.003361225128173828 time for calcul the mask position with numpy : 0.05600738525390625 nb_pixel_total : 104147 time to create 1 rle with old method : 0.11580634117126465 time for calcul the mask position with numpy : 0.05388665199279785 nb_pixel_total : 76433 time to create 1 rle with old method : 0.08636617660522461 time for calcul the mask position with numpy : 0.060767173767089844 nb_pixel_total : 109129 time to create 1 rle with old method : 0.1227409839630127 time for calcul the mask position with numpy : 0.05405473709106445 nb_pixel_total : 41683 time to create 1 rle with old method : 0.04646873474121094 time for calcul the mask position with numpy : 0.06088995933532715 nb_pixel_total : 28189 time to create 1 rle with old method : 0.04124307632446289 time for calcul the mask position with numpy : 0.05370187759399414 nb_pixel_total : 30789 time to create 1 rle with old method : 0.03407168388366699 time for calcul the mask position with numpy : 0.05325508117675781 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008327960968017578 create new chi : 21.591309309005737 time to delete rle : 0.0035812854766845703 batch 1 Loaded 69 chid ids of type : 4855 Number RLEs to save : 41158 TO DO : save crop sub photo not yet done ! save time : 2.344290256500244 nb_obj : 80 nb_hashtags : 8 time to prepare the origin masks : 74.33807945251465 time for calcul the mask position with numpy : 0.8148350715637207 nb_pixel_total : 5979738 time to create 1 rle with new method : 2.123394727706909 time for calcul the mask position with numpy : 0.05547595024108887 nb_pixel_total : 170504 time to create 1 rle with new method : 1.6667449474334717 time for calcul the mask position with numpy : 0.08896088600158691 nb_pixel_total : 772264 time to create 1 rle with new method : 1.4436914920806885 time for calcul the mask position with numpy : 0.06372308731079102 nb_pixel_total : 541958 time to create 1 rle with new method : 0.9179961681365967 time for calcul the mask position with numpy : 0.05445218086242676 nb_pixel_total : 144018 time to create 1 rle with old method : 0.1871781349182129 time for calcul the mask position with numpy : 0.053543806076049805 nb_pixel_total : 6653 time to create 1 rle with old method : 0.0075304508209228516 time for calcul the mask position with numpy : 0.05610394477844238 nb_pixel_total : 342780 time to create 1 rle with new method : 0.6458039283752441 time for calcul the mask position with numpy : 0.05404067039489746 nb_pixel_total : 58908 time to create 1 rle with old method : 0.06596755981445312 time for calcul the mask position with numpy : 0.0571904182434082 nb_pixel_total : 25823 time to create 1 rle with old method : 0.029234886169433594 time for calcul the mask position with numpy : 0.06067848205566406 nb_pixel_total : 51728 time to create 1 rle with old method : 0.05798220634460449 time for calcul the mask position with numpy : 0.05426764488220215 nb_pixel_total : 47350 time to create 1 rle with old method : 0.052576541900634766 time for calcul the mask position with numpy : 0.05392575263977051 nb_pixel_total : 13986 time to create 1 rle with old method : 0.015706539154052734 time for calcul the mask position with numpy : 0.053620338439941406 nb_pixel_total : 14924 time to create 1 rle with old method : 0.016765594482421875 time for calcul the mask position with numpy : 0.05573129653930664 nb_pixel_total : 16542 time to create 1 rle with old method : 0.01872086524963379 time for calcul the mask position with numpy : 0.05450868606567383 nb_pixel_total : 200515 time to create 1 rle with new method : 2.0250871181488037 time for calcul the mask position with numpy : 0.0539395809173584 nb_pixel_total : 102810 time to create 1 rle with old method : 0.11461734771728516 time for calcul the mask position with numpy : 0.05325126647949219 nb_pixel_total : 7421 time to create 1 rle with old method : 0.008803367614746094 time for calcul the mask position with numpy : 0.0544435977935791 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0013604164123535156 time for calcul the mask position with numpy : 0.05349588394165039 nb_pixel_total : 31782 time to create 1 rle with old method : 0.042229652404785156 time for calcul the mask position with numpy : 0.06144070625305176 nb_pixel_total : 101731 time to create 1 rle with old method : 0.11387300491333008 time for calcul the mask position with numpy : 0.05376410484313965 nb_pixel_total : 90748 time to create 1 rle with old method : 0.10034847259521484 time for calcul the mask position with numpy : 0.05539751052856445 nb_pixel_total : 58145 time to create 1 rle with old method : 0.06498861312866211 time for calcul the mask position with numpy : 0.05337667465209961 nb_pixel_total : 19192 time to create 1 rle with old method : 0.021540403366088867 time for calcul the mask position with numpy : 0.05416059494018555 nb_pixel_total : 71227 time to create 1 rle with old method : 0.08066248893737793 time for calcul the mask position with numpy : 0.05348920822143555 nb_pixel_total : 8641 time to create 1 rle with old method : 0.009944438934326172 time for calcul the mask position with numpy : 0.05338025093078613 nb_pixel_total : 32111 time to create 1 rle with old method : 0.03624129295349121 time for calcul the mask position with numpy : 0.05366659164428711 nb_pixel_total : 130717 time to create 1 rle with old method : 0.15072870254516602 time for calcul the mask position with numpy : 0.05324268341064453 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0016918182373046875 time for calcul the mask position with numpy : 0.05330061912536621 nb_pixel_total : 15600 time to create 1 rle with old method : 0.01763606071472168 time for calcul the mask position with numpy : 0.0531768798828125 nb_pixel_total : 34606 time to create 1 rle with old method : 0.04203319549560547 time for calcul the mask position with numpy : 0.05776548385620117 nb_pixel_total : 55596 time to create 1 rle with old method : 0.06221961975097656 time for calcul the mask position with numpy : 0.05491137504577637 nb_pixel_total : 294243 time to create 1 rle with new method : 1.4411766529083252 time for calcul the mask position with numpy : 0.05338144302368164 nb_pixel_total : 4916 time to create 1 rle with old method : 0.0056951045989990234 time for calcul the mask position with numpy : 0.05750465393066406 nb_pixel_total : 1504 time to create 1 rle with old method : 0.0017445087432861328 time for calcul the mask position with numpy : 0.05405712127685547 nb_pixel_total : 42066 time to create 1 rle with old method : 0.04807686805725098 time for calcul the mask position with numpy : 0.05375361442565918 nb_pixel_total : 65680 time to create 1 rle with old method : 0.0741586685180664 time for calcul the mask position with numpy : 0.053760528564453125 nb_pixel_total : 39361 time to create 1 rle with old method : 0.04542422294616699 time for calcul the mask position with numpy : 0.05359816551208496 nb_pixel_total : 34682 time to create 1 rle with old method : 0.03939318656921387 time for calcul the mask position with numpy : 0.0549311637878418 nb_pixel_total : 70173 time to create 1 rle with old method : 0.07888221740722656 time for calcul the mask position with numpy : 0.05360078811645508 nb_pixel_total : 29191 time to create 1 rle with old method : 0.032750844955444336 time for calcul the mask position with numpy : 0.05348777770996094 nb_pixel_total : 7030 time to create 1 rle with old method : 0.008104085922241211 time for calcul the mask position with numpy : 0.0537877082824707 nb_pixel_total : 62794 time to create 1 rle with old method : 0.07079529762268066 time for calcul the mask position with numpy : 0.05421090126037598 nb_pixel_total : 85593 time to create 1 rle with old method : 0.09521961212158203 time for calcul the mask position with numpy : 0.05501270294189453 nb_pixel_total : 184758 time to create 1 rle with new method : 1.1274020671844482 time for calcul the mask position with numpy : 0.05469942092895508 nb_pixel_total : 127007 time to create 1 rle with old method : 0.14115071296691895 time for calcul the mask position with numpy : 0.05313253402709961 nb_pixel_total : 173 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.051908254623413086 nb_pixel_total : 66528 time to create 1 rle with old method : 0.07285857200622559 time for calcul the mask position with numpy : 0.052438974380493164 nb_pixel_total : 3130 time to create 1 rle with old method : 0.003686189651489258 time for calcul the mask position with numpy : 0.0527651309967041 nb_pixel_total : 45035 time to create 1 rle with old method : 0.04885101318359375 time for calcul the mask position with numpy : 0.05379128456115723 nb_pixel_total : 29202 time to create 1 rle with old method : 0.04661273956298828 time for calcul the mask position with numpy : 0.05912065505981445 nb_pixel_total : 25835 time to create 1 rle with old method : 0.028909683227539062 time for calcul the mask position with numpy : 0.053348541259765625 nb_pixel_total : 29169 time to create 1 rle with old method : 0.03588128089904785 time for calcul the mask position with numpy : 0.05459094047546387 nb_pixel_total : 59333 time to create 1 rle with old method : 0.06638145446777344 time for calcul the mask position with numpy : 0.05919837951660156 nb_pixel_total : 16749 time to create 1 rle with old method : 0.019006013870239258 time for calcul the mask position with numpy : 0.06076192855834961 nb_pixel_total : 689908 time to create 1 rle with new method : 1.1268115043640137 time for calcul the mask position with numpy : 0.05440711975097656 nb_pixel_total : 67235 time to create 1 rle with old method : 0.07464790344238281 time for calcul the mask position with numpy : 0.05416750907897949 nb_pixel_total : 109931 time to create 1 rle with old method : 0.12181806564331055 time for calcul the mask position with numpy : 0.056923866271972656 nb_pixel_total : 216480 time to create 1 rle with new method : 1.0176928043365479 time for calcul the mask position with numpy : 0.05550026893615723 nb_pixel_total : 170458 time to create 1 rle with new method : 1.3277406692504883 time for calcul the mask position with numpy : 0.05446600914001465 nb_pixel_total : 69156 time to create 1 rle with old method : 0.07757449150085449 time for calcul the mask position with numpy : 0.05705428123474121 nb_pixel_total : 578 time to create 1 rle with old method : 0.0010554790496826172 time for calcul the mask position with numpy : 0.06045651435852051 nb_pixel_total : 40414 time to create 1 rle with old method : 0.045462846755981445 time for calcul the mask position with numpy : 0.05401754379272461 nb_pixel_total : 81593 time to create 1 rle with old method : 0.09115481376647949 time for calcul the mask position with numpy : 0.0541071891784668 nb_pixel_total : 64644 time to create 1 rle with old method : 0.07296371459960938 time for calcul the mask position with numpy : 0.05509066581726074 nb_pixel_total : 183671 time to create 1 rle with new method : 0.9420123100280762 time for calcul the mask position with numpy : 0.053800344467163086 nb_pixel_total : 8636 time to create 1 rle with old method : 0.010452985763549805 time for calcul the mask position with numpy : 0.053783416748046875 nb_pixel_total : 2423 time to create 1 rle with old method : 0.0028104782104492188 time for calcul the mask position with numpy : 0.05358266830444336 nb_pixel_total : 5728 time to create 1 rle with old method : 0.006493806838989258 time for calcul the mask position with numpy : 0.057456254959106445 nb_pixel_total : 453438 time to create 1 rle with new method : 1.283813238143921 time for calcul the mask position with numpy : 0.05364680290222168 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.054605722427368164 nb_pixel_total : 115768 time to create 1 rle with old method : 0.1318361759185791 time for calcul the mask position with numpy : 0.05363154411315918 nb_pixel_total : 5640 time to create 1 rle with old method : 0.006388664245605469 time for calcul the mask position with numpy : 0.05416727066040039 nb_pixel_total : 37531 time to create 1 rle with old method : 0.04308938980102539 time for calcul the mask position with numpy : 0.0537104606628418 nb_pixel_total : 40263 time to create 1 rle with old method : 0.045302629470825195 time for calcul the mask position with numpy : 0.05347132682800293 nb_pixel_total : 2818 time to create 1 rle with old method : 0.0033321380615234375 time for calcul the mask position with numpy : 0.0558164119720459 nb_pixel_total : 259 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.06180906295776367 nb_pixel_total : 56867 time to create 1 rle with old method : 0.06407809257507324 time for calcul the mask position with numpy : 0.053694725036621094 nb_pixel_total : 1971 time to create 1 rle with old method : 0.002318143844604492 time for calcul the mask position with numpy : 0.05378150939941406 nb_pixel_total : 67602 time to create 1 rle with old method : 0.07683992385864258 time for calcul the mask position with numpy : 0.055307865142822266 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0018131732940673828 time for calcul the mask position with numpy : 0.054279327392578125 nb_pixel_total : 10140 time to create 1 rle with old method : 0.011418342590332031 create new chi : 26.143218994140625 time to delete rle : 0.006027698516845703 batch 1 Loaded 81 chid ids of type : 4855 Number RLEs to save : 45800 TO DO : save crop sub photo not yet done ! save time : 2.606114387512207 nb_obj : 51 nb_hashtags : 8 time to prepare the origin masks : 45.730823278427124 time for calcul the mask position with numpy : 0.9346861839294434 nb_pixel_total : 6675408 time to create 1 rle with new method : 1.469644546508789 time for calcul the mask position with numpy : 0.12422728538513184 nb_pixel_total : 1172212 time to create 1 rle with new method : 1.1807801723480225 time for calcul the mask position with numpy : 0.05320239067077637 nb_pixel_total : 52274 time to create 1 rle with old method : 0.05924582481384277 time for calcul the mask position with numpy : 0.06994843482971191 nb_pixel_total : 1522970 time to create 1 rle with new method : 0.8800473213195801 time for calcul the mask position with numpy : 0.054323434829711914 nb_pixel_total : 376791 time to create 1 rle with new method : 1.1677560806274414 time for calcul the mask position with numpy : 0.0533757209777832 nb_pixel_total : 67258 time to create 1 rle with old method : 0.07479071617126465 time for calcul the mask position with numpy : 0.05354809761047363 nb_pixel_total : 21170 time to create 1 rle with old method : 0.023659467697143555 time for calcul the mask position with numpy : 0.05327010154724121 nb_pixel_total : 54798 time to create 1 rle with old method : 0.06260442733764648 time for calcul the mask position with numpy : 0.05417680740356445 nb_pixel_total : 265180 time to create 1 rle with new method : 1.3181183338165283 time for calcul the mask position with numpy : 0.052399396896362305 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006492137908935547 time for calcul the mask position with numpy : 0.05199909210205078 nb_pixel_total : 18020 time to create 1 rle with old method : 0.019606828689575195 time for calcul the mask position with numpy : 0.05199313163757324 nb_pixel_total : 7948 time to create 1 rle with old method : 0.008816003799438477 time for calcul the mask position with numpy : 0.05303955078125 nb_pixel_total : 31782 time to create 1 rle with old method : 0.03514242172241211 time for calcul the mask position with numpy : 0.052819252014160156 nb_pixel_total : 190875 time to create 1 rle with new method : 1.0434129238128662 time for calcul the mask position with numpy : 0.05247163772583008 nb_pixel_total : 17045 time to create 1 rle with old method : 0.018501758575439453 time for calcul the mask position with numpy : 0.05195116996765137 nb_pixel_total : 101411 time to create 1 rle with old method : 0.1139523983001709 time for calcul the mask position with numpy : 0.055458784103393555 nb_pixel_total : 33195 time to create 1 rle with old method : 0.03657245635986328 time for calcul the mask position with numpy : 0.05298805236816406 nb_pixel_total : 9899 time to create 1 rle with old method : 0.011325597763061523 time for calcul the mask position with numpy : 0.053254127502441406 nb_pixel_total : 70780 time to create 1 rle with old method : 0.07896780967712402 time for calcul the mask position with numpy : 0.052457571029663086 nb_pixel_total : 46006 time to create 1 rle with old method : 0.050385236740112305 time for calcul the mask position with numpy : 0.05336880683898926 nb_pixel_total : 189123 time to create 1 rle with new method : 1.111185073852539 time for calcul the mask position with numpy : 0.05252718925476074 nb_pixel_total : 35612 time to create 1 rle with old method : 0.03891706466674805 time for calcul the mask position with numpy : 0.05432772636413574 nb_pixel_total : 94774 time to create 1 rle with old method : 0.13114118576049805 time for calcul the mask position with numpy : 0.054317474365234375 nb_pixel_total : 36873 time to create 1 rle with old method : 0.04149675369262695 time for calcul the mask position with numpy : 0.05485343933105469 nb_pixel_total : 32686 time to create 1 rle with old method : 0.03706812858581543 time for calcul the mask position with numpy : 0.053705692291259766 nb_pixel_total : 21227 time to create 1 rle with old method : 0.024258136749267578 time for calcul the mask position with numpy : 0.053610801696777344 nb_pixel_total : 2316 time to create 1 rle with old method : 0.0029973983764648438 time for calcul the mask position with numpy : 0.053653717041015625 nb_pixel_total : 26379 time to create 1 rle with old method : 0.029415369033813477 time for calcul the mask position with numpy : 0.05612826347351074 nb_pixel_total : 61717 time to create 1 rle with old method : 0.08264017105102539 time for calcul the mask position with numpy : 0.05518364906311035 nb_pixel_total : 20984 time to create 1 rle with old method : 0.024814844131469727 time for calcul the mask position with numpy : 0.05491042137145996 nb_pixel_total : 48292 time to create 1 rle with old method : 0.05427384376525879 time for calcul the mask position with numpy : 0.05579662322998047 nb_pixel_total : 140025 time to create 1 rle with old method : 0.15426278114318848 time for calcul the mask position with numpy : 0.05263948440551758 nb_pixel_total : 20227 time to create 1 rle with old method : 0.022069692611694336 time for calcul the mask position with numpy : 0.05433845520019531 nb_pixel_total : 3202 time to create 1 rle with old method : 0.0040132999420166016 time for calcul the mask position with numpy : 0.05334925651550293 nb_pixel_total : 101155 time to create 1 rle with old method : 0.11131072044372559 time for calcul the mask position with numpy : 0.05398750305175781 nb_pixel_total : 73273 time to create 1 rle with old method : 0.08199405670166016 time for calcul the mask position with numpy : 0.05299115180969238 nb_pixel_total : 56833 time to create 1 rle with old method : 0.06332755088806152 time for calcul the mask position with numpy : 0.053139686584472656 nb_pixel_total : 88707 time to create 1 rle with old method : 0.09884834289550781 time for calcul the mask position with numpy : 0.057353973388671875 nb_pixel_total : 502673 time to create 1 rle with new method : 1.2094449996948242 time for calcul the mask position with numpy : 0.052755117416381836 nb_pixel_total : 1621 time to create 1 rle with old method : 0.002153158187866211 time for calcul the mask position with numpy : 0.05260968208312988 nb_pixel_total : 45154 time to create 1 rle with old method : 0.04988718032836914 time for calcul the mask position with numpy : 0.05327963829040527 nb_pixel_total : 110848 time to create 1 rle with old method : 0.12260031700134277 time for calcul the mask position with numpy : 0.05400419235229492 nb_pixel_total : 149958 time to create 1 rle with old method : 0.16533780097961426 time for calcul the mask position with numpy : 0.053452253341674805 nb_pixel_total : 329 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.05403757095336914 nb_pixel_total : 28658 time to create 1 rle with old method : 0.03321194648742676 time for calcul the mask position with numpy : 0.05255913734436035 nb_pixel_total : 38695 time to create 1 rle with old method : 0.04259610176086426 time for calcul the mask position with numpy : 0.0525355339050293 nb_pixel_total : 5625 time to create 1 rle with old method : 0.006541728973388672 time for calcul the mask position with numpy : 0.05260109901428223 nb_pixel_total : 143394 time to create 1 rle with old method : 0.15717315673828125 time for calcul the mask position with numpy : 0.05281567573547363 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007464885711669922 time for calcul the mask position with numpy : 0.054498910903930664 nb_pixel_total : 107355 time to create 1 rle with old method : 0.13605642318725586 time for calcul the mask position with numpy : 0.05196690559387207 nb_pixel_total : 24614 time to create 1 rle with old method : 0.02677631378173828 time for calcul the mask position with numpy : 0.05220174789428711 nb_pixel_total : 30847 time to create 1 rle with old method : 0.034070491790771484 create new chi : 15.906798839569092 time to delete rle : 0.0028259754180908203 batch 1 Loaded 52 chid ids of type : 4855 Number RLEs to save : 34354 TO DO : save crop sub photo not yet done ! save time : 1.922154426574707 nb_obj : 9 nb_hashtags : 6 time to prepare the origin masks : 17.684885501861572 time for calcul the mask position with numpy : 0.13743996620178223 nb_pixel_total : 1673383 time to create 1 rle with new method : 1.642939567565918 time for calcul the mask position with numpy : 0.06363344192504883 nb_pixel_total : 745 time to create 1 rle with old method : 0.0010275840759277344 time for calcul the mask position with numpy : 0.05388379096984863 nb_pixel_total : 1140363 time to create 1 rle with new method : 0.9887068271636963 time for calcul the mask position with numpy : 0.04175734519958496 nb_pixel_total : 113099 time to create 1 rle with old method : 0.12969422340393066 time for calcul the mask position with numpy : 0.04836392402648926 nb_pixel_total : 7093 time to create 1 rle with old method : 0.008057355880737305 time for calcul the mask position with numpy : 0.044126272201538086 nb_pixel_total : 40718 time to create 1 rle with old method : 0.047892093658447266 time for calcul the mask position with numpy : 0.04534149169921875 nb_pixel_total : 96327 time to create 1 rle with old method : 0.11191272735595703 time for calcul the mask position with numpy : 0.04853010177612305 nb_pixel_total : 809886 time to create 1 rle with new method : 1.4366168975830078 time for calcul the mask position with numpy : 0.10231685638427734 nb_pixel_total : 1924393 time to create 1 rle with new method : 1.5903091430664062 time for calcul the mask position with numpy : 0.6145973205566406 nb_pixel_total : 7173193 time to create 1 rle with new method : 1.3560113906860352 create new chi : 8.7754967212677 time to delete rle : 0.0034465789794921875 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 18447 TO DO : save crop sub photo not yet done ! save time : 1.0407023429870605 map_output_result : {1357676358: (0.3586416153686158, 'Should be the crop_list due to order', 0.42791283622917675), 1357676347: (0.3586416153686158, 'Should be the crop_list due to order', 0.44397923977035175), 1357676341: (0.3586416153686158, 'Should be the crop_list due to order', 0.20528253715930403), 1357676331: (0.3586416153686158, 'Should be the crop_list due to order', 0.20311174075297603), 1357676324: (0.3586416153686158, 'Should be the crop_list due to order', 0.1913213312112298), 1357676318: (0.3586416153686158, 'Should be the crop_list due to order', 0.6802420070886559)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 6 /1357676358.Didn't retrieve data . /1357676347.Didn't retrieve data . /1357676341.Didn't retrieve data . /1357676331.Didn't retrieve data . /1357676324.Didn't retrieve data . /1357676318.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.013280391693115234 save_final save missing photos in datou_result : time spend for datou_step_exec : 462.50398564338684 time spend to save output : 0.014020442962646484 total time spend for step 5 : 462.5180060863495 step6:crop_condition Mon May 12 20:52:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 379 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3015255 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076005_3832904 we have uploaded 36 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.798105478286743 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3015255 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076047_3832904 we have uploaded 51 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.72406005859375 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3015255 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076072_3832904 we have uploaded 38 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.47598147392273 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3015255 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076086_3832904 we have uploaded 2 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7074999809265137 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076090_3832904 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.6329345703125 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3015255 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076112_3832904 we have uploaded 52 photos in the portfolio 3015255 time of upload the photos Elapsed time : 12.148326873779297 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3015255 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076145_3832904 we have uploaded 21 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.9471518993377686 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3015255 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076154_3832904 we have uploaded 3 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.9663386344909668 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3015255 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076161_3832904 we have uploaded 18 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.934869766235352 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 60 About to insert : list_path_to_insert length 60 new photo from crops ! About to upload 60 photos upload in portfolio : 3015255 init cache_photo without model_param we have 60 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747076375_3832904 we have uploaded 60 photos in the portfolio 3015255 time of upload the photos Elapsed time : 19.968329191207886 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 282 /1357720615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357720928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357721219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 852 time used for this insertion : 0.665809154510498 save_final save missing photos in datou_result : time spend for datou_step_exec : 432.8547625541687 time spend to save output : 0.7956721782684326 total time spend for step 6 : 433.65043473243713 step7:ventilate_hashtags_in_portfolio Mon May 12 20:59:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22889869 get user id for portfolio 22889869 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22889869 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22889869 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22889869 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22889869 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22895625,22895626,22895627,22895628,22895629,22895634,22895636,22895637,22895638,22895639,22895640,22895641,22895643,22895644,22895645,22895646,22895647,22895648,22895649,22895650?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22889869 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 1 /22889869. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.016135215759277344 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.603529930114746 time spend to save output : 0.01728343963623047 total time spend for step 7 : 4.620813369750977 step8:final Mon May 12 21:00:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357676358: ('0.3378707242551948',), 1357676347: ('0.3378707242551948',), 1357676341: ('0.3378707242551948',), 1357676331: ('0.3378707242551948',), 1357676324: ('0.3378707242551948',), 1357676318: ('0.3378707242551948',)} new output for save of step final : {1357676358: ('0.3378707242551948',), 1357676347: ('0.3378707242551948',), 1357676341: ('0.3378707242551948',), 1357676331: ('0.3378707242551948',), 1357676324: ('0.3378707242551948',), 1357676318: ('0.3378707242551948',)} [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 6 /1357676358.Didn't retrieve data . /1357676347.Didn't retrieve data . /1357676341.Didn't retrieve data . /1357676331.Didn't retrieve data . /1357676324.Didn't retrieve data . /1357676318.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.014888525009155273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12877368927001953 time spend to save output : 0.015324592590332031 total time spend for step 8 : 0.14409828186035156 step9:velours_tree Mon May 12 21:00:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14217019081115723 time spend to save output : 4.100799560546875e-05 total time spend for step 9 : 0.1422111988067627 step10:send_mail_cod Mon May 12 21:00:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22889869_12-05-2025_21_00_02.pdf 22895599 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228955991747076402 22895600 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228956001747076404 22895601 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228956011747076406 22895602 change filename to text .change filename to text .imagette228956021747076407 22895603 change filename to text .imagette228956031747076407 22895604 imagette228956041747076407 22895605 imagette228956051747076407 22895606 imagette228956061747076407 22895607 imagette228956071747076407 22895608 imagette228956081747076407 22895609 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228956091747076407 22895610 imagette228956101747076409 22895611 imagette228956111747076409 22895612 imagette228956121747076409 22895613 imagette228956131747076409 22895614 imagette228956141747076409 22895615 imagette228956151747076409 22895616 change filename to text .change filename to text .change filename to text .imagette228956161747076409 22895617 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228956171747076409 22895619 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228956191747076410 22895620 imagette228956201747076412 22895621 imagette228956211747076412 22895622 imagette228956221747076412 22895623 imagette228956231747076412 22895624 imagette228956241747076412 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22889869 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22895625,22895626,22895627,22895628,22895629,22895634,22895636,22895637,22895638,22895639,22895640,22895641,22895643,22895644,22895645,22895646,22895647,22895648,22895649,22895650?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22889869 your option no_mail is active, we will not send the real mail to your client args[1357676358] : ((1357676358, 3770.4256844931706, 492609224), (1357676358, -0.27258079765348414, 496442774), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357676347] : ((1357676347, 3524.6544553090457, 492609224), (1357676347, -0.22440133322366962, 496442774), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357676341] : ((1357676341, 3302.9432031563097, 492609224), (1357676341, -0.40106026799779704, 496442774), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357676331] : ((1357676331, 5268.757815833344, 492609224), (1357676331, -0.3006546947640278, 496442774), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357676324] : ((1357676324, 998.3043450320747, 2107751945), (1357676324, -0.2827465239508777, 496442774), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357676318] : ((1357676318, 427.09759103342196, 492688767), (1357676318, -0.6761987583071036, 501862349), '0.3378707242551948') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.3378707242551948 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22889869_12-05-2025_21_00_02.pdf results_Auto_P22889869_12-05-2025_21_00_02.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22889869_12-05-2025_21_00_02.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22889869','results_Auto_P22889869_12-05-2025_21_00_02.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22889869_12-05-2025_21_00_02.pdf','pdf','','2.46','0.3378707242551948') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015714406967163086 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.79002833366394 time spend to save output : 0.016164541244506836 total time spend for step 10 : 13.806192874908447 step11:split_time_score Mon May 12 21:00:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('04', 3), ('05', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12052025 22889869 Nombre de photos uploadées : 6 / 23040 (0%) 12052025 22889869 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 12052025 22889869 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0006361007690429688 elapsed_time : insert_dashboard_record_day_entry 0.024695396423339844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22889868 order by id desc limit 1 Qualite : 0.3378707242551948 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22889869_12-05-2025_21_00_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22889869 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22889869 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12052025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357676358, 1357676347, 1357676341, 1357676331, 1357676324, 1357676318] Looping around the photos to save general results len do output : 1 /22889869Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676358', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676347', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676341', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676331', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676324', None, None, None, None, None, '2827974') ('4741', None, None, None, None, None, None, None, '2827974') ('4741', '22889869', '1357676318', None, None, None, None, None, '2827974') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015082120895385742 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1777634620666504 time spend to save output : 0.015399932861328125 total time spend for step 11 : 1.1931633949279785 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 710.36user 358.96system 18:52.57elapsed 94%CPU (0avgtext+0avgdata 7151244maxresident)k 1256312inputs+834256outputs (11599major+56459417minor)pagefaults 0swaps