python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1238181 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2797865'] with mtr_portfolio_ids : ['22716771'] and first list_photo_ids : [] new path : /proc/1238181/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.2229814529418945 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 6 17:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 17:41:33.935524: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 17:41:33.963152: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 17:41:33.965233: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdd50000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 17:41:33.965293: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 17:41:33.969363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 17:41:34.215807: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x220c31b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 17:41:34.215866: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 17:41:34.217081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:41:34.217485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:41:34.220116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:41:34.222745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:41:34.223264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:41:34.226182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:41:34.227720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:41:34.233705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:41:34.235672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:41:34.235825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:41:34.236808: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 17:41:34.236828: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 17:41:34.236839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 17:41:34.238581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 17:41:34.520408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:41:34.520535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:41:34.520557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:41:34.520576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:41:34.520593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:41:34.520611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:41:34.520628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:41:34.520646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:41:34.521860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:41:34.523224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:41:34.523266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:41:34.523281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:41:34.523295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:41:34.523324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:41:34.523339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:41:34.523353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:41:34.523368: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:41:34.524580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:41:34.524621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 17:41:34.524629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 17:41:34.524637: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 17:41:34.525922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 17:41:46.917206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:41:47.111191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 1238473 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10593 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.07625150680541992 nb_pixel_total : 2344467 time to create 1 rle with new method : 0.3652153015136719 length of segment : 3582 time for calcul the mask position with numpy : 0.027263164520263672 nb_pixel_total : 1490445 time to create 1 rle with new method : 0.11874246597290039 length of segment : 4633 time for calcul the mask position with numpy : 0.012711524963378906 nb_pixel_total : 635776 time to create 1 rle with new method : 0.2662627696990967 length of segment : 3093 time for calcul the mask position with numpy : 0.0024139881134033203 nb_pixel_total : 197532 time to create 1 rle with new method : 0.006415843963623047 length of segment : 1009 time for calcul the mask position with numpy : 0.012501716613769531 nb_pixel_total : 765343 time to create 1 rle with new method : 0.06000185012817383 length of segment : 2654 time for calcul the mask position with numpy : 0.0037255287170410156 nb_pixel_total : 299762 time to create 1 rle with new method : 0.008388519287109375 length of segment : 1107 time for calcul the mask position with numpy : 0.02773284912109375 nb_pixel_total : 1295204 time to create 1 rle with new method : 0.6977384090423584 length of segment : 3220 time for calcul the mask position with numpy : 0.013084650039672852 nb_pixel_total : 407927 time to create 1 rle with new method : 0.05394387245178223 length of segment : 1516 time for calcul the mask position with numpy : 0.002146005630493164 nb_pixel_total : 59352 time to create 1 rle with old method : 0.07342004776000977 length of segment : 256 time for calcul the mask position with numpy : 0.005882740020751953 nb_pixel_total : 130022 time to create 1 rle with old method : 0.15272831916809082 length of segment : 671 time for calcul the mask position with numpy : 0.004580020904541016 nb_pixel_total : 121675 time to create 1 rle with old method : 0.15160083770751953 length of segment : 413 time for calcul the mask position with numpy : 0.004117727279663086 nb_pixel_total : 100207 time to create 1 rle with old method : 0.13112258911132812 length of segment : 389 time for calcul the mask position with numpy : 0.0014710426330566406 nb_pixel_total : 24280 time to create 1 rle with old method : 0.036334991455078125 length of segment : 220 time for calcul the mask position with numpy : 0.028437376022338867 nb_pixel_total : 801581 time to create 1 rle with new method : 0.2975785732269287 length of segment : 1073 time for calcul the mask position with numpy : 0.0014345645904541016 nb_pixel_total : 46787 time to create 1 rle with old method : 0.0592961311340332 length of segment : 316 time for calcul the mask position with numpy : 0.0015065670013427734 nb_pixel_total : 37461 time to create 1 rle with old method : 0.056002140045166016 length of segment : 213 time for calcul the mask position with numpy : 0.0018169879913330078 nb_pixel_total : 44410 time to create 1 rle with old method : 0.051625967025756836 length of segment : 328 time for calcul the mask position with numpy : 0.0022649765014648438 nb_pixel_total : 72220 time to create 1 rle with old method : 0.08855223655700684 length of segment : 284 time for calcul the mask position with numpy : 0.011862039566040039 nb_pixel_total : 404553 time to create 1 rle with new method : 0.019028186798095703 length of segment : 718 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 17335 time to create 1 rle with old method : 0.021039247512817383 length of segment : 134 time for calcul the mask position with numpy : 0.0018658638000488281 nb_pixel_total : 38643 time to create 1 rle with old method : 0.04853010177612305 length of segment : 409 time for calcul the mask position with numpy : 0.001470804214477539 nb_pixel_total : 27629 time to create 1 rle with old method : 0.03769969940185547 length of segment : 278 time for calcul the mask position with numpy : 0.001859903335571289 nb_pixel_total : 39953 time to create 1 rle with old method : 0.0465397834777832 length of segment : 275 time for calcul the mask position with numpy : 0.0008442401885986328 nb_pixel_total : 8260 time to create 1 rle with old method : 0.010076761245727539 length of segment : 155 time for calcul the mask position with numpy : 0.0007078647613525391 nb_pixel_total : 17073 time to create 1 rle with old method : 0.020343303680419922 length of segment : 124 time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 14619 time to create 1 rle with old method : 0.01778101921081543 length of segment : 182 time for calcul the mask position with numpy : 0.0006415843963623047 nb_pixel_total : 14103 time to create 1 rle with old method : 0.019151687622070312 length of segment : 140 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 6501 time to create 1 rle with old method : 0.00815439224243164 length of segment : 144 time for calcul the mask position with numpy : 0.0003371238708496094 nb_pixel_total : 6826 time to create 1 rle with old method : 0.00867605209350586 length of segment : 93 time for calcul the mask position with numpy : 0.0030307769775390625 nb_pixel_total : 93926 time to create 1 rle with old method : 0.11124134063720703 length of segment : 279 time for calcul the mask position with numpy : 0.002745389938354492 nb_pixel_total : 96396 time to create 1 rle with old method : 0.11765909194946289 length of segment : 324 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 7286 time to create 1 rle with old method : 0.008741617202758789 length of segment : 120 time for calcul the mask position with numpy : 0.002245187759399414 nb_pixel_total : 65139 time to create 1 rle with old method : 0.08018660545349121 length of segment : 428 time for calcul the mask position with numpy : 0.0020825862884521484 nb_pixel_total : 39307 time to create 1 rle with old method : 0.048924922943115234 length of segment : 187 time for calcul the mask position with numpy : 0.004464387893676758 nb_pixel_total : 103617 time to create 1 rle with old method : 0.1237647533416748 length of segment : 420 time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 12613 time to create 1 rle with old method : 0.01648688316345215 length of segment : 199 time for calcul the mask position with numpy : 0.0005083084106445312 nb_pixel_total : 5064 time to create 1 rle with old method : 0.006350994110107422 length of segment : 81 time for calcul the mask position with numpy : 0.0009002685546875 nb_pixel_total : 18234 time to create 1 rle with old method : 0.024266719818115234 length of segment : 198 time for calcul the mask position with numpy : 0.0016057491302490234 nb_pixel_total : 32600 time to create 1 rle with old method : 0.04288220405578613 length of segment : 288 time for calcul the mask position with numpy : 0.000743865966796875 nb_pixel_total : 10925 time to create 1 rle with old method : 0.013634681701660156 length of segment : 155 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 15984 time to create 1 rle with old method : 0.022408246994018555 length of segment : 100 time for calcul the mask position with numpy : 0.0030698776245117188 nb_pixel_total : 137360 time to create 1 rle with old method : 0.1588280200958252 length of segment : 437 time for calcul the mask position with numpy : 0.0008127689361572266 nb_pixel_total : 33912 time to create 1 rle with old method : 0.040616512298583984 length of segment : 186 time for calcul the mask position with numpy : 0.003573894500732422 nb_pixel_total : 98000 time to create 1 rle with old method : 0.1151578426361084 length of segment : 474 time for calcul the mask position with numpy : 0.003564596176147461 nb_pixel_total : 79884 time to create 1 rle with old method : 0.16078877449035645 length of segment : 337 time for calcul the mask position with numpy : 0.0019927024841308594 nb_pixel_total : 74094 time to create 1 rle with old method : 0.09958028793334961 length of segment : 365 time for calcul the mask position with numpy : 0.001710653305053711 nb_pixel_total : 59158 time to create 1 rle with old method : 0.07248425483703613 length of segment : 276 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 22934 time to create 1 rle with old method : 0.027422428131103516 length of segment : 123 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 22783 time to create 1 rle with old method : 0.02763652801513672 length of segment : 173 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 9449 time to create 1 rle with old method : 0.012629508972167969 length of segment : 92 time for calcul the mask position with numpy : 0.001428365707397461 nb_pixel_total : 61168 time to create 1 rle with old method : 0.0729832649230957 length of segment : 293 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 49663 time to create 1 rle with old method : 0.05861687660217285 length of segment : 289 time for calcul the mask position with numpy : 0.0023131370544433594 nb_pixel_total : 102592 time to create 1 rle with old method : 0.12929129600524902 length of segment : 294 time for calcul the mask position with numpy : 0.0008788108825683594 nb_pixel_total : 19300 time to create 1 rle with old method : 0.023389339447021484 length of segment : 203 time for calcul the mask position with numpy : 0.0009312629699707031 nb_pixel_total : 26990 time to create 1 rle with old method : 0.034242868423461914 length of segment : 189 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 16424 time to create 1 rle with old method : 0.024934053421020508 length of segment : 235 time for calcul the mask position with numpy : 0.0010349750518798828 nb_pixel_total : 45256 time to create 1 rle with old method : 0.06405329704284668 length of segment : 240 time for calcul the mask position with numpy : 0.0012519359588623047 nb_pixel_total : 32288 time to create 1 rle with old method : 0.040730953216552734 length of segment : 209 time for calcul the mask position with numpy : 0.0023589134216308594 nb_pixel_total : 86141 time to create 1 rle with old method : 0.10368800163269043 length of segment : 521 time for calcul the mask position with numpy : 0.005637645721435547 nb_pixel_total : 182763 time to create 1 rle with new method : 0.009933233261108398 length of segment : 528 time for calcul the mask position with numpy : 0.0009875297546386719 nb_pixel_total : 27423 time to create 1 rle with old method : 0.03293609619140625 length of segment : 259 time for calcul the mask position with numpy : 0.0033173561096191406 nb_pixel_total : 122658 time to create 1 rle with old method : 0.1496121883392334 length of segment : 520 time for calcul the mask position with numpy : 0.002482891082763672 nb_pixel_total : 62225 time to create 1 rle with old method : 0.09549140930175781 length of segment : 311 time for calcul the mask position with numpy : 0.0034856796264648438 nb_pixel_total : 100412 time to create 1 rle with old method : 0.11895561218261719 length of segment : 373 time for calcul the mask position with numpy : 0.0019693374633789062 nb_pixel_total : 49733 time to create 1 rle with old method : 0.05902218818664551 length of segment : 271 time for calcul the mask position with numpy : 0.0008974075317382812 nb_pixel_total : 25591 time to create 1 rle with old method : 0.030884742736816406 length of segment : 329 time for calcul the mask position with numpy : 0.0003383159637451172 nb_pixel_total : 6992 time to create 1 rle with old method : 0.008635997772216797 length of segment : 284 time for calcul the mask position with numpy : 0.0007295608520507812 nb_pixel_total : 21803 time to create 1 rle with old method : 0.026990652084350586 length of segment : 144 time for calcul the mask position with numpy : 0.0014348030090332031 nb_pixel_total : 49264 time to create 1 rle with old method : 0.059927940368652344 length of segment : 400 time for calcul the mask position with numpy : 0.0008625984191894531 nb_pixel_total : 25819 time to create 1 rle with old method : 0.032530784606933594 length of segment : 148 time for calcul the mask position with numpy : 0.0030989646911621094 nb_pixel_total : 103446 time to create 1 rle with old method : 0.12418317794799805 length of segment : 306 time for calcul the mask position with numpy : 0.0007681846618652344 nb_pixel_total : 16558 time to create 1 rle with old method : 0.020665645599365234 length of segment : 160 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 15988 time to create 1 rle with old method : 0.02099013328552246 length of segment : 154 time for calcul the mask position with numpy : 0.00041365623474121094 nb_pixel_total : 3444 time to create 1 rle with old method : 0.004986763000488281 length of segment : 84 time for calcul the mask position with numpy : 0.007710695266723633 nb_pixel_total : 305093 time to create 1 rle with new method : 0.011074304580688477 length of segment : 533 time for calcul the mask position with numpy : 0.0008504390716552734 nb_pixel_total : 36857 time to create 1 rle with old method : 0.043497562408447266 length of segment : 227 time for calcul the mask position with numpy : 0.000701904296875 nb_pixel_total : 22989 time to create 1 rle with old method : 0.028161048889160156 length of segment : 132 time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 13948 time to create 1 rle with old method : 0.016927242279052734 length of segment : 116 time for calcul the mask position with numpy : 0.00044274330139160156 nb_pixel_total : 32099 time to create 1 rle with old method : 0.036879539489746094 length of segment : 143 time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 9620 time to create 1 rle with old method : 0.011863470077514648 length of segment : 108 time for calcul the mask position with numpy : 0.0009870529174804688 nb_pixel_total : 36447 time to create 1 rle with old method : 0.04358673095703125 length of segment : 235 time for calcul the mask position with numpy : 0.06965517997741699 nb_pixel_total : 2052545 time to create 1 rle with new method : 0.35843992233276367 length of segment : 1220 time for calcul the mask position with numpy : 0.014193534851074219 nb_pixel_total : 833200 time to create 1 rle with new method : 0.03696942329406738 length of segment : 1150 time for calcul the mask position with numpy : 0.0007295608520507812 nb_pixel_total : 21870 time to create 1 rle with old method : 0.025055885314941406 length of segment : 219 time for calcul the mask position with numpy : 0.0022165775299072266 nb_pixel_total : 78463 time to create 1 rle with old method : 0.08938336372375488 length of segment : 371 time for calcul the mask position with numpy : 0.0018739700317382812 nb_pixel_total : 75910 time to create 1 rle with old method : 0.09478616714477539 length of segment : 261 time for calcul the mask position with numpy : 0.0034666061401367188 nb_pixel_total : 103993 time to create 1 rle with old method : 0.15004205703735352 length of segment : 563 time for calcul the mask position with numpy : 0.0054552555084228516 nb_pixel_total : 242186 time to create 1 rle with new method : 0.009053230285644531 length of segment : 431 time for calcul the mask position with numpy : 0.0014379024505615234 nb_pixel_total : 42047 time to create 1 rle with old method : 0.05132102966308594 length of segment : 268 time for calcul the mask position with numpy : 0.002805471420288086 nb_pixel_total : 148755 time to create 1 rle with old method : 0.17308735847473145 length of segment : 359 time for calcul the mask position with numpy : 0.004019975662231445 nb_pixel_total : 56497 time to create 1 rle with old method : 0.08740115165710449 length of segment : 287 time for calcul the mask position with numpy : 0.003904104232788086 nb_pixel_total : 127567 time to create 1 rle with old method : 0.1746830940246582 length of segment : 336 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 21540 time to create 1 rle with old method : 0.0289306640625 length of segment : 142 time for calcul the mask position with numpy : 0.0021572113037109375 nb_pixel_total : 49530 time to create 1 rle with old method : 0.07187771797180176 length of segment : 272 time for calcul the mask position with numpy : 0.0004949569702148438 nb_pixel_total : 28792 time to create 1 rle with old method : 0.04243206977844238 length of segment : 186 time for calcul the mask position with numpy : 0.0006711483001708984 nb_pixel_total : 6077 time to create 1 rle with old method : 0.011497735977172852 length of segment : 153 time for calcul the mask position with numpy : 0.0002491474151611328 nb_pixel_total : 10935 time to create 1 rle with old method : 0.014443397521972656 length of segment : 119 time for calcul the mask position with numpy : 0.0008459091186523438 nb_pixel_total : 12459 time to create 1 rle with old method : 0.01996636390686035 length of segment : 157 time for calcul the mask position with numpy : 0.043791770935058594 nb_pixel_total : 2617416 time to create 1 rle with new method : 0.44653987884521484 length of segment : 2348 time for calcul the mask position with numpy : 0.6170358657836914 nb_pixel_total : 7312858 time to create 1 rle with new method : 0.5460500717163086 length of segment : 3784 time for calcul the mask position with numpy : 0.5098817348480225 nb_pixel_total : 9090932 time to create 1 rle with new method : 1.1641273498535156 length of segment : 2711 time for calcul the mask position with numpy : 0.03316617012023926 nb_pixel_total : 2724083 time to create 1 rle with new method : 0.4557914733886719 length of segment : 1415 time for calcul the mask position with numpy : 0.04225635528564453 nb_pixel_total : 2008937 time to create 1 rle with new method : 0.35440587997436523 length of segment : 1629 time for calcul the mask position with numpy : 0.032263994216918945 nb_pixel_total : 2063045 time to create 1 rle with new method : 0.1682121753692627 length of segment : 2021 time for calcul the mask position with numpy : 0.6371424198150635 nb_pixel_total : 5482920 time to create 1 rle with new method : 1.2661821842193604 length of segment : 5027 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 13020 time to create 1 rle with old method : 0.015707969665527344 length of segment : 162 time for calcul the mask position with numpy : 0.0016970634460449219 nb_pixel_total : 63798 time to create 1 rle with old method : 0.07634353637695312 length of segment : 428 time for calcul the mask position with numpy : 0.0007138252258300781 nb_pixel_total : 20622 time to create 1 rle with old method : 0.025755882263183594 length of segment : 307 time for calcul the mask position with numpy : 0.0006432533264160156 nb_pixel_total : 14068 time to create 1 rle with old method : 0.02381300926208496 length of segment : 218 time spent for convertir_results : 32.664857387542725 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 109 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 97.49412703514099 time spend to save output : 0.14617085456848145 total time spend for step 1 : 97.64029788970947 step2:mask_detect Tue May 6 17:43:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-06 17:43:11.358215: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-06 17:43:11.387074: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-06 17:43:11.389573: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdd44000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-06 17:43:11.389633: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-06 17:43:11.393994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-06 17:43:11.529259: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23539650 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-06 17:43:11.529341: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-06 17:43:11.530781: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:43:11.531223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:43:11.534893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:43:11.538195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:43:11.538811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:43:11.541644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:43:11.542777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:43:11.547325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:43:11.548845: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:43:11.548931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:43:11.549697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 17:43:11.549712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 17:43:11.549721: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 17:43:11.551160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-06 17:43:11.662176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:43:11.662296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:43:11.662315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:43:11.662332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:43:11.662348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:43:11.662364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:43:11.662379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:43:11.662395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:43:11.663586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:43:11.664669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-06 17:43:11.664714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-06 17:43:11.664730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:43:11.664745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-06 17:43:11.664760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-06 17:43:11.664775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-06 17:43:11.664790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-06 17:43:11.664804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-06 17:43:11.665971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-06 17:43:11.666003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-06 17:43:11.666011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-06 17:43:11.666019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-06 17:43:11.667245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-06 17:43:24.922316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-06 17:43:25.106696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (3120, 4160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 1244174 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10372 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 1.716111183166504 nb_pixel_total : 4669234 time to create 1 rle with new method : 1.2650928497314453 length of segment : 5492 time for calcul the mask position with numpy : 0.11069989204406738 nb_pixel_total : 2335264 time to create 1 rle with new method : 0.5175495147705078 length of segment : 5923 time for calcul the mask position with numpy : 0.004129648208618164 nb_pixel_total : 178409 time to create 1 rle with new method : 0.01261281967163086 length of segment : 1768 time for calcul the mask position with numpy : 0.026326417922973633 nb_pixel_total : 1605684 time to create 1 rle with new method : 0.17233037948608398 length of segment : 5071 time for calcul the mask position with numpy : 0.0009799003601074219 nb_pixel_total : 39236 time to create 1 rle with old method : 0.048587799072265625 length of segment : 340 time for calcul the mask position with numpy : 0.004971504211425781 nb_pixel_total : 317649 time to create 1 rle with new method : 0.011417388916015625 length of segment : 1191 time for calcul the mask position with numpy : 0.012544870376586914 nb_pixel_total : 949042 time to create 1 rle with new method : 0.04178905487060547 length of segment : 1287 time for calcul the mask position with numpy : 0.0021805763244628906 nb_pixel_total : 161768 time to create 1 rle with new method : 0.00522160530090332 length of segment : 688 time for calcul the mask position with numpy : 0.009462594985961914 nb_pixel_total : 685234 time to create 1 rle with new method : 0.018765926361083984 length of segment : 1327 time for calcul the mask position with numpy : 0.008093595504760742 nb_pixel_total : 526057 time to create 1 rle with new method : 0.01847100257873535 length of segment : 1403 time for calcul the mask position with numpy : 0.0019185543060302734 nb_pixel_total : 135976 time to create 1 rle with old method : 0.18723273277282715 length of segment : 587 time for calcul the mask position with numpy : 0.004476308822631836 nb_pixel_total : 308758 time to create 1 rle with new method : 0.011399984359741211 length of segment : 1472 time for calcul the mask position with numpy : 0.006910562515258789 nb_pixel_total : 456648 time to create 1 rle with new method : 0.01565408706665039 length of segment : 1338 time for calcul the mask position with numpy : 0.0005910396575927734 nb_pixel_total : 44642 time to create 1 rle with old method : 0.05237913131713867 length of segment : 158 time for calcul the mask position with numpy : 0.0009248256683349609 nb_pixel_total : 66878 time to create 1 rle with old method : 0.07941699028015137 length of segment : 239 time for calcul the mask position with numpy : 0.006248950958251953 nb_pixel_total : 445769 time to create 1 rle with new method : 0.015588760375976562 length of segment : 1345 time for calcul the mask position with numpy : 0.006098747253417969 nb_pixel_total : 386994 time to create 1 rle with new method : 0.015125513076782227 length of segment : 1272 time for calcul the mask position with numpy : 0.0005476474761962891 nb_pixel_total : 39163 time to create 1 rle with old method : 0.04736447334289551 length of segment : 147 time for calcul the mask position with numpy : 0.0013723373413085938 nb_pixel_total : 70802 time to create 1 rle with old method : 0.09359478950500488 length of segment : 261 time for calcul the mask position with numpy : 0.0043582916259765625 nb_pixel_total : 149794 time to create 1 rle with old method : 0.2185993194580078 length of segment : 383 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 44302 time to create 1 rle with old method : 0.05299019813537598 length of segment : 366 time for calcul the mask position with numpy : 0.012096166610717773 nb_pixel_total : 585851 time to create 1 rle with new method : 0.03808736801147461 length of segment : 803 time for calcul the mask position with numpy : 0.0011630058288574219 nb_pixel_total : 56493 time to create 1 rle with old method : 0.0696561336517334 length of segment : 318 time for calcul the mask position with numpy : 0.0008215904235839844 nb_pixel_total : 33319 time to create 1 rle with old method : 0.04081082344055176 length of segment : 169 time for calcul the mask position with numpy : 0.0017852783203125 nb_pixel_total : 76419 time to create 1 rle with old method : 0.09113860130310059 length of segment : 523 time for calcul the mask position with numpy : 0.0030450820922851562 nb_pixel_total : 136666 time to create 1 rle with old method : 0.16123723983764648 length of segment : 477 time for calcul the mask position with numpy : 0.0007765293121337891 nb_pixel_total : 40535 time to create 1 rle with old method : 0.048523902893066406 length of segment : 233 time for calcul the mask position with numpy : 0.003549814224243164 nb_pixel_total : 216400 time to create 1 rle with new method : 0.008577108383178711 length of segment : 647 time for calcul the mask position with numpy : 0.0013427734375 nb_pixel_total : 38208 time to create 1 rle with old method : 0.06168794631958008 length of segment : 356 time for calcul the mask position with numpy : 0.0038847923278808594 nb_pixel_total : 191229 time to create 1 rle with new method : 0.009302139282226562 length of segment : 401 time for calcul the mask position with numpy : 0.0008573532104492188 nb_pixel_total : 36247 time to create 1 rle with old method : 0.043842315673828125 length of segment : 158 time for calcul the mask position with numpy : 0.006159067153930664 nb_pixel_total : 320836 time to create 1 rle with new method : 0.013737201690673828 length of segment : 404 time for calcul the mask position with numpy : 0.0016803741455078125 nb_pixel_total : 58252 time to create 1 rle with old method : 0.06971168518066406 length of segment : 328 time for calcul the mask position with numpy : 0.0008444786071777344 nb_pixel_total : 27794 time to create 1 rle with old method : 0.03336787223815918 length of segment : 226 time for calcul the mask position with numpy : 0.0004105567932128906 nb_pixel_total : 16064 time to create 1 rle with old method : 0.019805908203125 length of segment : 117 time for calcul the mask position with numpy : 0.0017118453979492188 nb_pixel_total : 66873 time to create 1 rle with old method : 0.07950282096862793 length of segment : 309 time for calcul the mask position with numpy : 0.0008358955383300781 nb_pixel_total : 29270 time to create 1 rle with old method : 0.03513741493225098 length of segment : 436 time for calcul the mask position with numpy : 0.010128259658813477 nb_pixel_total : 335701 time to create 1 rle with new method : 0.03252387046813965 length of segment : 943 time for calcul the mask position with numpy : 0.0035774707794189453 nb_pixel_total : 159533 time to create 1 rle with new method : 0.009332418441772461 length of segment : 441 time for calcul the mask position with numpy : 0.0071697235107421875 nb_pixel_total : 321878 time to create 1 rle with new method : 0.01700568199157715 length of segment : 588 time for calcul the mask position with numpy : 0.011981010437011719 nb_pixel_total : 510380 time to create 1 rle with new method : 0.024224042892456055 length of segment : 881 time for calcul the mask position with numpy : 0.001104593276977539 nb_pixel_total : 49759 time to create 1 rle with old method : 0.05883955955505371 length of segment : 248 time for calcul the mask position with numpy : 0.002716541290283203 nb_pixel_total : 125643 time to create 1 rle with old method : 0.1472623348236084 length of segment : 375 time for calcul the mask position with numpy : 0.004974842071533203 nb_pixel_total : 156973 time to create 1 rle with new method : 0.014723539352416992 length of segment : 431 time for calcul the mask position with numpy : 0.0025751590728759766 nb_pixel_total : 98367 time to create 1 rle with old method : 0.1329941749572754 length of segment : 270 time for calcul the mask position with numpy : 0.001165628433227539 nb_pixel_total : 50685 time to create 1 rle with old method : 0.059401750564575195 length of segment : 239 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 33799 time to create 1 rle with old method : 0.04071235656738281 length of segment : 177 time for calcul the mask position with numpy : 0.005475521087646484 nb_pixel_total : 237061 time to create 1 rle with new method : 0.015216588973999023 length of segment : 559 time for calcul the mask position with numpy : 0.002801656723022461 nb_pixel_total : 131116 time to create 1 rle with old method : 0.16058731079101562 length of segment : 497 time for calcul the mask position with numpy : 0.0027294158935546875 nb_pixel_total : 156065 time to create 1 rle with new method : 0.006341218948364258 length of segment : 370 time for calcul the mask position with numpy : 0.0004260540008544922 nb_pixel_total : 15689 time to create 1 rle with old method : 0.019022703170776367 length of segment : 118 time for calcul the mask position with numpy : 0.037067413330078125 nb_pixel_total : 1291803 time to create 1 rle with new method : 0.22663354873657227 length of segment : 2554 time for calcul the mask position with numpy : 0.0023584365844726562 nb_pixel_total : 112604 time to create 1 rle with old method : 0.13143086433410645 length of segment : 412 time for calcul the mask position with numpy : 0.004029273986816406 nb_pixel_total : 209368 time to create 1 rle with new method : 0.009955883026123047 length of segment : 407 time for calcul the mask position with numpy : 0.0009424686431884766 nb_pixel_total : 50650 time to create 1 rle with old method : 0.059107303619384766 length of segment : 275 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 13484 time to create 1 rle with old method : 0.021941423416137695 length of segment : 126 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 54845 time to create 1 rle with old method : 0.07068419456481934 length of segment : 219 time for calcul the mask position with numpy : 0.012160539627075195 nb_pixel_total : 547219 time to create 1 rle with new method : 0.03979301452636719 length of segment : 775 time for calcul the mask position with numpy : 0.0027642250061035156 nb_pixel_total : 89165 time to create 1 rle with old method : 0.10386943817138672 length of segment : 289 time for calcul the mask position with numpy : 0.0033249855041503906 nb_pixel_total : 182176 time to create 1 rle with new method : 0.01059865951538086 length of segment : 556 time for calcul the mask position with numpy : 0.0015218257904052734 nb_pixel_total : 95286 time to create 1 rle with old method : 0.10956573486328125 length of segment : 322 time for calcul the mask position with numpy : 0.004488468170166016 nb_pixel_total : 187583 time to create 1 rle with new method : 0.014286994934082031 length of segment : 789 time for calcul the mask position with numpy : 0.0047054290771484375 nb_pixel_total : 240018 time to create 1 rle with new method : 0.010805368423461914 length of segment : 597 time for calcul the mask position with numpy : 0.009520530700683594 nb_pixel_total : 503453 time to create 1 rle with new method : 0.0223233699798584 length of segment : 1236 time for calcul the mask position with numpy : 0.0014281272888183594 nb_pixel_total : 74449 time to create 1 rle with old method : 0.08731245994567871 length of segment : 350 time for calcul the mask position with numpy : 0.0014374256134033203 nb_pixel_total : 71837 time to create 1 rle with old method : 0.08466410636901855 length of segment : 189 time for calcul the mask position with numpy : 0.004283428192138672 nb_pixel_total : 195314 time to create 1 rle with new method : 0.012463808059692383 length of segment : 437 time for calcul the mask position with numpy : 0.002475261688232422 nb_pixel_total : 149885 time to create 1 rle with old method : 0.19919991493225098 length of segment : 411 time for calcul the mask position with numpy : 0.0030694007873535156 nb_pixel_total : 185509 time to create 1 rle with new method : 0.008018016815185547 length of segment : 325 time for calcul the mask position with numpy : 0.002891063690185547 nb_pixel_total : 83418 time to create 1 rle with old method : 0.09911513328552246 length of segment : 497 time for calcul the mask position with numpy : 0.0019414424896240234 nb_pixel_total : 87880 time to create 1 rle with old method : 0.10175776481628418 length of segment : 511 time for calcul the mask position with numpy : 0.0011074542999267578 nb_pixel_total : 42144 time to create 1 rle with old method : 0.05035853385925293 length of segment : 214 time for calcul the mask position with numpy : 0.0048367977142333984 nb_pixel_total : 241035 time to create 1 rle with new method : 0.012230396270751953 length of segment : 563 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 18312 time to create 1 rle with old method : 0.021987438201904297 length of segment : 221 time for calcul the mask position with numpy : 0.005260467529296875 nb_pixel_total : 176077 time to create 1 rle with new method : 0.015227317810058594 length of segment : 612 time for calcul the mask position with numpy : 0.0009403228759765625 nb_pixel_total : 37165 time to create 1 rle with old method : 0.04420948028564453 length of segment : 197 time for calcul the mask position with numpy : 0.0019135475158691406 nb_pixel_total : 64676 time to create 1 rle with old method : 0.07709550857543945 length of segment : 376 time for calcul the mask position with numpy : 0.0010077953338623047 nb_pixel_total : 33424 time to create 1 rle with old method : 0.04070639610290527 length of segment : 203 time for calcul the mask position with numpy : 0.004104137420654297 nb_pixel_total : 176888 time to create 1 rle with new method : 0.01238703727722168 length of segment : 440 time for calcul the mask position with numpy : 0.013586282730102539 nb_pixel_total : 632740 time to create 1 rle with new method : 0.03282642364501953 length of segment : 797 time for calcul the mask position with numpy : 0.0026009082794189453 nb_pixel_total : 93931 time to create 1 rle with old method : 0.1114802360534668 length of segment : 357 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 26960 time to create 1 rle with old method : 0.03216814994812012 length of segment : 131 time for calcul the mask position with numpy : 0.0021390914916992188 nb_pixel_total : 113099 time to create 1 rle with old method : 0.13540244102478027 length of segment : 450 time for calcul the mask position with numpy : 0.001992464065551758 nb_pixel_total : 83168 time to create 1 rle with old method : 0.09638214111328125 length of segment : 295 time for calcul the mask position with numpy : 0.012355804443359375 nb_pixel_total : 526750 time to create 1 rle with new method : 0.02783966064453125 length of segment : 1193 time for calcul the mask position with numpy : 0.001924276351928711 nb_pixel_total : 97288 time to create 1 rle with old method : 0.138200044631958 length of segment : 341 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 52830 time to create 1 rle with old method : 0.06493091583251953 length of segment : 200 time for calcul the mask position with numpy : 0.0012466907501220703 nb_pixel_total : 74036 time to create 1 rle with old method : 0.08708786964416504 length of segment : 249 time for calcul the mask position with numpy : 0.006050586700439453 nb_pixel_total : 272466 time to create 1 rle with new method : 0.017265796661376953 length of segment : 738 time for calcul the mask position with numpy : 0.0033550262451171875 nb_pixel_total : 149899 time to create 1 rle with old method : 0.17434263229370117 length of segment : 383 time for calcul the mask position with numpy : 0.002394437789916992 nb_pixel_total : 82691 time to create 1 rle with old method : 0.09873533248901367 length of segment : 240 time for calcul the mask position with numpy : 0.0014634132385253906 nb_pixel_total : 52452 time to create 1 rle with old method : 0.06278371810913086 length of segment : 255 time for calcul the mask position with numpy : 0.001537322998046875 nb_pixel_total : 67464 time to create 1 rle with old method : 0.08184170722961426 length of segment : 330 time for calcul the mask position with numpy : 0.0008087158203125 nb_pixel_total : 34093 time to create 1 rle with old method : 0.0403592586517334 length of segment : 299 time for calcul the mask position with numpy : 0.0017697811126708984 nb_pixel_total : 94552 time to create 1 rle with old method : 0.1116795539855957 length of segment : 280 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 46487 time to create 1 rle with old method : 0.05698537826538086 length of segment : 254 time for calcul the mask position with numpy : 0.0007781982421875 nb_pixel_total : 31599 time to create 1 rle with old method : 0.039315223693847656 length of segment : 198 time for calcul the mask position with numpy : 0.0036780834197998047 nb_pixel_total : 191028 time to create 1 rle with new method : 0.010192394256591797 length of segment : 486 time for calcul the mask position with numpy : 0.0013594627380371094 nb_pixel_total : 18992 time to create 1 rle with old method : 0.023183107376098633 length of segment : 344 time for calcul the mask position with numpy : 0.01123809814453125 nb_pixel_total : 410030 time to create 1 rle with new method : 0.032994985580444336 length of segment : 1279 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 21918 time to create 1 rle with old method : 0.02751922607421875 length of segment : 124 time for calcul the mask position with numpy : 0.0036270618438720703 nb_pixel_total : 132754 time to create 1 rle with old method : 0.16032004356384277 length of segment : 561 time for calcul the mask position with numpy : 0.0018780231475830078 nb_pixel_total : 92862 time to create 1 rle with old method : 0.10825729370117188 length of segment : 388 time for calcul the mask position with numpy : 0.007421255111694336 nb_pixel_total : 347752 time to create 1 rle with new method : 0.020569801330566406 length of segment : 867 time for calcul the mask position with numpy : 0.0016326904296875 nb_pixel_total : 81728 time to create 1 rle with old method : 0.11393380165100098 length of segment : 395 time for calcul the mask position with numpy : 0.011997461318969727 nb_pixel_total : 256188 time to create 1 rle with new method : 0.027522802352905273 length of segment : 842 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 43824 time to create 1 rle with old method : 0.05179119110107422 length of segment : 255 time for calcul the mask position with numpy : 0.0032112598419189453 nb_pixel_total : 138236 time to create 1 rle with old method : 0.16438603401184082 length of segment : 433 time for calcul the mask position with numpy : 0.002296924591064453 nb_pixel_total : 101109 time to create 1 rle with old method : 0.11841845512390137 length of segment : 567 time for calcul the mask position with numpy : 0.0011074542999267578 nb_pixel_total : 57549 time to create 1 rle with old method : 0.06717610359191895 length of segment : 194 time for calcul the mask position with numpy : 0.0018758773803710938 nb_pixel_total : 82549 time to create 1 rle with old method : 0.09735918045043945 length of segment : 379 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 39005 time to create 1 rle with old method : 0.04791855812072754 length of segment : 231 time for calcul the mask position with numpy : 0.001081705093383789 nb_pixel_total : 51630 time to create 1 rle with old method : 0.06591367721557617 length of segment : 182 time for calcul the mask position with numpy : 0.0103759765625 nb_pixel_total : 353860 time to create 1 rle with new method : 0.029056549072265625 length of segment : 703 time for calcul the mask position with numpy : 0.019304990768432617 nb_pixel_total : 927105 time to create 1 rle with new method : 0.09513497352600098 length of segment : 1025 time for calcul the mask position with numpy : 0.0006909370422363281 nb_pixel_total : 26148 time to create 1 rle with old method : 0.03156304359436035 length of segment : 183 time for calcul the mask position with numpy : 0.0015707015991210938 nb_pixel_total : 45357 time to create 1 rle with old method : 0.05747675895690918 length of segment : 217 time for calcul the mask position with numpy : 0.0014879703521728516 nb_pixel_total : 71261 time to create 1 rle with old method : 0.10900259017944336 length of segment : 342 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 16350 time to create 1 rle with old method : 0.019878625869750977 length of segment : 100 time for calcul the mask position with numpy : 0.0008437633514404297 nb_pixel_total : 36870 time to create 1 rle with old method : 0.04439902305603027 length of segment : 252 time for calcul the mask position with numpy : 0.0021810531616210938 nb_pixel_total : 87694 time to create 1 rle with old method : 0.1029655933380127 length of segment : 386 time for calcul the mask position with numpy : 0.006110429763793945 nb_pixel_total : 264476 time to create 1 rle with new method : 0.016693830490112305 length of segment : 872 time for calcul the mask position with numpy : 0.0022614002227783203 nb_pixel_total : 92295 time to create 1 rle with old method : 0.10775423049926758 length of segment : 481 time for calcul the mask position with numpy : 0.029267549514770508 nb_pixel_total : 1104992 time to create 1 rle with new method : 0.24976658821105957 length of segment : 2109 time for calcul the mask position with numpy : 0.002122163772583008 nb_pixel_total : 88198 time to create 1 rle with old method : 0.10524773597717285 length of segment : 398 time for calcul the mask position with numpy : 0.0014216899871826172 nb_pixel_total : 68670 time to create 1 rle with old method : 0.08064913749694824 length of segment : 237 time for calcul the mask position with numpy : 0.006880521774291992 nb_pixel_total : 357143 time to create 1 rle with new method : 0.01952385902404785 length of segment : 564 time for calcul the mask position with numpy : 0.01589202880859375 nb_pixel_total : 428324 time to create 1 rle with new method : 0.08742403984069824 length of segment : 1140 time for calcul the mask position with numpy : 0.0014901161193847656 nb_pixel_total : 69197 time to create 1 rle with old method : 0.08176922798156738 length of segment : 249 time for calcul the mask position with numpy : 0.0016875267028808594 nb_pixel_total : 54680 time to create 1 rle with old method : 0.06671714782714844 length of segment : 368 time for calcul the mask position with numpy : 0.002657175064086914 nb_pixel_total : 149800 time to create 1 rle with old method : 0.1996145248413086 length of segment : 579 time for calcul the mask position with numpy : 0.010451316833496094 nb_pixel_total : 432888 time to create 1 rle with new method : 0.02650928497314453 length of segment : 698 time for calcul the mask position with numpy : 0.0009291172027587891 nb_pixel_total : 37768 time to create 1 rle with old method : 0.04495811462402344 length of segment : 293 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 46403 time to create 1 rle with old method : 0.0564272403717041 length of segment : 194 time for calcul the mask position with numpy : 0.0007731914520263672 nb_pixel_total : 39911 time to create 1 rle with old method : 0.056806325912475586 length of segment : 172 time for calcul the mask position with numpy : 0.003065824508666992 nb_pixel_total : 124080 time to create 1 rle with old method : 0.15060663223266602 length of segment : 340 time for calcul the mask position with numpy : 0.008445024490356445 nb_pixel_total : 500557 time to create 1 rle with new method : 0.017607927322387695 length of segment : 695 time for calcul the mask position with numpy : 0.0006878376007080078 nb_pixel_total : 17611 time to create 1 rle with old method : 0.021641969680786133 length of segment : 170 time for calcul the mask position with numpy : 0.0006606578826904297 nb_pixel_total : 27466 time to create 1 rle with old method : 0.0333406925201416 length of segment : 239 time for calcul the mask position with numpy : 0.0007505416870117188 nb_pixel_total : 34941 time to create 1 rle with old method : 0.04148578643798828 length of segment : 359 time for calcul the mask position with numpy : 0.0006160736083984375 nb_pixel_total : 27824 time to create 1 rle with old method : 0.03321504592895508 length of segment : 199 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 50984 time to create 1 rle with old method : 0.06039595603942871 length of segment : 218 time for calcul the mask position with numpy : 0.0028350353240966797 nb_pixel_total : 155774 time to create 1 rle with new method : 0.00680994987487793 length of segment : 386 time for calcul the mask position with numpy : 0.0016522407531738281 nb_pixel_total : 103449 time to create 1 rle with old method : 0.12148880958557129 length of segment : 712 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 36420 time to create 1 rle with old method : 0.04388904571533203 length of segment : 193 time for calcul the mask position with numpy : 0.010148048400878906 nb_pixel_total : 457988 time to create 1 rle with new method : 0.02523016929626465 length of segment : 831 time for calcul the mask position with numpy : 0.005576372146606445 nb_pixel_total : 207497 time to create 1 rle with new method : 0.014854907989501953 length of segment : 656 time for calcul the mask position with numpy : 0.0013332366943359375 nb_pixel_total : 63056 time to create 1 rle with old method : 0.0746314525604248 length of segment : 252 time for calcul the mask position with numpy : 0.0016503334045410156 nb_pixel_total : 93935 time to create 1 rle with old method : 0.1137685775756836 length of segment : 275 time for calcul the mask position with numpy : 0.0013141632080078125 nb_pixel_total : 72146 time to create 1 rle with old method : 0.08511877059936523 length of segment : 314 time for calcul the mask position with numpy : 0.005006313323974609 nb_pixel_total : 310421 time to create 1 rle with new method : 0.013152360916137695 length of segment : 654 time for calcul the mask position with numpy : 0.0014753341674804688 nb_pixel_total : 40792 time to create 1 rle with old method : 0.04920554161071777 length of segment : 526 time for calcul the mask position with numpy : 0.003483295440673828 nb_pixel_total : 191871 time to create 1 rle with new method : 0.009061098098754883 length of segment : 427 time for calcul the mask position with numpy : 0.0026869773864746094 nb_pixel_total : 84732 time to create 1 rle with old method : 0.10239744186401367 length of segment : 536 time for calcul the mask position with numpy : 0.001094818115234375 nb_pixel_total : 51411 time to create 1 rle with old method : 0.06131267547607422 length of segment : 299 time for calcul the mask position with numpy : 0.001329660415649414 nb_pixel_total : 58715 time to create 1 rle with old method : 0.06967854499816895 length of segment : 264 time for calcul the mask position with numpy : 0.004732847213745117 nb_pixel_total : 189806 time to create 1 rle with new method : 0.014081001281738281 length of segment : 493 time for calcul the mask position with numpy : 0.0010340213775634766 nb_pixel_total : 50199 time to create 1 rle with old method : 0.06005096435546875 length of segment : 246 time for calcul the mask position with numpy : 0.0008890628814697266 nb_pixel_total : 45883 time to create 1 rle with old method : 0.05508017539978027 length of segment : 254 time for calcul the mask position with numpy : 0.0023283958435058594 nb_pixel_total : 84935 time to create 1 rle with old method : 0.11761188507080078 length of segment : 224 time for calcul the mask position with numpy : 0.01993417739868164 nb_pixel_total : 552813 time to create 1 rle with new method : 0.22349810600280762 length of segment : 883 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 14571 time to create 1 rle with old method : 0.018007278442382812 length of segment : 116 time for calcul the mask position with numpy : 0.0028374195098876953 nb_pixel_total : 134677 time to create 1 rle with old method : 0.1589953899383545 length of segment : 317 time for calcul the mask position with numpy : 0.0004572868347167969 nb_pixel_total : 20052 time to create 1 rle with old method : 0.025812149047851562 length of segment : 146 time for calcul the mask position with numpy : 0.0011649131774902344 nb_pixel_total : 40903 time to create 1 rle with old method : 0.048560142517089844 length of segment : 248 time for calcul the mask position with numpy : 0.003530740737915039 nb_pixel_total : 149094 time to create 1 rle with old method : 0.17806744575500488 length of segment : 324 time for calcul the mask position with numpy : 0.00535893440246582 nb_pixel_total : 267964 time to create 1 rle with new method : 0.014228105545043945 length of segment : 582 time for calcul the mask position with numpy : 0.01323843002319336 nb_pixel_total : 643755 time to create 1 rle with new method : 0.04867410659790039 length of segment : 717 time for calcul the mask position with numpy : 0.0009217262268066406 nb_pixel_total : 44615 time to create 1 rle with old method : 0.05288863182067871 length of segment : 186 time for calcul the mask position with numpy : 0.0031633377075195312 nb_pixel_total : 155428 time to create 1 rle with new method : 0.008831501007080078 length of segment : 386 time for calcul the mask position with numpy : 0.004236698150634766 nb_pixel_total : 270552 time to create 1 rle with new method : 0.011946439743041992 length of segment : 644 time for calcul the mask position with numpy : 0.003541707992553711 nb_pixel_total : 181473 time to create 1 rle with new method : 0.010388612747192383 length of segment : 513 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 11718 time to create 1 rle with old method : 0.014617204666137695 length of segment : 173 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 33888 time to create 1 rle with old method : 0.04093575477600098 length of segment : 174 time for calcul the mask position with numpy : 0.0011606216430664062 nb_pixel_total : 64634 time to create 1 rle with old method : 0.0770423412322998 length of segment : 225 time for calcul the mask position with numpy : 0.0017583370208740234 nb_pixel_total : 95872 time to create 1 rle with old method : 0.11479854583740234 length of segment : 300 time for calcul the mask position with numpy : 0.017071247100830078 nb_pixel_total : 872850 time to create 1 rle with new method : 0.07257843017578125 length of segment : 1066 time for calcul the mask position with numpy : 0.0399320125579834 nb_pixel_total : 1410490 time to create 1 rle with new method : 0.2402329444885254 length of segment : 1296 time for calcul the mask position with numpy : 0.0022687911987304688 nb_pixel_total : 111755 time to create 1 rle with old method : 0.14632391929626465 length of segment : 393 time for calcul the mask position with numpy : 0.002010822296142578 nb_pixel_total : 111240 time to create 1 rle with old method : 0.12551569938659668 length of segment : 379 time for calcul the mask position with numpy : 0.0009524822235107422 nb_pixel_total : 51173 time to create 1 rle with old method : 0.060137033462524414 length of segment : 192 time for calcul the mask position with numpy : 0.0019707679748535156 nb_pixel_total : 108784 time to create 1 rle with old method : 0.12633061408996582 length of segment : 250 time for calcul the mask position with numpy : 0.0039021968841552734 nb_pixel_total : 208907 time to create 1 rle with new method : 0.010971546173095703 length of segment : 456 time for calcul the mask position with numpy : 0.001222848892211914 nb_pixel_total : 68441 time to create 1 rle with old method : 0.08071660995483398 length of segment : 346 time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 28198 time to create 1 rle with old method : 0.034208059310913086 length of segment : 149 time for calcul the mask position with numpy : 0.00817728042602539 nb_pixel_total : 302655 time to create 1 rle with new method : 0.031081438064575195 length of segment : 1119 time for calcul the mask position with numpy : 0.0054056644439697266 nb_pixel_total : 330763 time to create 1 rle with new method : 0.012455940246582031 length of segment : 569 time for calcul the mask position with numpy : 0.014741182327270508 nb_pixel_total : 658362 time to create 1 rle with new method : 0.07681536674499512 length of segment : 991 time for calcul the mask position with numpy : 0.0006787776947021484 nb_pixel_total : 37898 time to create 1 rle with old method : 0.043933868408203125 length of segment : 204 time for calcul the mask position with numpy : 0.0010311603546142578 nb_pixel_total : 50736 time to create 1 rle with old method : 0.06116032600402832 length of segment : 283 time for calcul the mask position with numpy : 0.0013549327850341797 nb_pixel_total : 78925 time to create 1 rle with old method : 0.09160137176513672 length of segment : 255 time for calcul the mask position with numpy : 0.0011200904846191406 nb_pixel_total : 42938 time to create 1 rle with old method : 0.05861663818359375 length of segment : 276 time for calcul the mask position with numpy : 0.0007250308990478516 nb_pixel_total : 29613 time to create 1 rle with old method : 0.0355374813079834 length of segment : 264 time for calcul the mask position with numpy : 0.003268003463745117 nb_pixel_total : 213173 time to create 1 rle with new method : 0.008558273315429688 length of segment : 541 time for calcul the mask position with numpy : 0.0009262561798095703 nb_pixel_total : 21180 time to create 1 rle with old method : 0.02588486671447754 length of segment : 297 time for calcul the mask position with numpy : 0.0020389556884765625 nb_pixel_total : 124184 time to create 1 rle with old method : 0.14790081977844238 length of segment : 617 time for calcul the mask position with numpy : 0.0016498565673828125 nb_pixel_total : 129165 time to create 1 rle with old method : 0.14693546295166016 length of segment : 328 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 35254 time to create 1 rle with old method : 0.04096055030822754 length of segment : 193 time for calcul the mask position with numpy : 0.0028281211853027344 nb_pixel_total : 186114 time to create 1 rle with new method : 0.007903099060058594 length of segment : 492 time for calcul the mask position with numpy : 0.0006222724914550781 nb_pixel_total : 29821 time to create 1 rle with old method : 0.034009695053100586 length of segment : 185 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 41341 time to create 1 rle with old method : 0.04621386528015137 length of segment : 209 time for calcul the mask position with numpy : 0.0008985996246337891 nb_pixel_total : 54512 time to create 1 rle with old method : 0.06132197380065918 length of segment : 303 time for calcul the mask position with numpy : 0.0012180805206298828 nb_pixel_total : 72926 time to create 1 rle with old method : 0.08263635635375977 length of segment : 281 time for calcul the mask position with numpy : 0.0007870197296142578 nb_pixel_total : 49343 time to create 1 rle with old method : 0.05612015724182129 length of segment : 239 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 26133 time to create 1 rle with old method : 0.03135371208190918 length of segment : 161 time for calcul the mask position with numpy : 0.008156538009643555 nb_pixel_total : 420994 time to create 1 rle with new method : 0.020145416259765625 length of segment : 488 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 17411 time to create 1 rle with old method : 0.021521568298339844 length of segment : 143 time for calcul the mask position with numpy : 0.0011332035064697266 nb_pixel_total : 64899 time to create 1 rle with old method : 0.0754542350769043 length of segment : 305 time for calcul the mask position with numpy : 0.002694368362426758 nb_pixel_total : 170436 time to create 1 rle with new method : 0.006981372833251953 length of segment : 448 time for calcul the mask position with numpy : 0.0009427070617675781 nb_pixel_total : 51907 time to create 1 rle with old method : 0.05942893028259277 length of segment : 349 time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 47607 time to create 1 rle with old method : 0.0548708438873291 length of segment : 368 time for calcul the mask position with numpy : 1.0063576698303223 nb_pixel_total : 7909169 time to create 1 rle with new method : 1.0016560554504395 length of segment : 4647 time for calcul the mask position with numpy : 0.0019676685333251953 nb_pixel_total : 130691 time to create 1 rle with old method : 0.2947111129760742 length of segment : 256 time for calcul the mask position with numpy : 0.004020214080810547 nb_pixel_total : 289150 time to create 1 rle with new method : 0.007129192352294922 length of segment : 450 time for calcul the mask position with numpy : 0.023649930953979492 nb_pixel_total : 1043044 time to create 1 rle with new method : 0.06993818283081055 length of segment : 978 time for calcul the mask position with numpy : 0.6279544830322266 nb_pixel_total : 1200215 time to create 1 rle with new method : 0.3909645080566406 length of segment : 2066 time for calcul the mask position with numpy : 0.6555852890014648 nb_pixel_total : 6465928 time to create 1 rle with new method : 1.3452730178833008 length of segment : 4575 time for calcul the mask position with numpy : 0.003305673599243164 nb_pixel_total : 151785 time to create 1 rle with new method : 0.009459972381591797 length of segment : 643 time for calcul the mask position with numpy : 0.016244888305664062 nb_pixel_total : 1027537 time to create 1 rle with new method : 0.08217024803161621 length of segment : 899 time for calcul the mask position with numpy : 0.0015513896942138672 nb_pixel_total : 118728 time to create 1 rle with old method : 0.13220763206481934 length of segment : 605 time for calcul the mask position with numpy : 0.0003139972686767578 nb_pixel_total : 22501 time to create 1 rle with old method : 0.026493549346923828 length of segment : 162 time for calcul the mask position with numpy : 0.0009210109710693359 nb_pixel_total : 34850 time to create 1 rle with old method : 0.04345250129699707 length of segment : 193 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 247046 time to create 1 rle with new method : 0.030286550521850586 length of segment : 1098 time for calcul the mask position with numpy : 0.0007526874542236328 nb_pixel_total : 48640 time to create 1 rle with old method : 0.05847811698913574 length of segment : 133 time for calcul the mask position with numpy : 0.0009913444519042969 nb_pixel_total : 70782 time to create 1 rle with old method : 0.08509540557861328 length of segment : 251 time for calcul the mask position with numpy : 0.004655122756958008 nb_pixel_total : 343295 time to create 1 rle with new method : 0.011259078979492188 length of segment : 663 time spent for convertir_results : 60.89302659034729 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 335 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 147.51659846305847 time spend to save output : 0.19135141372680664 total time spend for step 2 : 147.70794987678528 step3:blur_detection Tue May 6 17:45:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 995.6443410907566 (3120, 4160) 4662.018021972973 (3120, 4160) 4208.3290057896575 (3120, 4160) 3034.2725583232705 (3120, 4160) 3071.399476237449 (3120, 4160) 127.61887722167494 (3120, 4160) 913.5448104385467 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.014096260070800781 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.014560461044311523 save missing photos in datou_result : time spend for datou_step_exec : 2.829920530319214 time spend to save output : 0.03306102752685547 total time spend for step 3 : 2.8629815578460693 step4:brightness Tue May 6 17:45:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746546089_1238181_1356361583_7b48e1205bc7058301c42d5ab2dc88dc.jpg treat image : temp/1746546089_1238181_1356361548_5f24ee07919a73b63d4b5b733dcf967b.jpg treat image : temp/1746546089_1238181_1356361543_87c0125d4fe4d07ee31d83d67756276b.jpg treat image : temp/1746546089_1238181_1356361537_f743a79feda1fe16aece8c6b893ca885.jpg treat image : temp/1746546089_1238181_1356361530_55ced77b8fa8c913e649fa29adc74198.jpg treat image : temp/1746546089_1238181_1356361523_cc921dd8363b8c76355fe047a19e414f.jpg treat image : temp/1746546089_1238181_1356361517_59940e0b89603891604d9a24c7a41f53.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.013682126998901367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.011991500854492188 save missing photos in datou_result : time spend for datou_step_exec : 12.428045749664307 time spend to save output : 0.030028581619262695 total time spend for step 4 : 12.45807433128357 step5:rle_unique_nms_with_priority Tue May 6 17:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 335 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 22 nb_hashtags : 5 time to prepare the origin masks : 62.89677119255066 time for calcul the mask position with numpy : 0.4827609062194824 nb_pixel_total : 1708515 time to create 1 rle with new method : 1.1654369831085205 time for calcul the mask position with numpy : 0.054111480712890625 nb_pixel_total : 110105 time to create 1 rle with old method : 0.1305382251739502 time for calcul the mask position with numpy : 0.052911996841430664 nb_pixel_total : 323023 time to create 1 rle with new method : 1.4793224334716797 time for calcul the mask position with numpy : 0.05567026138305664 nb_pixel_total : 676305 time to create 1 rle with new method : 0.9407124519348145 time for calcul the mask position with numpy : 0.056883811950683594 nb_pixel_total : 318187 time to create 1 rle with new method : 1.4975337982177734 time for calcul the mask position with numpy : 0.4093356132507324 nb_pixel_total : 4651589 time to create 1 rle with new method : 1.299605131149292 time for calcul the mask position with numpy : 0.3244447708129883 nb_pixel_total : 2238904 time to create 1 rle with new method : 1.5662462711334229 time for calcul the mask position with numpy : 0.06629729270935059 nb_pixel_total : 482189 time to create 1 rle with new method : 1.043656349182129 time for calcul the mask position with numpy : 0.053262948989868164 nb_pixel_total : 17553 time to create 1 rle with old method : 0.020527362823486328 time for calcul the mask position with numpy : 0.05720353126525879 nb_pixel_total : 372973 time to create 1 rle with new method : 0.703228235244751 time for calcul the mask position with numpy : 0.05466341972351074 nb_pixel_total : 84639 time to create 1 rle with old method : 0.0990591049194336 time for calcul the mask position with numpy : 0.062413930892944336 nb_pixel_total : 686498 time to create 1 rle with new method : 1.5113940238952637 time for calcul the mask position with numpy : 0.06154346466064453 nb_pixel_total : 907688 time to create 1 rle with new method : 0.9958829879760742 time for calcul the mask position with numpy : 0.05444073677062988 nb_pixel_total : 38920 time to create 1 rle with old method : 0.04567670822143555 time for calcul the mask position with numpy : 0.05260181427001953 nb_pixel_total : 3902 time to create 1 rle with old method : 0.004565000534057617 time for calcul the mask position with numpy : 0.0524594783782959 nb_pixel_total : 10397 time to create 1 rle with old method : 0.012114524841308594 time for calcul the mask position with numpy : 0.05411219596862793 nb_pixel_total : 21303 time to create 1 rle with old method : 0.03182220458984375 time for calcul the mask position with numpy : 0.06094694137573242 nb_pixel_total : 1301 time to create 1 rle with old method : 0.0019049644470214844 time for calcul the mask position with numpy : 0.054361820220947266 nb_pixel_total : 4964 time to create 1 rle with old method : 0.005956411361694336 time for calcul the mask position with numpy : 0.052400827407836914 nb_pixel_total : 17 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.05265402793884277 nb_pixel_total : 6474 time to create 1 rle with old method : 0.007708549499511719 time for calcul the mask position with numpy : 0.0534207820892334 nb_pixel_total : 83129 time to create 1 rle with old method : 0.09475231170654297 time for calcul the mask position with numpy : 0.05313253402709961 nb_pixel_total : 230625 time to create 1 rle with new method : 1.098987102508545 create new chi : 16.616567611694336 time to delete rle : 0.03588104248046875 batch 1 Loaded 23 chid ids of type : 4855 Number RLEs to save : 53112 TO DO : save crop sub photo not yet done ! save time : 2.910616874694824 nb_obj : 80 nb_hashtags : 10 time to prepare the origin masks : 61.87150812149048 time for calcul the mask position with numpy : 0.9629037380218506 nb_pixel_total : 5212523 time to create 1 rle with new method : 1.0418922901153564 time for calcul the mask position with numpy : 0.054598331451416016 nb_pixel_total : 99292 time to create 1 rle with old method : 0.1162102222442627 time for calcul the mask position with numpy : 0.059721946716308594 nb_pixel_total : 26406 time to create 1 rle with old method : 0.039386749267578125 time for calcul the mask position with numpy : 0.26564812660217285 nb_pixel_total : 404300 time to create 1 rle with new method : 1.561903953552246 time for calcul the mask position with numpy : 0.053986310958862305 nb_pixel_total : 36080 time to create 1 rle with old method : 0.04237771034240723 time for calcul the mask position with numpy : 0.0526275634765625 nb_pixel_total : 70662 time to create 1 rle with old method : 0.08252978324890137 time for calcul the mask position with numpy : 0.06560707092285156 nb_pixel_total : 799484 time to create 1 rle with new method : 1.147618055343628 time for calcul the mask position with numpy : 0.05945587158203125 nb_pixel_total : 35005 time to create 1 rle with old method : 0.041074275970458984 time for calcul the mask position with numpy : 0.05268406867980957 nb_pixel_total : 39025 time to create 1 rle with old method : 0.045004844665527344 time for calcul the mask position with numpy : 0.052490949630737305 nb_pixel_total : 36369 time to create 1 rle with old method : 0.041417598724365234 time for calcul the mask position with numpy : 0.054886579513549805 nb_pixel_total : 301845 time to create 1 rle with new method : 1.0288302898406982 time for calcul the mask position with numpy : 0.05707073211669922 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0013897418975830078 time for calcul the mask position with numpy : 0.05335569381713867 nb_pixel_total : 124168 time to create 1 rle with old method : 0.17373967170715332 time for calcul the mask position with numpy : 0.05699944496154785 nb_pixel_total : 43431 time to create 1 rle with old method : 0.05101585388183594 time for calcul the mask position with numpy : 0.05475354194641113 nb_pixel_total : 149393 time to create 1 rle with old method : 0.18022823333740234 time for calcul the mask position with numpy : 0.05513310432434082 nb_pixel_total : 132416 time to create 1 rle with old method : 0.15642690658569336 time for calcul the mask position with numpy : 0.05317425727844238 nb_pixel_total : 38475 time to create 1 rle with old method : 0.04373311996459961 time for calcul the mask position with numpy : 0.054303646087646484 nb_pixel_total : 149194 time to create 1 rle with old method : 0.1839742660522461 time for calcul the mask position with numpy : 0.057160139083862305 nb_pixel_total : 566245 time to create 1 rle with new method : 3.0328030586242676 time for calcul the mask position with numpy : 0.0537867546081543 nb_pixel_total : 3088 time to create 1 rle with old method : 0.003710031509399414 time for calcul the mask position with numpy : 0.06243324279785156 nb_pixel_total : 14067 time to create 1 rle with old method : 0.01710653305053711 time for calcul the mask position with numpy : 0.05381131172180176 nb_pixel_total : 24178 time to create 1 rle with old method : 0.027746915817260742 time for calcul the mask position with numpy : 0.05507612228393555 nb_pixel_total : 197982 time to create 1 rle with new method : 1.124467134475708 time for calcul the mask position with numpy : 0.052573442459106445 nb_pixel_total : 6554 time to create 1 rle with old method : 0.007833480834960938 time for calcul the mask position with numpy : 0.05739736557006836 nb_pixel_total : 68120 time to create 1 rle with old method : 0.0779726505279541 time for calcul the mask position with numpy : 0.05433917045593262 nb_pixel_total : 6402 time to create 1 rle with old method : 0.007123231887817383 time for calcul the mask position with numpy : 0.05578184127807617 nb_pixel_total : 437987 time to create 1 rle with new method : 1.7195158004760742 time for calcul the mask position with numpy : 0.053076744079589844 nb_pixel_total : 17276 time to create 1 rle with old method : 0.020397186279296875 time for calcul the mask position with numpy : 0.05292868614196777 nb_pixel_total : 921 time to create 1 rle with old method : 0.0012030601501464844 time for calcul the mask position with numpy : 0.0534515380859375 nb_pixel_total : 58057 time to create 1 rle with old method : 0.06731438636779785 time for calcul the mask position with numpy : 0.05408048629760742 nb_pixel_total : 49485 time to create 1 rle with old method : 0.06233930587768555 time for calcul the mask position with numpy : 0.054277658462524414 nb_pixel_total : 33710 time to create 1 rle with old method : 0.04500746726989746 time for calcul the mask position with numpy : 0.06850361824035645 nb_pixel_total : 545625 time to create 1 rle with new method : 1.0634682178497314 time for calcul the mask position with numpy : 0.053678035736083984 nb_pixel_total : 38171 time to create 1 rle with old method : 0.04690217971801758 time for calcul the mask position with numpy : 0.05465197563171387 nb_pixel_total : 72015 time to create 1 rle with old method : 0.08453631401062012 time for calcul the mask position with numpy : 0.054405927658081055 nb_pixel_total : 4387 time to create 1 rle with old method : 0.005372524261474609 time for calcul the mask position with numpy : 0.056062936782836914 nb_pixel_total : 212079 time to create 1 rle with new method : 1.0757451057434082 time for calcul the mask position with numpy : 0.05358529090881348 nb_pixel_total : 93621 time to create 1 rle with old method : 0.10660696029663086 time for calcul the mask position with numpy : 0.051813364028930664 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0019941329956054688 time for calcul the mask position with numpy : 0.06034541130065918 nb_pixel_total : 44369 time to create 1 rle with old method : 0.050872087478637695 time for calcul the mask position with numpy : 0.05307793617248535 nb_pixel_total : 37394 time to create 1 rle with old method : 0.05051922798156738 time for calcul the mask position with numpy : 0.05254817008972168 nb_pixel_total : 20254 time to create 1 rle with old method : 0.024338245391845703 time for calcul the mask position with numpy : 0.05314970016479492 nb_pixel_total : 32517 time to create 1 rle with old method : 0.03721117973327637 time for calcul the mask position with numpy : 0.054204702377319336 nb_pixel_total : 27345 time to create 1 rle with old method : 0.03299069404602051 time for calcul the mask position with numpy : 0.05444765090942383 nb_pixel_total : 39665 time to create 1 rle with old method : 0.046260833740234375 time for calcul the mask position with numpy : 0.05423927307128906 nb_pixel_total : 7950 time to create 1 rle with old method : 0.009556293487548828 time for calcul the mask position with numpy : 0.05304360389709473 nb_pixel_total : 27602 time to create 1 rle with old method : 0.03243088722229004 time for calcul the mask position with numpy : 0.05399346351623535 nb_pixel_total : 17027 time to create 1 rle with old method : 0.022173643112182617 time for calcul the mask position with numpy : 0.06631612777709961 nb_pixel_total : 584942 time to create 1 rle with new method : 0.9860517978668213 time for calcul the mask position with numpy : 0.056571006774902344 nb_pixel_total : 12532 time to create 1 rle with old method : 0.01417398452758789 time for calcul the mask position with numpy : 0.05229592323303223 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0019063949584960938 time for calcul the mask position with numpy : 0.05206012725830078 nb_pixel_total : 22348 time to create 1 rle with old method : 0.025493144989013672 time for calcul the mask position with numpy : 0.05421757698059082 nb_pixel_total : 101089 time to create 1 rle with old method : 0.11903023719787598 time for calcul the mask position with numpy : 0.05608081817626953 nb_pixel_total : 110342 time to create 1 rle with old method : 0.1526484489440918 time for calcul the mask position with numpy : 0.053902626037597656 nb_pixel_total : 14594 time to create 1 rle with old method : 0.017276525497436523 time for calcul the mask position with numpy : 0.05457639694213867 nb_pixel_total : 121168 time to create 1 rle with old method : 0.14341092109680176 time for calcul the mask position with numpy : 0.05295276641845703 nb_pixel_total : 2904 time to create 1 rle with old method : 0.003386259078979492 time for calcul the mask position with numpy : 0.05396461486816406 nb_pixel_total : 136568 time to create 1 rle with old method : 0.1738450527191162 time for calcul the mask position with numpy : 0.05851912498474121 nb_pixel_total : 95136 time to create 1 rle with old method : 0.13152360916137695 time for calcul the mask position with numpy : 0.05450582504272461 nb_pixel_total : 69099 time to create 1 rle with old method : 0.08811497688293457 time for calcul the mask position with numpy : 0.060883522033691406 nb_pixel_total : 27686 time to create 1 rle with old method : 0.03274416923522949 time for calcul the mask position with numpy : 0.056412696838378906 nb_pixel_total : 88409 time to create 1 rle with old method : 0.10930514335632324 time for calcul the mask position with numpy : 0.05434870719909668 nb_pixel_total : 59185 time to create 1 rle with old method : 0.06908631324768066 time for calcul the mask position with numpy : 0.05380892753601074 nb_pixel_total : 31920 time to create 1 rle with old method : 0.03754615783691406 time for calcul the mask position with numpy : 0.054175615310668945 nb_pixel_total : 76333 time to create 1 rle with old method : 0.09274959564208984 time for calcul the mask position with numpy : 0.0520474910736084 nb_pixel_total : 95514 time to create 1 rle with old method : 0.1362898349761963 time for calcul the mask position with numpy : 0.050611257553100586 nb_pixel_total : 42638 time to create 1 rle with old method : 0.04699897766113281 time for calcul the mask position with numpy : 0.052294254302978516 nb_pixel_total : 8218 time to create 1 rle with old method : 0.009408712387084961 time for calcul the mask position with numpy : 0.0529937744140625 nb_pixel_total : 39464 time to create 1 rle with old method : 0.044615745544433594 time for calcul the mask position with numpy : 0.052239418029785156 nb_pixel_total : 3925 time to create 1 rle with old method : 0.004503011703491211 time for calcul the mask position with numpy : 0.05406045913696289 nb_pixel_total : 136551 time to create 1 rle with old method : 0.15875506401062012 time for calcul the mask position with numpy : 0.05227851867675781 nb_pixel_total : 59447 time to create 1 rle with old method : 0.06634926795959473 time for calcul the mask position with numpy : 0.051656484603881836 nb_pixel_total : 162 time to create 1 rle with old method : 0.00025582313537597656 time for calcul the mask position with numpy : 0.05316948890686035 nb_pixel_total : 99941 time to create 1 rle with old method : 0.11267471313476562 time for calcul the mask position with numpy : 0.05282902717590332 nb_pixel_total : 1801 time to create 1 rle with old method : 0.0023314952850341797 time for calcul the mask position with numpy : 0.05379891395568848 nb_pixel_total : 190872 time to create 1 rle with new method : 1.3867816925048828 time for calcul the mask position with numpy : 0.05709362030029297 nb_pixel_total : 155795 time to create 1 rle with new method : 1.5208346843719482 time for calcul the mask position with numpy : 0.0559239387512207 nb_pixel_total : 46687 time to create 1 rle with old method : 0.05835127830505371 time for calcul the mask position with numpy : 0.05770134925842285 nb_pixel_total : 10352 time to create 1 rle with old method : 0.013037443161010742 time for calcul the mask position with numpy : 0.054853200912475586 nb_pixel_total : 94419 time to create 1 rle with old method : 0.10933613777160645 time for calcul the mask position with numpy : 0.05676388740539551 nb_pixel_total : 33129 time to create 1 rle with old method : 0.05304217338562012 create new chi : 27.02658176422119 time to delete rle : 0.0055005550384521484 batch 1 Loaded 81 chid ids of type : 4855 Number RLEs to save : 52784 TO DO : save crop sub photo not yet done ! save time : 2.8774008750915527 nb_obj : 74 nb_hashtags : 8 time to prepare the origin masks : 53.93133783340454 time for calcul the mask position with numpy : 0.512373685836792 nb_pixel_total : 5516744 time to create 1 rle with new method : 1.4281761646270752 time for calcul the mask position with numpy : 0.054486751556396484 nb_pixel_total : 45137 time to create 1 rle with old method : 0.05274343490600586 time for calcul the mask position with numpy : 0.05368185043334961 nb_pixel_total : 26391 time to create 1 rle with old method : 0.030811786651611328 time for calcul the mask position with numpy : 0.05372762680053711 nb_pixel_total : 117388 time to create 1 rle with old method : 0.16704082489013672 time for calcul the mask position with numpy : 0.05434393882751465 nb_pixel_total : 263857 time to create 1 rle with new method : 1.3316705226898193 time for calcul the mask position with numpy : 0.053376197814941406 nb_pixel_total : 26905 time to create 1 rle with old method : 0.031336069107055664 time for calcul the mask position with numpy : 0.05372881889343262 nb_pixel_total : 64465 time to create 1 rle with old method : 0.07491326332092285 time for calcul the mask position with numpy : 0.05403590202331543 nb_pixel_total : 18855 time to create 1 rle with old method : 0.03036046028137207 time for calcul the mask position with numpy : 0.059557199478149414 nb_pixel_total : 113362 time to create 1 rle with old method : 0.1321263313293457 time for calcul the mask position with numpy : 0.05293703079223633 nb_pixel_total : 219795 time to create 1 rle with new method : 1.1849064826965332 time for calcul the mask position with numpy : 0.05509352684020996 nb_pixel_total : 29382 time to create 1 rle with old method : 0.03454303741455078 time for calcul the mask position with numpy : 0.05262494087219238 nb_pixel_total : 22643 time to create 1 rle with old method : 0.02630448341369629 time for calcul the mask position with numpy : 0.05451321601867676 nb_pixel_total : 47990 time to create 1 rle with old method : 0.0737762451171875 time for calcul the mask position with numpy : 0.0524599552154541 nb_pixel_total : 43806 time to create 1 rle with old method : 0.053375959396362305 time for calcul the mask position with numpy : 0.05349588394165039 nb_pixel_total : 41963 time to create 1 rle with old method : 0.048471689224243164 time for calcul the mask position with numpy : 0.05226755142211914 nb_pixel_total : 38967 time to create 1 rle with old method : 0.05621600151062012 time for calcul the mask position with numpy : 0.054039716720581055 nb_pixel_total : 92781 time to create 1 rle with old method : 0.10817980766296387 time for calcul the mask position with numpy : 0.05701017379760742 nb_pixel_total : 88122 time to create 1 rle with old method : 0.12688684463500977 time for calcul the mask position with numpy : 0.054033517837524414 nb_pixel_total : 136774 time to create 1 rle with old method : 0.15860867500305176 time for calcul the mask position with numpy : 0.05423259735107422 nb_pixel_total : 49585 time to create 1 rle with old method : 0.05794835090637207 time for calcul the mask position with numpy : 0.05827498435974121 nb_pixel_total : 57879 time to create 1 rle with old method : 0.07973766326904297 time for calcul the mask position with numpy : 0.05402565002441406 nb_pixel_total : 33247 time to create 1 rle with old method : 0.038657188415527344 time for calcul the mask position with numpy : 0.052895545959472656 nb_pixel_total : 58997 time to create 1 rle with old method : 0.06857061386108398 time for calcul the mask position with numpy : 0.05332469940185547 nb_pixel_total : 52676 time to create 1 rle with old method : 0.06182694435119629 time for calcul the mask position with numpy : 0.053084373474121094 nb_pixel_total : 18111 time to create 1 rle with old method : 0.021246910095214844 time for calcul the mask position with numpy : 0.0516664981842041 nb_pixel_total : 82364 time to create 1 rle with old method : 0.09447145462036133 time for calcul the mask position with numpy : 0.054229736328125 nb_pixel_total : 59893 time to create 1 rle with old method : 0.07758927345275879 time for calcul the mask position with numpy : 0.06374979019165039 nb_pixel_total : 297674 time to create 1 rle with new method : 0.9711003303527832 time for calcul the mask position with numpy : 0.054114580154418945 nb_pixel_total : 240829 time to create 1 rle with new method : 1.2551641464233398 time for calcul the mask position with numpy : 0.05410480499267578 nb_pixel_total : 22821 time to create 1 rle with old method : 0.03306293487548828 time for calcul the mask position with numpy : 0.054520368576049805 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008273124694824219 time for calcul the mask position with numpy : 0.0545039176940918 nb_pixel_total : 101957 time to create 1 rle with old method : 0.12250280380249023 time for calcul the mask position with numpy : 0.06628537178039551 nb_pixel_total : 386534 time to create 1 rle with new method : 0.9632456302642822 time for calcul the mask position with numpy : 0.053418874740600586 nb_pixel_total : 46440 time to create 1 rle with old method : 0.05556225776672363 time for calcul the mask position with numpy : 0.056859731674194336 nb_pixel_total : 4723 time to create 1 rle with old method : 0.00839543342590332 time for calcul the mask position with numpy : 0.060463666915893555 nb_pixel_total : 12340 time to create 1 rle with old method : 0.014284372329711914 time for calcul the mask position with numpy : 0.055866241455078125 nb_pixel_total : 93818 time to create 1 rle with old method : 0.11051106452941895 time for calcul the mask position with numpy : 0.05143547058105469 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.05483436584472656 nb_pixel_total : 9375 time to create 1 rle with old method : 0.01173090934753418 time for calcul the mask position with numpy : 0.05802631378173828 nb_pixel_total : 291379 time to create 1 rle with new method : 1.051668405532837 time for calcul the mask position with numpy : 0.05353736877441406 nb_pixel_total : 33818 time to create 1 rle with old method : 0.03949093818664551 time for calcul the mask position with numpy : 0.05321168899536133 nb_pixel_total : 26920 time to create 1 rle with old method : 0.031058311462402344 time for calcul the mask position with numpy : 0.05378437042236328 nb_pixel_total : 79775 time to create 1 rle with old method : 0.0924384593963623 time for calcul the mask position with numpy : 0.05310511589050293 nb_pixel_total : 37013 time to create 1 rle with old method : 0.058701276779174805 time for calcul the mask position with numpy : 0.06774306297302246 nb_pixel_total : 631936 time to create 1 rle with new method : 0.9634256362915039 time for calcul the mask position with numpy : 0.05365109443664551 nb_pixel_total : 71268 time to create 1 rle with old method : 0.08241653442382812 time for calcul the mask position with numpy : 0.05442237854003906 nb_pixel_total : 61127 time to create 1 rle with old method : 0.07129287719726562 time for calcul the mask position with numpy : 0.05389094352722168 nb_pixel_total : 16397 time to create 1 rle with old method : 0.019410133361816406 time for calcul the mask position with numpy : 0.05440664291381836 nb_pixel_total : 80383 time to create 1 rle with old method : 0.09443306922912598 time for calcul the mask position with numpy : 0.05456137657165527 nb_pixel_total : 87680 time to create 1 rle with old method : 0.10243034362792969 time for calcul the mask position with numpy : 0.05375838279724121 nb_pixel_total : 77392 time to create 1 rle with old method : 0.0919656753540039 time for calcul the mask position with numpy : 0.053978919982910156 nb_pixel_total : 175777 time to create 1 rle with new method : 0.9150598049163818 time for calcul the mask position with numpy : 0.05218696594238281 nb_pixel_total : 67332 time to create 1 rle with old method : 0.0772254467010498 time for calcul the mask position with numpy : 0.05948233604431152 nb_pixel_total : 97751 time to create 1 rle with old method : 0.13561677932739258 time for calcul the mask position with numpy : 0.05623364448547363 nb_pixel_total : 525997 time to create 1 rle with new method : 1.0556511878967285 time for calcul the mask position with numpy : 0.053118228912353516 nb_pixel_total : 906 time to create 1 rle with old method : 0.0012662410736083984 time for calcul the mask position with numpy : 0.05575704574584961 nb_pixel_total : 325235 time to create 1 rle with new method : 0.9351496696472168 time for calcul the mask position with numpy : 0.0507047176361084 nb_pixel_total : 34035 time to create 1 rle with old method : 0.03987860679626465 time for calcul the mask position with numpy : 0.05498456954956055 nb_pixel_total : 176398 time to create 1 rle with new method : 1.2963247299194336 time for calcul the mask position with numpy : 0.05379319190979004 nb_pixel_total : 74737 time to create 1 rle with old method : 0.08650922775268555 time for calcul the mask position with numpy : 0.05352473258972168 nb_pixel_total : 21115 time to create 1 rle with old method : 0.02481675148010254 time for calcul the mask position with numpy : 0.060530900955200195 nb_pixel_total : 689594 time to create 1 rle with new method : 0.9829344749450684 time for calcul the mask position with numpy : 0.05425000190734863 nb_pixel_total : 240919 time to create 1 rle with new method : 1.4186248779296875 time for calcul the mask position with numpy : 0.05478811264038086 nb_pixel_total : 83335 time to create 1 rle with old method : 0.09658241271972656 time for calcul the mask position with numpy : 0.05696845054626465 nb_pixel_total : 81601 time to create 1 rle with old method : 0.09494471549987793 time for calcul the mask position with numpy : 0.054006338119506836 nb_pixel_total : 7307 time to create 1 rle with old method : 0.009161233901977539 time for calcul the mask position with numpy : 0.056406497955322266 nb_pixel_total : 36689 time to create 1 rle with old method : 0.04291415214538574 time for calcul the mask position with numpy : 0.05318093299865723 nb_pixel_total : 2340 time to create 1 rle with old method : 0.0028564929962158203 time for calcul the mask position with numpy : 0.053802490234375 nb_pixel_total : 73850 time to create 1 rle with old method : 0.08583879470825195 time for calcul the mask position with numpy : 0.05630326271057129 nb_pixel_total : 32858 time to create 1 rle with old method : 0.04044747352600098 time for calcul the mask position with numpy : 0.05855369567871094 nb_pixel_total : 57425 time to create 1 rle with old method : 0.06913232803344727 time for calcul the mask position with numpy : 0.05387163162231445 nb_pixel_total : 1793 time to create 1 rle with old method : 0.0023956298828125 time for calcul the mask position with numpy : 0.05378150939941406 nb_pixel_total : 18258 time to create 1 rle with old method : 0.021756887435913086 time for calcul the mask position with numpy : 0.054331064224243164 nb_pixel_total : 51399 time to create 1 rle with old method : 0.060178279876708984 time for calcul the mask position with numpy : 0.05500960350036621 nb_pixel_total : 21827 time to create 1 rle with old method : 0.02568197250366211 create new chi : 24.635401010513306 time to delete rle : 0.006721019744873047 batch 1 Loaded 75 chid ids of type : 4855 Number RLEs to save : 53557 TO DO : save crop sub photo not yet done ! save time : 2.9217374324798584 nb_obj : 72 nb_hashtags : 9 time to prepare the origin masks : 54.94019889831543 time for calcul the mask position with numpy : 0.7150883674621582 nb_pixel_total : 6014450 time to create 1 rle with new method : 1.0543906688690186 time for calcul the mask position with numpy : 0.05524420738220215 nb_pixel_total : 34076 time to create 1 rle with old method : 0.040731191635131836 time for calcul the mask position with numpy : 0.08175373077392578 nb_pixel_total : 25497 time to create 1 rle with old method : 0.038675546646118164 time for calcul the mask position with numpy : 0.054358482360839844 nb_pixel_total : 11615 time to create 1 rle with old method : 0.013328313827514648 time for calcul the mask position with numpy : 0.05127525329589844 nb_pixel_total : 8103 time to create 1 rle with old method : 0.009319067001342773 time for calcul the mask position with numpy : 0.05386543273925781 nb_pixel_total : 25498 time to create 1 rle with old method : 0.029937028884887695 time for calcul the mask position with numpy : 0.05431222915649414 nb_pixel_total : 34157 time to create 1 rle with old method : 0.04033184051513672 time for calcul the mask position with numpy : 0.056214094161987305 nb_pixel_total : 6600 time to create 1 rle with old method : 0.00814509391784668 time for calcul the mask position with numpy : 0.05433511734008789 nb_pixel_total : 84460 time to create 1 rle with old method : 0.09685254096984863 time for calcul the mask position with numpy : 0.058173418045043945 nb_pixel_total : 6811 time to create 1 rle with old method : 0.008619546890258789 time for calcul the mask position with numpy : 0.05527162551879883 nb_pixel_total : 123869 time to create 1 rle with old method : 0.14058828353881836 time for calcul the mask position with numpy : 0.05394124984741211 nb_pixel_total : 23634 time to create 1 rle with old method : 0.027164697647094727 time for calcul the mask position with numpy : 0.05435466766357422 nb_pixel_total : 182562 time to create 1 rle with new method : 1.5454015731811523 time for calcul the mask position with numpy : 0.05519843101501465 nb_pixel_total : 50900 time to create 1 rle with old method : 0.0597536563873291 time for calcul the mask position with numpy : 0.05353093147277832 nb_pixel_total : 7056 time to create 1 rle with old method : 0.008475780487060547 time for calcul the mask position with numpy : 0.052643537521362305 nb_pixel_total : 28297 time to create 1 rle with old method : 0.031885385513305664 time for calcul the mask position with numpy : 0.05236220359802246 nb_pixel_total : 44383 time to create 1 rle with old method : 0.0580594539642334 time for calcul the mask position with numpy : 0.054534196853637695 nb_pixel_total : 48752 time to create 1 rle with old method : 0.060610055923461914 time for calcul the mask position with numpy : 0.052431583404541016 nb_pixel_total : 6228 time to create 1 rle with old method : 0.0069446563720703125 time for calcul the mask position with numpy : 0.08513140678405762 nb_pixel_total : 765493 time to create 1 rle with new method : 1.2562668323516846 time for calcul the mask position with numpy : 0.06513452529907227 nb_pixel_total : 628600 time to create 1 rle with new method : 0.9115185737609863 time for calcul the mask position with numpy : 0.05205392837524414 nb_pixel_total : 36318 time to create 1 rle with old method : 0.04072308540344238 time for calcul the mask position with numpy : 0.05215334892272949 nb_pixel_total : 13844 time to create 1 rle with old method : 0.015570878982543945 time for calcul the mask position with numpy : 0.051513671875 nb_pixel_total : 45757 time to create 1 rle with old method : 0.050685882568359375 time for calcul the mask position with numpy : 0.0515446662902832 nb_pixel_total : 155068 time to create 1 rle with new method : 1.4341907501220703 time for calcul the mask position with numpy : 0.05170392990112305 nb_pixel_total : 46257 time to create 1 rle with old method : 0.05138731002807617 time for calcul the mask position with numpy : 0.05541682243347168 nb_pixel_total : 457674 time to create 1 rle with new method : 1.1398358345031738 time for calcul the mask position with numpy : 0.05296897888183594 nb_pixel_total : 27400 time to create 1 rle with old method : 0.0302426815032959 time for calcul the mask position with numpy : 0.05120539665222168 nb_pixel_total : 93708 time to create 1 rle with old method : 0.1068720817565918 time for calcul the mask position with numpy : 0.053691864013671875 nb_pixel_total : 83732 time to create 1 rle with old method : 0.09869885444641113 time for calcul the mask position with numpy : 0.05269026756286621 nb_pixel_total : 61809 time to create 1 rle with old method : 0.07117104530334473 time for calcul the mask position with numpy : 0.05657148361206055 nb_pixel_total : 499681 time to create 1 rle with new method : 0.9744031429290771 time for calcul the mask position with numpy : 0.05133318901062012 nb_pixel_total : 71488 time to create 1 rle with old method : 0.08145785331726074 time for calcul the mask position with numpy : 0.05211758613586426 nb_pixel_total : 17566 time to create 1 rle with old method : 0.02037191390991211 time for calcul the mask position with numpy : 0.05229377746582031 nb_pixel_total : 961 time to create 1 rle with old method : 0.0012443065643310547 time for calcul the mask position with numpy : 0.05191850662231445 nb_pixel_total : 3236 time to create 1 rle with old method : 0.00400090217590332 time for calcul the mask position with numpy : 0.05228161811828613 nb_pixel_total : 32197 time to create 1 rle with old method : 0.03704977035522461 time for calcul the mask position with numpy : 0.05285358428955078 nb_pixel_total : 85508 time to create 1 rle with old method : 0.09748268127441406 time for calcul the mask position with numpy : 0.05429482460021973 nb_pixel_total : 21683 time to create 1 rle with old method : 0.02551555633544922 time for calcul the mask position with numpy : 0.054685115814208984 nb_pixel_total : 170020 time to create 1 rle with new method : 1.5861003398895264 time for calcul the mask position with numpy : 0.051125288009643555 nb_pixel_total : 122756 time to create 1 rle with old method : 0.13772344589233398 time for calcul the mask position with numpy : 0.050813913345336914 nb_pixel_total : 20007 time to create 1 rle with old method : 0.022786378860473633 time for calcul the mask position with numpy : 0.05053424835205078 nb_pixel_total : 10611 time to create 1 rle with old method : 0.012063741683959961 time for calcul the mask position with numpy : 0.050987958908081055 nb_pixel_total : 62162 time to create 1 rle with old method : 0.07017707824707031 time for calcul the mask position with numpy : 0.054046630859375 nb_pixel_total : 100680 time to create 1 rle with old method : 0.11214661598205566 time for calcul the mask position with numpy : 0.05332779884338379 nb_pixel_total : 410063 time to create 1 rle with new method : 1.2777397632598877 time for calcul the mask position with numpy : 0.0527195930480957 nb_pixel_total : 1733 time to create 1 rle with old method : 0.0022430419921875 time for calcul the mask position with numpy : 0.052657127380371094 nb_pixel_total : 11639 time to create 1 rle with old method : 0.013478517532348633 time for calcul the mask position with numpy : 0.05295443534851074 nb_pixel_total : 110642 time to create 1 rle with old method : 0.1255040168762207 time for calcul the mask position with numpy : 0.05742692947387695 nb_pixel_total : 431871 time to create 1 rle with new method : 1.0483217239379883 time for calcul the mask position with numpy : 0.05040287971496582 nb_pixel_total : 22946 time to create 1 rle with old method : 0.026108264923095703 time for calcul the mask position with numpy : 0.052434682846069336 nb_pixel_total : 180681 time to create 1 rle with new method : 1.4581925868988037 time for calcul the mask position with numpy : 0.05369162559509277 nb_pixel_total : 188799 time to create 1 rle with new method : 0.9721052646636963 time for calcul the mask position with numpy : 0.08600068092346191 nb_pixel_total : 37706 time to create 1 rle with old method : 0.05530071258544922 time for calcul the mask position with numpy : 0.05430865287780762 nb_pixel_total : 7650 time to create 1 rle with old method : 0.009617090225219727 time for calcul the mask position with numpy : 0.05912041664123535 nb_pixel_total : 34416 time to create 1 rle with old method : 0.04054117202758789 time for calcul the mask position with numpy : 0.06910896301269531 nb_pixel_total : 48143 time to create 1 rle with old method : 0.06685185432434082 time for calcul the mask position with numpy : 0.05423235893249512 nb_pixel_total : 13285 time to create 1 rle with old method : 0.016282320022583008 time for calcul the mask position with numpy : 0.05829048156738281 nb_pixel_total : 106980 time to create 1 rle with old method : 0.13524413108825684 time for calcul the mask position with numpy : 0.06272435188293457 nb_pixel_total : 200290 time to create 1 rle with new method : 1.5848815441131592 time for calcul the mask position with numpy : 0.050879478454589844 nb_pixel_total : 10614 time to create 1 rle with old method : 0.012374401092529297 time for calcul the mask position with numpy : 0.05127239227294922 nb_pixel_total : 36803 time to create 1 rle with old method : 0.040933847427368164 time for calcul the mask position with numpy : 0.05797553062438965 nb_pixel_total : 304654 time to create 1 rle with new method : 1.523380994796753 time for calcul the mask position with numpy : 0.05441904067993164 nb_pixel_total : 3595 time to create 1 rle with old method : 0.00529789924621582 time for calcul the mask position with numpy : 0.053446054458618164 nb_pixel_total : 100105 time to create 1 rle with old method : 0.11253762245178223 time for calcul the mask position with numpy : 0.05097484588623047 nb_pixel_total : 36858 time to create 1 rle with old method : 0.04233264923095703 time for calcul the mask position with numpy : 0.05129432678222656 nb_pixel_total : 12659 time to create 1 rle with old method : 0.014855623245239258 time for calcul the mask position with numpy : 0.051308631896972656 nb_pixel_total : 134136 time to create 1 rle with old method : 0.15363121032714844 time for calcul the mask position with numpy : 0.051105499267578125 nb_pixel_total : 1541 time to create 1 rle with old method : 0.002208709716796875 time for calcul the mask position with numpy : 0.05081939697265625 nb_pixel_total : 27753 time to create 1 rle with old method : 0.034407615661621094 time for calcul the mask position with numpy : 0.05384111404418945 nb_pixel_total : 62672 time to create 1 rle with old method : 0.07281923294067383 time for calcul the mask position with numpy : 0.057404518127441406 nb_pixel_total : 39725 time to create 1 rle with old method : 0.047284841537475586 time for calcul the mask position with numpy : 0.05626082420349121 nb_pixel_total : 77 time to create 1 rle with old method : 0.00016021728515625 create new chi : 25.966098070144653 time to delete rle : 0.004868745803833008 batch 1 Loaded 73 chid ids of type : 4855 Number RLEs to save : 45947 TO DO : save crop sub photo not yet done ! save time : 2.5517406463623047 nb_obj : 43 nb_hashtags : 8 time to prepare the origin masks : 36.882550954818726 time for calcul the mask position with numpy : 0.822115421295166 nb_pixel_total : 7250573 time to create 1 rle with new method : 1.54472017288208 time for calcul the mask position with numpy : 0.3938164710998535 nb_pixel_total : 2050568 time to create 1 rle with new method : 1.2277212142944336 time for calcul the mask position with numpy : 0.05435013771057129 nb_pixel_total : 45698 time to create 1 rle with old method : 0.05283689498901367 time for calcul the mask position with numpy : 0.06066083908081055 nb_pixel_total : 249227 time to create 1 rle with new method : 1.8476333618164062 time for calcul the mask position with numpy : 0.05816960334777832 nb_pixel_total : 415917 time to create 1 rle with new method : 2.326463222503662 time for calcul the mask position with numpy : 0.057041168212890625 nb_pixel_total : 2682 time to create 1 rle with old method : 0.0048274993896484375 time for calcul the mask position with numpy : 0.059477806091308594 nb_pixel_total : 19706 time to create 1 rle with old method : 0.023313522338867188 time for calcul the mask position with numpy : 0.05349850654602051 nb_pixel_total : 4014 time to create 1 rle with old method : 0.004840373992919922 time for calcul the mask position with numpy : 0.05666971206665039 nb_pixel_total : 68290 time to create 1 rle with old method : 0.0805051326751709 time for calcul the mask position with numpy : 0.0540471076965332 nb_pixel_total : 28020 time to create 1 rle with old method : 0.0330808162689209 time for calcul the mask position with numpy : 0.05428647994995117 nb_pixel_total : 12508 time to create 1 rle with old method : 0.016685962677001953 time for calcul the mask position with numpy : 0.05390119552612305 nb_pixel_total : 28746 time to create 1 rle with old method : 0.03366446495056152 time for calcul the mask position with numpy : 0.05431985855102539 nb_pixel_total : 29421 time to create 1 rle with old method : 0.04037284851074219 time for calcul the mask position with numpy : 0.06294751167297363 nb_pixel_total : 42725 time to create 1 rle with old method : 0.06173276901245117 time for calcul the mask position with numpy : 0.05407905578613281 nb_pixel_total : 21836 time to create 1 rle with old method : 0.025760412216186523 time for calcul the mask position with numpy : 0.05529165267944336 nb_pixel_total : 330058 time to create 1 rle with new method : 1.414142370223999 time for calcul the mask position with numpy : 0.05192875862121582 nb_pixel_total : 12408 time to create 1 rle with old method : 0.0142974853515625 time for calcul the mask position with numpy : 0.05228424072265625 nb_pixel_total : 212643 time to create 1 rle with new method : 1.6821236610412598 time for calcul the mask position with numpy : 0.060692548751831055 nb_pixel_total : 36569 time to create 1 rle with old method : 0.04809999465942383 time for calcul the mask position with numpy : 0.052355289459228516 nb_pixel_total : 78260 time to create 1 rle with old method : 0.09093809127807617 time for calcul the mask position with numpy : 0.05287599563598633 nb_pixel_total : 5935 time to create 1 rle with old method : 0.0071485042572021484 time for calcul the mask position with numpy : 0.05320096015930176 nb_pixel_total : 65396 time to create 1 rle with old method : 0.07690978050231934 time for calcul the mask position with numpy : 0.05334115028381348 nb_pixel_total : 41992 time to create 1 rle with old method : 0.04896211624145508 time for calcul the mask position with numpy : 0.05339550971984863 nb_pixel_total : 75764 time to create 1 rle with old method : 0.08889937400817871 time for calcul the mask position with numpy : 0.05360841751098633 nb_pixel_total : 21457 time to create 1 rle with old method : 0.025287151336669922 time for calcul the mask position with numpy : 0.0533444881439209 nb_pixel_total : 1881 time to create 1 rle with old method : 0.002652406692504883 time for calcul the mask position with numpy : 0.053922176361083984 nb_pixel_total : 77046 time to create 1 rle with old method : 0.09037113189697266 time for calcul the mask position with numpy : 0.05844426155090332 nb_pixel_total : 598433 time to create 1 rle with new method : 3.539717674255371 time for calcul the mask position with numpy : 0.054564714431762695 nb_pixel_total : 22538 time to create 1 rle with old method : 0.027487993240356445 time for calcul the mask position with numpy : 0.056089162826538086 nb_pixel_total : 103679 time to create 1 rle with old method : 0.12394046783447266 time for calcul the mask position with numpy : 0.05541872978210449 nb_pixel_total : 208502 time to create 1 rle with new method : 2.043436288833618 time for calcul the mask position with numpy : 0.054200172424316406 nb_pixel_total : 56221 time to create 1 rle with old method : 0.06593537330627441 time for calcul the mask position with numpy : 0.054123878479003906 nb_pixel_total : 49169 time to create 1 rle with old method : 0.0570218563079834 time for calcul the mask position with numpy : 0.05302596092224121 nb_pixel_total : 8 time to create 1 rle with old method : 3.8623809814453125e-05 time for calcul the mask position with numpy : 0.05350232124328613 nb_pixel_total : 49584 time to create 1 rle with old method : 0.05657243728637695 time for calcul the mask position with numpy : 0.055520057678222656 nb_pixel_total : 242130 time to create 1 rle with new method : 1.664689064025879 time for calcul the mask position with numpy : 0.05546379089355469 nb_pixel_total : 53424 time to create 1 rle with old method : 0.06220865249633789 time for calcul the mask position with numpy : 0.053769826889038086 nb_pixel_total : 37831 time to create 1 rle with old method : 0.04554915428161621 time for calcul the mask position with numpy : 0.055527687072753906 nb_pixel_total : 51882 time to create 1 rle with old method : 0.06047654151916504 time for calcul the mask position with numpy : 0.05376172065734863 nb_pixel_total : 201 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.05716753005981445 nb_pixel_total : 124469 time to create 1 rle with old method : 0.14504480361938477 time for calcul the mask position with numpy : 0.05365252494812012 nb_pixel_total : 7076 time to create 1 rle with old method : 0.008608102798461914 time for calcul the mask position with numpy : 0.05446267127990723 nb_pixel_total : 127017 time to create 1 rle with old method : 0.1496739387512207 time for calcul the mask position with numpy : 0.05381941795349121 nb_pixel_total : 17696 time to create 1 rle with old method : 0.029087305068969727 create new chi : 22.931530237197876 time to delete rle : 0.004410743713378906 batch 1 Loaded 44 chid ids of type : 4855 Number RLEs to save : 28498 TO DO : save crop sub photo not yet done ! save time : 1.589824914932251 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 23.70832109451294 time for calcul the mask position with numpy : 0.21074891090393066 nb_pixel_total : 1638474 time to create 1 rle with new method : 1.1124017238616943 time for calcul the mask position with numpy : 0.047661542892456055 nb_pixel_total : 17425 time to create 1 rle with old method : 0.019364356994628906 time for calcul the mask position with numpy : 0.05462050437927246 nb_pixel_total : 365994 time to create 1 rle with new method : 1.1204590797424316 time for calcul the mask position with numpy : 0.06553339958190918 nb_pixel_total : 1529179 time to create 1 rle with new method : 1.283276081085205 time for calcul the mask position with numpy : 0.05077314376831055 nb_pixel_total : 5268 time to create 1 rle with old method : 0.0074100494384765625 time for calcul the mask position with numpy : 0.07840228080749512 nb_pixel_total : 670213 time to create 1 rle with new method : 0.9146072864532471 time for calcul the mask position with numpy : 0.056920766830444336 nb_pixel_total : 247676 time to create 1 rle with new method : 0.9768390655517578 time for calcul the mask position with numpy : 0.0764620304107666 nb_pixel_total : 416337 time to create 1 rle with new method : 1.2976484298706055 time for calcul the mask position with numpy : 0.07710504531860352 nb_pixel_total : 130300 time to create 1 rle with old method : 0.17545533180236816 time for calcul the mask position with numpy : 0.7394812107086182 nb_pixel_total : 7958334 time to create 1 rle with new method : 1.0866615772247314 create new chi : 10.007481098175049 time to delete rle : 0.0023174285888671875 batch 1 Loaded 10 chid ids of type : 4855 Number RLEs to save : 21678 TO DO : save crop sub photo not yet done ! save time : 1.2351744174957275 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 29.624293565750122 time for calcul the mask position with numpy : 0.3483898639678955 nb_pixel_total : 2373003 time to create 1 rle with new method : 1.6661338806152344 time for calcul the mask position with numpy : 0.07302713394165039 nb_pixel_total : 78842 time to create 1 rle with old method : 0.09898209571838379 time for calcul the mask position with numpy : 0.06761050224304199 nb_pixel_total : 49371 time to create 1 rle with old method : 0.0590667724609375 time for calcul the mask position with numpy : 0.13025236129760742 nb_pixel_total : 1721672 time to create 1 rle with new method : 1.3314735889434814 time for calcul the mask position with numpy : 0.06954240798950195 nb_pixel_total : 5704 time to create 1 rle with old method : 0.0069158077239990234 time for calcul the mask position with numpy : 0.06908297538757324 nb_pixel_total : 508859 time to create 1 rle with new method : 1.324294090270996 time for calcul the mask position with numpy : 0.09571313858032227 nb_pixel_total : 646539 time to create 1 rle with new method : 1.2224524021148682 time for calcul the mask position with numpy : 0.0747842788696289 nb_pixel_total : 118532 time to create 1 rle with old method : 0.16056537628173828 time for calcul the mask position with numpy : 0.10061192512512207 nb_pixel_total : 997993 time to create 1 rle with new method : 1.7010314464569092 time for calcul the mask position with numpy : 0.05368947982788086 nb_pixel_total : 107873 time to create 1 rle with old method : 0.13118219375610352 time for calcul the mask position with numpy : 0.5277154445648193 nb_pixel_total : 6370812 time to create 1 rle with new method : 1.4990086555480957 create new chi : 11.15974473953247 time to delete rle : 0.0030074119567871094 batch 1 Loaded 11 chid ids of type : 4855 Number RLEs to save : 21683 TO DO : save crop sub photo not yet done ! save time : 1.237917423248291 map_output_result : {1356361583: (0.6403035751862578, 'Should be the crop_list due to order', 0.9358110121760185), 1356361548: (0.6403035751862578, 'Should be the crop_list due to order', 0.6594440639994803), 1356361543: (0.6403035751862578, 'Should be the crop_list due to order', 0.5173428902970971), 1356361537: (0.6403035751862578, 'Should be the crop_list due to order', 0.5251499698232431), 1356361530: (0.6403035751862578, 'Should be the crop_list due to order', 0.6453501295185176), 1356361523: (0.6403035751862578, 'Should be the crop_list due to order', 0.8269945404049154), 1356361517: (0.6403035751862578, 'Should be the crop_list due to order', 0.37203242008453263)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 7 /1356361583.Didn't retrieve data . /1356361548.Didn't retrieve data . /1356361543.Didn't retrieve data . /1356361537.Didn't retrieve data . /1356361530.Didn't retrieve data . /1356361523.Didn't retrieve data . /1356361517.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.014230489730834961 save_final save missing photos in datou_result : time spend for datou_step_exec : 481.5246059894562 time spend to save output : 0.015138626098632812 total time spend for step 5 : 481.5397446155548 step6:crop_condition Tue May 6 17:53:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 317 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3015255 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546863_1238181 we have uploaded 23 photos in the portfolio 3015255 time of upload the photos Elapsed time : 7.232383728027344 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546885_1238181 we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 22.567533254623413 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3015255 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546917_1238181 we have uploaded 24 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.825802803039551 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3015255 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546928_1238181 we have uploaded 5 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.8557493686676025 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 3015255 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546949_1238181 we have uploaded 49 photos in the portfolio 3015255 time of upload the photos Elapsed time : 15.22755765914917 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746546968_1238181 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7788875102996826 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3015255 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746547023_1238181 we have uploaded 40 photos in the portfolio 3015255 time of upload the photos Elapsed time : 10.381297588348389 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746547037_1238181 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5038812160491943 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3015255 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746547043_1238181 we have uploaded 12 photos in the portfolio 3015255 time of upload the photos Elapsed time : 3.1041903495788574 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3015255 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746547294_1238181 we have uploaded 38 photos in the portfolio 3015255 time of upload the photos Elapsed time : 16.42655920982361 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 232 /1356371827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356371971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356372683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356374303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 703 time used for this insertion : 0.07908487319946289 save_final save missing photos in datou_result : time spend for datou_step_exec : 479.68589878082275 time spend to save output : 0.2690412998199463 total time spend for step 6 : 479.9549400806427 step7:ventilate_hashtags_in_portfolio Tue May 6 18:01:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22716771 get user id for portfolio 22716771 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22716771 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22716771 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22716771 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22716771 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22719450,22719451,22719452,22719453,22719454,22719459,22719461,22719462,22719463,22719464,22719465,22719466,22719468,22719469,22719470,22719471,22719472,22719473,22719474,22719475?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22716771 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 1 /22716771. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01647329330444336 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.276528596878052 time spend to save output : 0.016877412796020508 total time spend for step 7 : 4.293406009674072 step8:final Tue May 6 18:01:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356361583: ('0.5959041648699679',), 1356361548: ('0.5959041648699679',), 1356361543: ('0.5959041648699679',), 1356361537: ('0.5959041648699679',), 1356361530: ('0.5959041648699679',), 1356361523: ('0.5959041648699679',), 1356361517: ('0.5959041648699679',)} new output for save of step final : {1356361583: ('0.5959041648699679',), 1356361548: ('0.5959041648699679',), 1356361543: ('0.5959041648699679',), 1356361537: ('0.5959041648699679',), 1356361530: ('0.5959041648699679',), 1356361523: ('0.5959041648699679',), 1356361517: ('0.5959041648699679',)} [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 7 /1356361583.Didn't retrieve data . /1356361548.Didn't retrieve data . /1356361543.Didn't retrieve data . /1356361537.Didn't retrieve data . /1356361530.Didn't retrieve data . /1356361523.Didn't retrieve data . /1356361517.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012099027633666992 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11315584182739258 time spend to save output : 0.012733697891235352 total time spend for step 8 : 0.12588953971862793 step9:velours_tree Tue May 6 18:01:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.9466230869293213 time spend to save output : 6.222724914550781e-05 total time spend for step 9 : 1.9466853141784668 step10:send_mail_cod Tue May 6 18:01:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22716771_06-05-2025_18_01_59.pdf 22719424 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194241746547319 22719425 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194251746547321 22719426 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194261746547323 22719427 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194271746547324 22719428 imagette227194281746547325 22719429 imagette227194291746547325 22719430 imagette227194301746547325 22719431 imagette227194311746547325 22719432 imagette227194321746547325 22719433 imagette227194331746547325 22719434 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194341746547325 22719435 change filename to text .imagette227194351746547326 22719436 imagette227194361746547326 22719437 imagette227194371746547326 22719438 imagette227194381746547326 22719439 imagette227194391746547326 22719440 imagette227194401746547326 22719441 change filename to text .imagette227194411746547326 22719442 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194421746547326 22719444 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227194441746547327 22719445 imagette227194451746547329 22719446 imagette227194461746547329 22719447 imagette227194471746547329 22719448 imagette227194481746547329 22719449 imagette227194491746547329 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22716771 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22719450,22719451,22719452,22719453,22719454,22719459,22719461,22719462,22719463,22719464,22719465,22719466,22719468,22719469,22719470,22719471,22719472,22719473,22719474,22719475?tags=papier,carton,metal,pet_clair,pehd,ela,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,autre,flux_dev,mal_croppe,flou,film_dev_souple,sac_om_plein&datou_id_consolidate=4742&port_consolidate=22716771 your option no_mail is active, we will not send the real mail to your client args[1356361583] : ((1356361583, 995.6443410907566, 2107751945), (1356361583, -0.22533855902404604, 496442774), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361548] : ((1356361548, 4662.018021972973, 492609224), (1356361548, -0.3648077506476149, 496442774), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361543] : ((1356361543, 4208.3290057896575, 492609224), (1356361543, -0.16905383703216303, 496442774), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361537] : ((1356361537, 3034.2725583232705, 492609224), (1356361537, -0.3339108909735234, 496442774), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361530] : ((1356361530, 3071.399476237449, 492609224), (1356361530, -0.40043610117869666, 496442774), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361523] : ((1356361523, 127.61887722167494, 492688767), (1356361523, -1.3618691818971234, 501862349), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1356361517] : ((1356361517, 913.5448104385467, 2107751945), (1356361517, -0.7327232120173187, 501862349), '0.5959041648699679') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.5959041648699679 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22716771_06-05-2025_18_01_59.pdf results_Auto_P22716771_06-05-2025_18_01_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22716771_06-05-2025_18_01_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22716771','results_Auto_P22716771_06-05-2025_18_01_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22716771_06-05-2025_18_01_59.pdf','pdf','','2.27','0.5959041648699679') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014808177947998047 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.779679775238037 time spend to save output : 0.015442132949829102 total time spend for step 10 : 13.795121908187866 step11:split_time_score Tue May 6 18:02:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('33', 2), ('34', 2), ('35', 2), ('40', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06052025 22716771 Nombre de photos uploadées : 7 / 23040 (0%) 06052025 22716771 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 06052025 22716771 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 8.58306884765625e-06 elapsed_time : order_list_meta_photo_and_scores 1.71661376953125e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0005323886871337891 elapsed_time : insert_dashboard_record_day_entry 0.02405238151550293 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.5959041648699679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22716771_06-05-2025_18_01_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22716771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22716771 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356361583, 1356361548, 1356361543, 1356361537, 1356361530, 1356361523, 1356361517] Looping around the photos to save general results len do output : 1 /22716771Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361583', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361548', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361543', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361537', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361530', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361523', None, None, None, None, None, '2797865') ('4741', None, None, None, None, None, None, None, '2797865') ('4741', '22716771', '1356361517', None, None, None, None, None, '2797865') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013465166091918945 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.26558375358581543 time spend to save output : 0.013814210891723633 total time spend for step 11 : 0.27939796447753906 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 771.06user 491.32system 20:48.31elapsed 101%CPU (0avgtext+0avgdata 6892596maxresident)k 1871296inputs+828720outputs (25969major+60639949minor)pagefaults 0swaps