python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4741 -l 30 ' -s datou_current_4741 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 780411 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2833132'] with mtr_portfolio_ids : ['22902876'] and first list_photo_ids : [] new path : /proc/780411/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.2283787727355957 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue May 13 03:21:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5304 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-13 03:21:32.879073: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-13 03:21:32.903191: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-13 03:21:32.904609: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7faea0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:21:32.904662: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-13 03:21:32.907432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-13 03:21:33.041519: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2dbdca80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:21:33.041555: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-13 03:21:33.042366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:21:33.042674: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:21:33.044885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:21:33.047186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:21:33.047546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:21:33.050085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:21:33.051270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:21:33.056219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:21:33.057460: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:21:33.057571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:21:33.058229: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:21:33.058245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:21:33.058255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:21:33.059363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-13 03:21:33.323875: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:21:33.324002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:21:33.324022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:21:33.324039: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:21:33.324055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:21:33.324071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:21:33.324087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:21:33.324103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:21:33.324993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:21:33.325995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:21:33.326028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:21:33.326044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:21:33.326058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:21:33.326087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:21:33.326102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:21:33.326116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:21:33.326130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:21:33.327048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:21:33.327085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:21:33.327093: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:21:33.327100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:21:33.328027: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4843 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-13 03:21:44.792631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:21:44.977653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:21:46.379171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.379731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.380257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.380781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.381314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.381818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.382310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.382336: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.383037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.383056: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.391738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.391760: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.392295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.392311: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.398964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.398986: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.399523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.399540: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.430744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.430776: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.431353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.431372: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.438474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.438497: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.439037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.439064: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 03:21:46.496889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.497547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.501368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.501986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.559181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.559777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.562688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.563309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.605041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.605852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.609226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.610174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.621056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.621756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.624426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.624966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.633951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.634496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.636969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.637508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.684102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.684707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.685265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.685809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.691626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.692185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.717667: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.718237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.718774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.719329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.734835: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.735377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.735898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.736423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.740809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.741344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.746010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.746554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.758571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.759145: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.763242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.763782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.764321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.764859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.765628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.766160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.777040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.777586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.778134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.778675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.779232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.779759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.780269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.780798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.790158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.790785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.797128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.797931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.820784: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.820866: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-13 03:21:46.821833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.822790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.830090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.830821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.831570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.832263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.840474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.841043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.856181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.856758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.857333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.857889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.861935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.862466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.862994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.863564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.864666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.875640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.876666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.886134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.886737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.887317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.887886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.888461: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 03:21:46.889010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 780602 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 553 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1746 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.013061761856079102 nb_pixel_total : 305289 time to create 1 rle with new method : 0.04375100135803223 length of segment : 754 time for calcul the mask position with numpy : 0.0004532337188720703 nb_pixel_total : 27644 time to create 1 rle with old method : 0.03125810623168945 length of segment : 197 time for calcul the mask position with numpy : 0.0017857551574707031 nb_pixel_total : 133722 time to create 1 rle with old method : 0.1430985927581787 length of segment : 613 time for calcul the mask position with numpy : 0.002334117889404297 nb_pixel_total : 130331 time to create 1 rle with old method : 0.14838171005249023 length of segment : 383 time for calcul the mask position with numpy : 0.0006296634674072266 nb_pixel_total : 20645 time to create 1 rle with old method : 0.02382493019104004 length of segment : 314 time for calcul the mask position with numpy : 0.0013401508331298828 nb_pixel_total : 21542 time to create 1 rle with old method : 0.02475762367248535 length of segment : 342 time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 32536 time to create 1 rle with old method : 0.03883171081542969 length of segment : 361 time for calcul the mask position with numpy : 0.0010797977447509766 nb_pixel_total : 71373 time to create 1 rle with old method : 0.08317422866821289 length of segment : 299 time for calcul the mask position with numpy : 0.0015156269073486328 nb_pixel_total : 70880 time to create 1 rle with old method : 0.08182978630065918 length of segment : 422 time for calcul the mask position with numpy : 0.005547046661376953 nb_pixel_total : 251880 time to create 1 rle with new method : 0.018215417861938477 length of segment : 546 time for calcul the mask position with numpy : 0.0008018016815185547 nb_pixel_total : 51499 time to create 1 rle with old method : 0.06356096267700195 length of segment : 274 time for calcul the mask position with numpy : 0.0185394287109375 nb_pixel_total : 382525 time to create 1 rle with new method : 0.035848379135131836 length of segment : 848 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 24275 time to create 1 rle with old method : 0.027748584747314453 length of segment : 296 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 27027 time to create 1 rle with old method : 0.0313572883605957 length of segment : 337 time for calcul the mask position with numpy : 0.04067635536193848 nb_pixel_total : 901329 time to create 1 rle with new method : 0.2754707336425781 length of segment : 1038 time for calcul the mask position with numpy : 0.0066950321197509766 nb_pixel_total : 193522 time to create 1 rle with new method : 0.012242794036865234 length of segment : 715 time for calcul the mask position with numpy : 0.0004143714904785156 nb_pixel_total : 6662 time to create 1 rle with old method : 0.008052825927734375 length of segment : 121 time for calcul the mask position with numpy : 0.0007569789886474609 nb_pixel_total : 28420 time to create 1 rle with old method : 0.03327059745788574 length of segment : 248 time for calcul the mask position with numpy : 0.0012798309326171875 nb_pixel_total : 23532 time to create 1 rle with old method : 0.029079675674438477 length of segment : 362 time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 24079 time to create 1 rle with old method : 0.02829885482788086 length of segment : 125 time for calcul the mask position with numpy : 0.0047566890716552734 nb_pixel_total : 156282 time to create 1 rle with new method : 0.013947010040283203 length of segment : 845 time for calcul the mask position with numpy : 0.03886532783508301 nb_pixel_total : 1365860 time to create 1 rle with new method : 0.24432945251464844 length of segment : 1037 time for calcul the mask position with numpy : 0.003799915313720703 nb_pixel_total : 150726 time to create 1 rle with new method : 0.0047762393951416016 length of segment : 429 time for calcul the mask position with numpy : 0.0037381649017333984 nb_pixel_total : 145455 time to create 1 rle with old method : 0.16393232345581055 length of segment : 310 time for calcul the mask position with numpy : 0.002490520477294922 nb_pixel_total : 153736 time to create 1 rle with new method : 0.005615711212158203 length of segment : 387 time for calcul the mask position with numpy : 0.0012650489807128906 nb_pixel_total : 16449 time to create 1 rle with old method : 0.027831315994262695 length of segment : 225 time for calcul the mask position with numpy : 0.003893136978149414 nb_pixel_total : 110193 time to create 1 rle with old method : 0.12863969802856445 length of segment : 647 time for calcul the mask position with numpy : 0.0020759105682373047 nb_pixel_total : 56578 time to create 1 rle with old method : 0.06709480285644531 length of segment : 275 time for calcul the mask position with numpy : 0.0004572868347167969 nb_pixel_total : 8938 time to create 1 rle with old method : 0.012065410614013672 length of segment : 106 time for calcul the mask position with numpy : 0.008532285690307617 nb_pixel_total : 339841 time to create 1 rle with new method : 0.01690673828125 length of segment : 588 time for calcul the mask position with numpy : 0.0007348060607910156 nb_pixel_total : 11014 time to create 1 rle with old method : 0.01433873176574707 length of segment : 148 time for calcul the mask position with numpy : 0.007544517517089844 nb_pixel_total : 157491 time to create 1 rle with new method : 0.010867118835449219 length of segment : 522 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 11401 time to create 1 rle with old method : 0.015099287033081055 length of segment : 109 time for calcul the mask position with numpy : 0.0025534629821777344 nb_pixel_total : 94207 time to create 1 rle with old method : 0.1195073127746582 length of segment : 505 time for calcul the mask position with numpy : 0.0038597583770751953 nb_pixel_total : 108627 time to create 1 rle with old method : 0.12477564811706543 length of segment : 538 time for calcul the mask position with numpy : 0.0011472702026367188 nb_pixel_total : 27508 time to create 1 rle with old method : 0.03201770782470703 length of segment : 213 length of segment : 0 time for calcul the mask position with numpy : 0.00561213493347168 nb_pixel_total : 299400 time to create 1 rle with new method : 0.009688854217529297 length of segment : 502 time for calcul the mask position with numpy : 0.0030813217163085938 nb_pixel_total : 106372 time to create 1 rle with old method : 0.11949682235717773 length of segment : 561 time for calcul the mask position with numpy : 0.009346246719360352 nb_pixel_total : 337714 time to create 1 rle with new method : 0.015689611434936523 length of segment : 911 time for calcul the mask position with numpy : 0.0013942718505859375 nb_pixel_total : 60327 time to create 1 rle with old method : 0.0681924819946289 length of segment : 415 time for calcul the mask position with numpy : 0.0005476474761962891 nb_pixel_total : 12214 time to create 1 rle with old method : 0.014417648315429688 length of segment : 151 time for calcul the mask position with numpy : 0.0008668899536132812 nb_pixel_total : 53595 time to create 1 rle with old method : 0.061959266662597656 length of segment : 292 time for calcul the mask position with numpy : 0.0019161701202392578 nb_pixel_total : 88710 time to create 1 rle with old method : 0.10020208358764648 length of segment : 495 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 9175 time to create 1 rle with old method : 0.010743141174316406 length of segment : 79 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 7652 time to create 1 rle with old method : 0.00934600830078125 length of segment : 144 time for calcul the mask position with numpy : 0.0007557868957519531 nb_pixel_total : 31701 time to create 1 rle with old method : 0.03844881057739258 length of segment : 245 time for calcul the mask position with numpy : 0.0013611316680908203 nb_pixel_total : 55662 time to create 1 rle with old method : 0.06456494331359863 length of segment : 490 time for calcul the mask position with numpy : 0.001979827880859375 nb_pixel_total : 91740 time to create 1 rle with old method : 0.10375499725341797 length of segment : 425 time for calcul the mask position with numpy : 0.0017971992492675781 nb_pixel_total : 70395 time to create 1 rle with old method : 0.08237695693969727 length of segment : 323 time for calcul the mask position with numpy : 0.0024116039276123047 nb_pixel_total : 157822 time to create 1 rle with new method : 0.0034711360931396484 length of segment : 377 time for calcul the mask position with numpy : 0.0026226043701171875 nb_pixel_total : 134241 time to create 1 rle with old method : 0.15087056159973145 length of segment : 471 time for calcul the mask position with numpy : 0.0010602474212646484 nb_pixel_total : 51882 time to create 1 rle with old method : 0.05870175361633301 length of segment : 257 time for calcul the mask position with numpy : 0.0021958351135253906 nb_pixel_total : 126103 time to create 1 rle with old method : 0.14199352264404297 length of segment : 337 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 5975 time to create 1 rle with old method : 0.007021665573120117 length of segment : 113 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 5224 time to create 1 rle with old method : 0.006142377853393555 length of segment : 138 time for calcul the mask position with numpy : 0.150115966796875 nb_pixel_total : 2860125 time to create 1 rle with new method : 0.1854090690612793 length of segment : 1537 time for calcul the mask position with numpy : 0.44165778160095215 nb_pixel_total : 6437943 time to create 1 rle with new method : 0.9767329692840576 length of segment : 4976 time for calcul the mask position with numpy : 0.0015010833740234375 nb_pixel_total : 104702 time to create 1 rle with old method : 0.12143707275390625 length of segment : 186 time for calcul the mask position with numpy : 0.4599192142486572 nb_pixel_total : 6836254 time to create 1 rle with new method : 0.5408768653869629 length of segment : 2581 time for calcul the mask position with numpy : 1.1423492431640625 nb_pixel_total : 3482406 time to create 1 rle with new method : 0.20709228515625 length of segment : 1981 time spent for convertir_results : 15.86931586265564 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 54.60862994194031 time spend to save output : 0.10951614379882812 total time spend for step 1 : 54.718146085739136 step2:mask_detect Tue May 13 03:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5525 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-13 03:22:27.574354: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-13 03:22:27.599368: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-13 03:22:27.601354: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fae98000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:22:27.601401: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-13 03:22:27.605115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-13 03:22:27.860654: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2eb1ca80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-13 03:22:27.860700: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-13 03:22:27.861953: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:22:27.862375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:22:27.866200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:22:27.869310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:22:27.869721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:22:27.872197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:22:27.873173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:22:27.877086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:22:27.878171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:22:27.878233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:22:27.878812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:22:27.878827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:22:27.878835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:22:27.879888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-13 03:22:27.994014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:22:27.994111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:22:27.994141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:22:27.994167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:22:27.994193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:22:27.994219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:22:27.994243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:22:27.994269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:22:27.995564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:22:27.996694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 03:22:27.996732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 03:22:27.996766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:22:27.996787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 03:22:27.996807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 03:22:27.996826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 03:22:27.996845: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 03:22:27.996865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 03:22:27.998058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 03:22:27.998090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 03:22:27.998101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 03:22:27.998112: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 03:22:27.999458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5051 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3453 thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) {'thcl': {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'svm_hashtag_type_desc': 5732, 'photo_desc_type': 5732, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_refus_amiens_050123 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_refus_amiens_050123 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-13 03:22:40.073744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 03:22:40.248300: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 784752 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.008292198181152344 nb_pixel_total : 269610 time to create 1 rle with new method : 0.014330625534057617 length of segment : 560 time for calcul the mask position with numpy : 0.00406646728515625 nb_pixel_total : 213609 time to create 1 rle with new method : 0.011943578720092773 length of segment : 443 time for calcul the mask position with numpy : 0.0027964115142822266 nb_pixel_total : 107912 time to create 1 rle with old method : 0.12144923210144043 length of segment : 384 time for calcul the mask position with numpy : 0.0015003681182861328 nb_pixel_total : 67245 time to create 1 rle with old method : 0.09214448928833008 length of segment : 238 time for calcul the mask position with numpy : 0.0007939338684082031 nb_pixel_total : 30536 time to create 1 rle with old method : 0.03958916664123535 length of segment : 178 time for calcul the mask position with numpy : 0.0017769336700439453 nb_pixel_total : 103247 time to create 1 rle with old method : 0.14670181274414062 length of segment : 591 time for calcul the mask position with numpy : 0.0010907649993896484 nb_pixel_total : 54097 time to create 1 rle with old method : 0.06290817260742188 length of segment : 196 time for calcul the mask position with numpy : 0.003498554229736328 nb_pixel_total : 181833 time to create 1 rle with new method : 0.009023666381835938 length of segment : 455 time for calcul the mask position with numpy : 0.0025768280029296875 nb_pixel_total : 146135 time to create 1 rle with old method : 0.17005085945129395 length of segment : 275 time for calcul the mask position with numpy : 0.008794307708740234 nb_pixel_total : 477069 time to create 1 rle with new method : 0.03754925727844238 length of segment : 724 time for calcul the mask position with numpy : 0.002318859100341797 nb_pixel_total : 104451 time to create 1 rle with old method : 0.13116955757141113 length of segment : 640 time for calcul the mask position with numpy : 0.0026297569274902344 nb_pixel_total : 134021 time to create 1 rle with old method : 0.15411686897277832 length of segment : 467 time for calcul the mask position with numpy : 0.007378578186035156 nb_pixel_total : 365982 time to create 1 rle with new method : 0.02008199691772461 length of segment : 1003 time for calcul the mask position with numpy : 0.003171682357788086 nb_pixel_total : 94383 time to create 1 rle with old method : 0.11572051048278809 length of segment : 465 time for calcul the mask position with numpy : 0.003392934799194336 nb_pixel_total : 198241 time to create 1 rle with new method : 0.008319854736328125 length of segment : 414 time for calcul the mask position with numpy : 0.0016357898712158203 nb_pixel_total : 73570 time to create 1 rle with old method : 0.08936047554016113 length of segment : 311 time for calcul the mask position with numpy : 0.0009658336639404297 nb_pixel_total : 38958 time to create 1 rle with old method : 0.04561924934387207 length of segment : 231 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 34247 time to create 1 rle with old method : 0.043622732162475586 length of segment : 372 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 48288 time to create 1 rle with old method : 0.06279468536376953 length of segment : 222 time for calcul the mask position with numpy : 0.0011551380157470703 nb_pixel_total : 49224 time to create 1 rle with old method : 0.05773735046386719 length of segment : 256 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 22670 time to create 1 rle with old method : 0.02964162826538086 length of segment : 162 time for calcul the mask position with numpy : 0.0006387233734130859 nb_pixel_total : 33727 time to create 1 rle with old method : 0.03836417198181152 length of segment : 195 time for calcul the mask position with numpy : 0.011100530624389648 nb_pixel_total : 652656 time to create 1 rle with new method : 0.27533650398254395 length of segment : 792 time for calcul the mask position with numpy : 0.0009405612945556641 nb_pixel_total : 53860 time to create 1 rle with old method : 0.06639337539672852 length of segment : 370 time for calcul the mask position with numpy : 0.0014958381652832031 nb_pixel_total : 78312 time to create 1 rle with old method : 0.08974194526672363 length of segment : 336 time for calcul the mask position with numpy : 0.001737833023071289 nb_pixel_total : 78155 time to create 1 rle with old method : 0.09791231155395508 length of segment : 334 time for calcul the mask position with numpy : 0.009670495986938477 nb_pixel_total : 434922 time to create 1 rle with new method : 0.026675701141357422 length of segment : 842 time for calcul the mask position with numpy : 0.0020515918731689453 nb_pixel_total : 99640 time to create 1 rle with old method : 0.11398649215698242 length of segment : 585 time for calcul the mask position with numpy : 0.006814479827880859 nb_pixel_total : 405927 time to create 1 rle with new method : 0.01748514175415039 length of segment : 486 time for calcul the mask position with numpy : 0.0017058849334716797 nb_pixel_total : 58633 time to create 1 rle with old method : 0.07366394996643066 length of segment : 351 time for calcul the mask position with numpy : 0.0007648468017578125 nb_pixel_total : 41400 time to create 1 rle with old method : 0.0669548511505127 length of segment : 234 time for calcul the mask position with numpy : 0.005614757537841797 nb_pixel_total : 290218 time to create 1 rle with new method : 0.017272472381591797 length of segment : 798 time for calcul the mask position with numpy : 0.0073316097259521484 nb_pixel_total : 366325 time to create 1 rle with new method : 0.019196033477783203 length of segment : 904 time for calcul the mask position with numpy : 0.023277997970581055 nb_pixel_total : 482053 time to create 1 rle with new method : 0.3511464595794678 length of segment : 1647 time for calcul the mask position with numpy : 0.0026350021362304688 nb_pixel_total : 142274 time to create 1 rle with old method : 0.1605992317199707 length of segment : 666 time for calcul the mask position with numpy : 0.001982450485229492 nb_pixel_total : 106237 time to create 1 rle with old method : 0.13587117195129395 length of segment : 313 time for calcul the mask position with numpy : 0.00148773193359375 nb_pixel_total : 80391 time to create 1 rle with old method : 0.0917363166809082 length of segment : 332 time for calcul the mask position with numpy : 0.0031430721282958984 nb_pixel_total : 189934 time to create 1 rle with new method : 0.008950233459472656 length of segment : 546 time for calcul the mask position with numpy : 0.0028562545776367188 nb_pixel_total : 145665 time to create 1 rle with old method : 0.18033981323242188 length of segment : 490 time for calcul the mask position with numpy : 0.004734992980957031 nb_pixel_total : 237016 time to create 1 rle with new method : 0.012955904006958008 length of segment : 755 time for calcul the mask position with numpy : 0.0012257099151611328 nb_pixel_total : 49768 time to create 1 rle with old method : 0.05846977233886719 length of segment : 246 time for calcul the mask position with numpy : 0.002095460891723633 nb_pixel_total : 79779 time to create 1 rle with old method : 0.0897212028503418 length of segment : 340 time for calcul the mask position with numpy : 0.005045413970947266 nb_pixel_total : 267445 time to create 1 rle with new method : 0.013848304748535156 length of segment : 791 time for calcul the mask position with numpy : 0.0074920654296875 nb_pixel_total : 400315 time to create 1 rle with new method : 0.01962113380432129 length of segment : 807 time for calcul the mask position with numpy : 0.006888866424560547 nb_pixel_total : 313094 time to create 1 rle with new method : 0.02169656753540039 length of segment : 810 time for calcul the mask position with numpy : 0.004471302032470703 nb_pixel_total : 208832 time to create 1 rle with new method : 0.017238855361938477 length of segment : 507 time for calcul the mask position with numpy : 0.0015366077423095703 nb_pixel_total : 65473 time to create 1 rle with old method : 0.07652044296264648 length of segment : 372 time for calcul the mask position with numpy : 0.00509333610534668 nb_pixel_total : 187199 time to create 1 rle with new method : 0.016451597213745117 length of segment : 523 time for calcul the mask position with numpy : 0.0027017593383789062 nb_pixel_total : 117783 time to create 1 rle with old method : 0.1426858901977539 length of segment : 314 time for calcul the mask position with numpy : 0.0012028217315673828 nb_pixel_total : 64911 time to create 1 rle with old method : 0.07595992088317871 length of segment : 396 time for calcul the mask position with numpy : 0.010540008544921875 nb_pixel_total : 494062 time to create 1 rle with new method : 0.038417816162109375 length of segment : 887 time for calcul the mask position with numpy : 0.0007605552673339844 nb_pixel_total : 31422 time to create 1 rle with old method : 0.03931379318237305 length of segment : 194 time for calcul the mask position with numpy : 0.0035619735717773438 nb_pixel_total : 180302 time to create 1 rle with new method : 0.009191513061523438 length of segment : 584 time for calcul the mask position with numpy : 0.0021622180938720703 nb_pixel_total : 82230 time to create 1 rle with old method : 0.11268043518066406 length of segment : 352 time for calcul the mask position with numpy : 0.003837108612060547 nb_pixel_total : 178394 time to create 1 rle with new method : 0.01065683364868164 length of segment : 870 time for calcul the mask position with numpy : 0.0013840198516845703 nb_pixel_total : 50029 time to create 1 rle with old method : 0.056958913803100586 length of segment : 290 time for calcul the mask position with numpy : 0.002752065658569336 nb_pixel_total : 138868 time to create 1 rle with old method : 0.1588747501373291 length of segment : 452 time for calcul the mask position with numpy : 0.0011167526245117188 nb_pixel_total : 63051 time to create 1 rle with old method : 0.07191896438598633 length of segment : 292 time for calcul the mask position with numpy : 0.0025949478149414062 nb_pixel_total : 147359 time to create 1 rle with old method : 0.1651308536529541 length of segment : 457 time for calcul the mask position with numpy : 0.0014820098876953125 nb_pixel_total : 68652 time to create 1 rle with old method : 0.07780337333679199 length of segment : 567 time for calcul the mask position with numpy : 0.0006709098815917969 nb_pixel_total : 32307 time to create 1 rle with old method : 0.03943204879760742 length of segment : 203 time for calcul the mask position with numpy : 0.0018613338470458984 nb_pixel_total : 105091 time to create 1 rle with old method : 0.11946940422058105 length of segment : 452 time for calcul the mask position with numpy : 0.0013842582702636719 nb_pixel_total : 72607 time to create 1 rle with old method : 0.08121132850646973 length of segment : 383 time for calcul the mask position with numpy : 0.0012354850769042969 nb_pixel_total : 72471 time to create 1 rle with old method : 0.08675098419189453 length of segment : 371 time for calcul the mask position with numpy : 0.003536701202392578 nb_pixel_total : 176597 time to create 1 rle with new method : 0.009261608123779297 length of segment : 494 time for calcul the mask position with numpy : 0.0021026134490966797 nb_pixel_total : 121814 time to create 1 rle with old method : 0.13897705078125 length of segment : 490 time for calcul the mask position with numpy : 0.0016946792602539062 nb_pixel_total : 84905 time to create 1 rle with old method : 0.1016840934753418 length of segment : 486 time for calcul the mask position with numpy : 0.03484010696411133 nb_pixel_total : 1948342 time to create 1 rle with new method : 0.3570573329925537 length of segment : 1112 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 44687 time to create 1 rle with old method : 0.05218148231506348 length of segment : 244 time for calcul the mask position with numpy : 0.0012121200561523438 nb_pixel_total : 51492 time to create 1 rle with old method : 0.062150001525878906 length of segment : 331 time for calcul the mask position with numpy : 0.0018262863159179688 nb_pixel_total : 63186 time to create 1 rle with old method : 0.07495856285095215 length of segment : 364 time for calcul the mask position with numpy : 0.0016596317291259766 nb_pixel_total : 74370 time to create 1 rle with old method : 0.08561849594116211 length of segment : 358 time for calcul the mask position with numpy : 0.0033261775970458984 nb_pixel_total : 137858 time to create 1 rle with old method : 0.15265583992004395 length of segment : 531 time for calcul the mask position with numpy : 0.0031731128692626953 nb_pixel_total : 153764 time to create 1 rle with new method : 0.007538318634033203 length of segment : 250 time for calcul the mask position with numpy : 0.0019083023071289062 nb_pixel_total : 107759 time to create 1 rle with old method : 0.12532424926757812 length of segment : 359 time for calcul the mask position with numpy : 0.0023698806762695312 nb_pixel_total : 48646 time to create 1 rle with old method : 0.07839488983154297 length of segment : 268 time for calcul the mask position with numpy : 0.0007748603820800781 nb_pixel_total : 11803 time to create 1 rle with old method : 0.015967845916748047 length of segment : 243 time for calcul the mask position with numpy : 0.006744861602783203 nb_pixel_total : 395160 time to create 1 rle with new method : 0.015038013458251953 length of segment : 714 time for calcul the mask position with numpy : 0.0017719268798828125 nb_pixel_total : 85271 time to create 1 rle with old method : 0.0970466136932373 length of segment : 411 time for calcul the mask position with numpy : 0.013897418975830078 nb_pixel_total : 768671 time to create 1 rle with new method : 0.11839771270751953 length of segment : 1039 time for calcul the mask position with numpy : 0.0006914138793945312 nb_pixel_total : 32942 time to create 1 rle with old method : 0.03804636001586914 length of segment : 198 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 33628 time to create 1 rle with old method : 0.0393829345703125 length of segment : 296 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 41958 time to create 1 rle with old method : 0.04665803909301758 length of segment : 251 time for calcul the mask position with numpy : 0.0033109188079833984 nb_pixel_total : 116309 time to create 1 rle with old method : 0.14130735397338867 length of segment : 765 time for calcul the mask position with numpy : 0.0027518272399902344 nb_pixel_total : 163494 time to create 1 rle with new method : 0.007266998291015625 length of segment : 577 time for calcul the mask position with numpy : 0.000978231430053711 nb_pixel_total : 46183 time to create 1 rle with old method : 0.05797243118286133 length of segment : 169 time for calcul the mask position with numpy : 0.00619196891784668 nb_pixel_total : 355954 time to create 1 rle with new method : 0.01643514633178711 length of segment : 765 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 28154 time to create 1 rle with old method : 0.03176403045654297 length of segment : 204 time for calcul the mask position with numpy : 0.0014891624450683594 nb_pixel_total : 87868 time to create 1 rle with old method : 0.1258394718170166 length of segment : 373 time for calcul the mask position with numpy : 0.0016644001007080078 nb_pixel_total : 69207 time to create 1 rle with old method : 0.08178329467773438 length of segment : 343 time for calcul the mask position with numpy : 0.008005619049072266 nb_pixel_total : 427224 time to create 1 rle with new method : 0.0226895809173584 length of segment : 995 time for calcul the mask position with numpy : 0.0015304088592529297 nb_pixel_total : 66128 time to create 1 rle with old method : 0.07515311241149902 length of segment : 372 time for calcul the mask position with numpy : 0.006814002990722656 nb_pixel_total : 325401 time to create 1 rle with new method : 0.018958330154418945 length of segment : 622 time for calcul the mask position with numpy : 0.006910800933837891 nb_pixel_total : 467350 time to create 1 rle with new method : 0.016132831573486328 length of segment : 779 time for calcul the mask position with numpy : 0.005258083343505859 nb_pixel_total : 274681 time to create 1 rle with new method : 0.012601852416992188 length of segment : 599 time for calcul the mask position with numpy : 0.0033152103424072266 nb_pixel_total : 43905 time to create 1 rle with old method : 0.05049467086791992 length of segment : 630 time for calcul the mask position with numpy : 0.0038187503814697266 nb_pixel_total : 246900 time to create 1 rle with new method : 0.009514093399047852 length of segment : 629 time for calcul the mask position with numpy : 0.00597691535949707 nb_pixel_total : 308859 time to create 1 rle with new method : 0.01642894744873047 length of segment : 698 time for calcul the mask position with numpy : 0.003313302993774414 nb_pixel_total : 173885 time to create 1 rle with new method : 0.010120630264282227 length of segment : 601 time for calcul the mask position with numpy : 0.0014491081237792969 nb_pixel_total : 63784 time to create 1 rle with old method : 0.07274818420410156 length of segment : 205 time for calcul the mask position with numpy : 0.014370203018188477 nb_pixel_total : 581441 time to create 1 rle with new method : 0.04456639289855957 length of segment : 772 time for calcul the mask position with numpy : 0.0023093223571777344 nb_pixel_total : 77193 time to create 1 rle with old method : 0.08685088157653809 length of segment : 451 time for calcul the mask position with numpy : 0.0005860328674316406 nb_pixel_total : 26167 time to create 1 rle with old method : 0.030293703079223633 length of segment : 174 time for calcul the mask position with numpy : 0.0030202865600585938 nb_pixel_total : 170127 time to create 1 rle with new method : 0.0074346065521240234 length of segment : 423 time for calcul the mask position with numpy : 0.005222320556640625 nb_pixel_total : 223070 time to create 1 rle with new method : 0.013733148574829102 length of segment : 533 time for calcul the mask position with numpy : 0.0100555419921875 nb_pixel_total : 439492 time to create 1 rle with new method : 0.04538297653198242 length of segment : 1376 time for calcul the mask position with numpy : 0.001180410385131836 nb_pixel_total : 39996 time to create 1 rle with old method : 0.04730081558227539 length of segment : 244 time for calcul the mask position with numpy : 0.0009379386901855469 nb_pixel_total : 50582 time to create 1 rle with old method : 0.06342387199401855 length of segment : 317 time for calcul the mask position with numpy : 0.0009884834289550781 nb_pixel_total : 46664 time to create 1 rle with old method : 0.051082611083984375 length of segment : 264 time for calcul the mask position with numpy : 0.00747227668762207 nb_pixel_total : 367462 time to create 1 rle with new method : 0.021239042282104492 length of segment : 757 time for calcul the mask position with numpy : 0.0029938220977783203 nb_pixel_total : 70298 time to create 1 rle with old method : 0.0878300666809082 length of segment : 466 time for calcul the mask position with numpy : 0.004247903823852539 nb_pixel_total : 277316 time to create 1 rle with new method : 0.011244535446166992 length of segment : 740 time for calcul the mask position with numpy : 0.0010018348693847656 nb_pixel_total : 40807 time to create 1 rle with old method : 0.05390477180480957 length of segment : 159 time for calcul the mask position with numpy : 0.002131223678588867 nb_pixel_total : 104851 time to create 1 rle with old method : 0.128889799118042 length of segment : 310 time for calcul the mask position with numpy : 0.002839803695678711 nb_pixel_total : 80442 time to create 1 rle with old method : 0.09169673919677734 length of segment : 310 time for calcul the mask position with numpy : 0.0011792182922363281 nb_pixel_total : 57459 time to create 1 rle with old method : 0.07283425331115723 length of segment : 427 time for calcul the mask position with numpy : 0.0019540786743164062 nb_pixel_total : 73278 time to create 1 rle with old method : 0.08433938026428223 length of segment : 322 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 18503 time to create 1 rle with old method : 0.022617101669311523 length of segment : 158 time for calcul the mask position with numpy : 0.002126932144165039 nb_pixel_total : 83372 time to create 1 rle with old method : 0.09620499610900879 length of segment : 338 time for calcul the mask position with numpy : 0.005480051040649414 nb_pixel_total : 325364 time to create 1 rle with new method : 0.014003515243530273 length of segment : 507 time for calcul the mask position with numpy : 0.0020227432250976562 nb_pixel_total : 105581 time to create 1 rle with old method : 0.11861109733581543 length of segment : 455 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 15112 time to create 1 rle with old method : 0.018866539001464844 length of segment : 186 time for calcul the mask position with numpy : 0.007731914520263672 nb_pixel_total : 474873 time to create 1 rle with new method : 0.020404815673828125 length of segment : 920 time for calcul the mask position with numpy : 0.010836362838745117 nb_pixel_total : 336927 time to create 1 rle with new method : 0.12052011489868164 length of segment : 1178 time for calcul the mask position with numpy : 0.003941774368286133 nb_pixel_total : 182308 time to create 1 rle with new method : 0.01174306869506836 length of segment : 594 time for calcul the mask position with numpy : 0.003929853439331055 nb_pixel_total : 177094 time to create 1 rle with new method : 0.011217355728149414 length of segment : 539 time for calcul the mask position with numpy : 0.002026081085205078 nb_pixel_total : 83166 time to create 1 rle with old method : 0.1011502742767334 length of segment : 479 time for calcul the mask position with numpy : 0.0007109642028808594 nb_pixel_total : 24340 time to create 1 rle with old method : 0.029962539672851562 length of segment : 205 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 40842 time to create 1 rle with old method : 0.047326087951660156 length of segment : 202 time for calcul the mask position with numpy : 0.0006089210510253906 nb_pixel_total : 26526 time to create 1 rle with old method : 0.03193974494934082 length of segment : 156 time for calcul the mask position with numpy : 0.00342559814453125 nb_pixel_total : 174936 time to create 1 rle with new method : 0.01119685173034668 length of segment : 354 time for calcul the mask position with numpy : 0.001348257064819336 nb_pixel_total : 60698 time to create 1 rle with old method : 0.06516170501708984 length of segment : 422 time for calcul the mask position with numpy : 0.0012285709381103516 nb_pixel_total : 62973 time to create 1 rle with old method : 0.06975579261779785 length of segment : 242 time for calcul the mask position with numpy : 0.0027441978454589844 nb_pixel_total : 102884 time to create 1 rle with old method : 0.10970401763916016 length of segment : 593 time for calcul the mask position with numpy : 0.0026662349700927734 nb_pixel_total : 70356 time to create 1 rle with old method : 0.08031320571899414 length of segment : 528 time for calcul the mask position with numpy : 0.0020265579223632812 nb_pixel_total : 44569 time to create 1 rle with old method : 0.050711631774902344 length of segment : 334 time for calcul the mask position with numpy : 0.0048084259033203125 nb_pixel_total : 218986 time to create 1 rle with new method : 0.01318979263305664 length of segment : 603 time for calcul the mask position with numpy : 0.001062631607055664 nb_pixel_total : 48875 time to create 1 rle with old method : 0.05572199821472168 length of segment : 372 time for calcul the mask position with numpy : 0.03134512901306152 nb_pixel_total : 1207507 time to create 1 rle with new method : 0.5420455932617188 length of segment : 1388 time for calcul the mask position with numpy : 0.0047795772552490234 nb_pixel_total : 245094 time to create 1 rle with new method : 0.013478755950927734 length of segment : 503 time for calcul the mask position with numpy : 0.004679679870605469 nb_pixel_total : 256472 time to create 1 rle with new method : 0.012875795364379883 length of segment : 683 time for calcul the mask position with numpy : 0.003361940383911133 nb_pixel_total : 93955 time to create 1 rle with old method : 0.10512614250183105 length of segment : 344 time for calcul the mask position with numpy : 0.0036907196044921875 nb_pixel_total : 206027 time to create 1 rle with new method : 0.010246753692626953 length of segment : 608 time for calcul the mask position with numpy : 0.0006055831909179688 nb_pixel_total : 17889 time to create 1 rle with old method : 0.022471189498901367 length of segment : 144 time for calcul the mask position with numpy : 0.00391840934753418 nb_pixel_total : 200646 time to create 1 rle with new method : 0.009696722030639648 length of segment : 519 time for calcul the mask position with numpy : 0.001651763916015625 nb_pixel_total : 79205 time to create 1 rle with old method : 0.09809279441833496 length of segment : 296 time for calcul the mask position with numpy : 0.007741212844848633 nb_pixel_total : 316527 time to create 1 rle with new method : 0.02138972282409668 length of segment : 860 time for calcul the mask position with numpy : 0.003312826156616211 nb_pixel_total : 193307 time to create 1 rle with new method : 0.009171009063720703 length of segment : 743 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 20841 time to create 1 rle with old method : 0.026903390884399414 length of segment : 72 time for calcul the mask position with numpy : 0.0030956268310546875 nb_pixel_total : 184503 time to create 1 rle with new method : 0.00856637954711914 length of segment : 446 time for calcul the mask position with numpy : 0.0021295547485351562 nb_pixel_total : 95207 time to create 1 rle with old method : 0.11165452003479004 length of segment : 574 time for calcul the mask position with numpy : 0.0007066726684570312 nb_pixel_total : 12084 time to create 1 rle with old method : 0.01425027847290039 length of segment : 284 time for calcul the mask position with numpy : 0.0007946491241455078 nb_pixel_total : 35258 time to create 1 rle with old method : 0.038639068603515625 length of segment : 277 time for calcul the mask position with numpy : 0.0021142959594726562 nb_pixel_total : 80306 time to create 1 rle with old method : 0.08989238739013672 length of segment : 544 time for calcul the mask position with numpy : 0.006471395492553711 nb_pixel_total : 325981 time to create 1 rle with new method : 0.016884565353393555 length of segment : 820 time for calcul the mask position with numpy : 0.001917123794555664 nb_pixel_total : 99235 time to create 1 rle with old method : 0.12333250045776367 length of segment : 350 time for calcul the mask position with numpy : 0.012167215347290039 nb_pixel_total : 565395 time to create 1 rle with new method : 0.04434800148010254 length of segment : 827 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 11189 time to create 1 rle with old method : 0.013431549072265625 length of segment : 136 time for calcul the mask position with numpy : 0.0024182796478271484 nb_pixel_total : 100330 time to create 1 rle with old method : 0.12117910385131836 length of segment : 497 time for calcul the mask position with numpy : 0.0015592575073242188 nb_pixel_total : 68858 time to create 1 rle with old method : 0.07691717147827148 length of segment : 377 time for calcul the mask position with numpy : 0.009157180786132812 nb_pixel_total : 419577 time to create 1 rle with new method : 0.02755284309387207 length of segment : 1191 time for calcul the mask position with numpy : 0.0016722679138183594 nb_pixel_total : 68426 time to create 1 rle with old method : 0.07857513427734375 length of segment : 273 time for calcul the mask position with numpy : 0.0012867450714111328 nb_pixel_total : 56500 time to create 1 rle with old method : 0.06612253189086914 length of segment : 296 time for calcul the mask position with numpy : 0.006185770034790039 nb_pixel_total : 335924 time to create 1 rle with new method : 0.01851677894592285 length of segment : 602 time for calcul the mask position with numpy : 0.006678581237792969 nb_pixel_total : 377949 time to create 1 rle with new method : 0.017792224884033203 length of segment : 628 time for calcul the mask position with numpy : 0.005245685577392578 nb_pixel_total : 164387 time to create 1 rle with new method : 0.016034364700317383 length of segment : 672 time for calcul the mask position with numpy : 0.008795022964477539 nb_pixel_total : 477478 time to create 1 rle with new method : 0.021711111068725586 length of segment : 1060 time for calcul the mask position with numpy : 0.0011954307556152344 nb_pixel_total : 48780 time to create 1 rle with old method : 0.05604147911071777 length of segment : 448 time for calcul the mask position with numpy : 0.0029401779174804688 nb_pixel_total : 165119 time to create 1 rle with new method : 0.007790327072143555 length of segment : 335 time for calcul the mask position with numpy : 0.0030574798583984375 nb_pixel_total : 142413 time to create 1 rle with old method : 0.16980862617492676 length of segment : 394 time for calcul the mask position with numpy : 0.0016922950744628906 nb_pixel_total : 85178 time to create 1 rle with old method : 0.09896636009216309 length of segment : 323 time for calcul the mask position with numpy : 0.004029512405395508 nb_pixel_total : 179898 time to create 1 rle with new method : 0.00887441635131836 length of segment : 422 time for calcul the mask position with numpy : 0.002591848373413086 nb_pixel_total : 150143 time to create 1 rle with new method : 0.007273674011230469 length of segment : 537 time for calcul the mask position with numpy : 0.004174232482910156 nb_pixel_total : 242643 time to create 1 rle with new method : 0.010295867919921875 length of segment : 793 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 61529 time to create 1 rle with old method : 0.07269906997680664 length of segment : 225 time for calcul the mask position with numpy : 0.023244142532348633 nb_pixel_total : 1282147 time to create 1 rle with new method : 1.02451753616333 length of segment : 1245 time for calcul the mask position with numpy : 0.009825468063354492 nb_pixel_total : 564792 time to create 1 rle with new method : 0.044939279556274414 length of segment : 1185 time for calcul the mask position with numpy : 0.006608486175537109 nb_pixel_total : 411784 time to create 1 rle with new method : 0.017299413681030273 length of segment : 589 time for calcul the mask position with numpy : 0.0026819705963134766 nb_pixel_total : 115527 time to create 1 rle with old method : 0.13272857666015625 length of segment : 366 time for calcul the mask position with numpy : 0.0012345314025878906 nb_pixel_total : 52933 time to create 1 rle with old method : 0.06325387954711914 length of segment : 335 time for calcul the mask position with numpy : 0.0022056102752685547 nb_pixel_total : 138969 time to create 1 rle with old method : 0.15942740440368652 length of segment : 329 time for calcul the mask position with numpy : 0.004134654998779297 nb_pixel_total : 249272 time to create 1 rle with new method : 0.010419607162475586 length of segment : 666 time for calcul the mask position with numpy : 0.21955251693725586 nb_pixel_total : 3373093 time to create 1 rle with new method : 1.0183286666870117 length of segment : 2158 time for calcul the mask position with numpy : 0.0014102458953857422 nb_pixel_total : 73719 time to create 1 rle with old method : 0.09070396423339844 length of segment : 347 time for calcul the mask position with numpy : 0.0017294883728027344 nb_pixel_total : 69574 time to create 1 rle with old method : 0.08852910995483398 length of segment : 266 time for calcul the mask position with numpy : 0.00077056884765625 nb_pixel_total : 41780 time to create 1 rle with old method : 0.05297732353210449 length of segment : 203 time for calcul the mask position with numpy : 0.0028650760650634766 nb_pixel_total : 167162 time to create 1 rle with new method : 0.008203506469726562 length of segment : 509 time for calcul the mask position with numpy : 0.0031633377075195312 nb_pixel_total : 133857 time to create 1 rle with old method : 0.15833234786987305 length of segment : 633 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 37023 time to create 1 rle with old method : 0.04336881637573242 length of segment : 169 time for calcul the mask position with numpy : 0.008845329284667969 nb_pixel_total : 491917 time to create 1 rle with new method : 0.023110628128051758 length of segment : 783 time for calcul the mask position with numpy : 0.005633115768432617 nb_pixel_total : 326796 time to create 1 rle with new method : 0.015596628189086914 length of segment : 868 time for calcul the mask position with numpy : 0.002506256103515625 nb_pixel_total : 137490 time to create 1 rle with old method : 0.1617414951324463 length of segment : 487 time for calcul the mask position with numpy : 0.0028378963470458984 nb_pixel_total : 171537 time to create 1 rle with new method : 0.007157325744628906 length of segment : 383 time for calcul the mask position with numpy : 0.003406524658203125 nb_pixel_total : 178682 time to create 1 rle with new method : 0.008362770080566406 length of segment : 564 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 14423 time to create 1 rle with old method : 0.01711416244506836 length of segment : 156 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 23784 time to create 1 rle with old method : 0.028603315353393555 length of segment : 258 time for calcul the mask position with numpy : 0.0020661354064941406 nb_pixel_total : 123350 time to create 1 rle with old method : 0.14498686790466309 length of segment : 276 time for calcul the mask position with numpy : 0.0013346672058105469 nb_pixel_total : 63473 time to create 1 rle with old method : 0.07376790046691895 length of segment : 303 time for calcul the mask position with numpy : 0.005594730377197266 nb_pixel_total : 244201 time to create 1 rle with new method : 0.01667618751525879 length of segment : 1266 time for calcul the mask position with numpy : 0.003096342086791992 nb_pixel_total : 125892 time to create 1 rle with old method : 0.1414496898651123 length of segment : 417 time for calcul the mask position with numpy : 0.0032575130462646484 nb_pixel_total : 146551 time to create 1 rle with old method : 0.1677558422088623 length of segment : 664 time for calcul the mask position with numpy : 0.001039743423461914 nb_pixel_total : 51798 time to create 1 rle with old method : 0.05853581428527832 length of segment : 255 time for calcul the mask position with numpy : 0.0053653717041015625 nb_pixel_total : 235907 time to create 1 rle with new method : 0.017749547958374023 length of segment : 1014 time for calcul the mask position with numpy : 0.0019507408142089844 nb_pixel_total : 71166 time to create 1 rle with old method : 0.08011269569396973 length of segment : 334 time for calcul the mask position with numpy : 0.0028853416442871094 nb_pixel_total : 180337 time to create 1 rle with new method : 0.007444143295288086 length of segment : 374 time for calcul the mask position with numpy : 0.0026159286499023438 nb_pixel_total : 95996 time to create 1 rle with old method : 0.10718274116516113 length of segment : 347 time for calcul the mask position with numpy : 0.006817340850830078 nb_pixel_total : 422429 time to create 1 rle with new method : 0.018247127532958984 length of segment : 1151 time for calcul the mask position with numpy : 0.0010941028594970703 nb_pixel_total : 63899 time to create 1 rle with old method : 0.07146239280700684 length of segment : 299 time for calcul the mask position with numpy : 0.0032134056091308594 nb_pixel_total : 193892 time to create 1 rle with new method : 0.008350610733032227 length of segment : 810 time for calcul the mask position with numpy : 0.003201723098754883 nb_pixel_total : 158433 time to create 1 rle with new method : 0.009644031524658203 length of segment : 664 time for calcul the mask position with numpy : 0.002210378646850586 nb_pixel_total : 75744 time to create 1 rle with old method : 0.08830380439758301 length of segment : 326 time for calcul the mask position with numpy : 0.0025887489318847656 nb_pixel_total : 108522 time to create 1 rle with old method : 0.13344979286193848 length of segment : 362 time for calcul the mask position with numpy : 0.0034041404724121094 nb_pixel_total : 231837 time to create 1 rle with new method : 0.008636474609375 length of segment : 704 time for calcul the mask position with numpy : 0.12235522270202637 nb_pixel_total : 2890436 time to create 1 rle with new method : 0.45172619819641113 length of segment : 2345 time for calcul the mask position with numpy : 0.001110076904296875 nb_pixel_total : 52373 time to create 1 rle with old method : 0.06568527221679688 length of segment : 256 time for calcul the mask position with numpy : 0.010756731033325195 nb_pixel_total : 460576 time to create 1 rle with new method : 0.05261969566345215 length of segment : 761 time for calcul the mask position with numpy : 0.002190113067626953 nb_pixel_total : 99516 time to create 1 rle with old method : 0.10930681228637695 length of segment : 357 time for calcul the mask position with numpy : 0.006222724914550781 nb_pixel_total : 304016 time to create 1 rle with new method : 0.019036054611206055 length of segment : 1056 time for calcul the mask position with numpy : 0.3620026111602783 nb_pixel_total : 5260393 time to create 1 rle with new method : 0.7090837955474854 length of segment : 5794 time for calcul the mask position with numpy : 0.29761266708374023 nb_pixel_total : 4307396 time to create 1 rle with new method : 0.318845272064209 length of segment : 1862 time for calcul the mask position with numpy : 0.0012450218200683594 nb_pixel_total : 88504 time to create 1 rle with old method : 0.10129857063293457 length of segment : 162 time for calcul the mask position with numpy : 0.01959514617919922 nb_pixel_total : 1613946 time to create 1 rle with new method : 0.10678505897521973 length of segment : 1481 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 100270 time to create 1 rle with old method : 0.1201012134552002 length of segment : 265 time spent for convertir_results : 47.55161237716675 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 284 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 119.74286794662476 time spend to save output : 0.19303679466247559 total time spend for step 2 : 119.93590474128723 step3:blur_detection Tue May 13 03:24:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.008767843246459961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.008336544036865234 save missing photos in datou_result : time spend for datou_step_exec : 0.028955459594726562 time spend to save output : 0.021677017211914062 total time spend for step 3 : 0.050632476806640625 step4:brightness Tue May 13 03:24:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.009039640426635742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.007932901382446289 save missing photos in datou_result : time spend for datou_step_exec : 0.026940345764160156 time spend to save output : 0.021724224090576172 total time spend for step 4 : 0.04866456985473633 step5:rle_unique_nms_with_priority Tue May 13 03:24:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 284 chid ids of type : 4854 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 58 nb_hashtags : 9 time to prepare the origin masks : 45.534932374954224 time for calcul the mask position with numpy : 0.9354739189147949 nb_pixel_total : 5980757 time to create 1 rle with new method : 1.5166711807250977 time for calcul the mask position with numpy : 0.0558009147644043 nb_pixel_total : 2486 time to create 1 rle with old method : 0.0031576156616210938 time for calcul the mask position with numpy : 0.0605008602142334 nb_pixel_total : 305153 time to create 1 rle with new method : 1.2736046314239502 time for calcul the mask position with numpy : 0.05157804489135742 nb_pixel_total : 41276 time to create 1 rle with old method : 0.04755449295043945 time for calcul the mask position with numpy : 0.05272674560546875 nb_pixel_total : 48083 time to create 1 rle with old method : 0.05199027061462402 time for calcul the mask position with numpy : 0.04998612403869629 nb_pixel_total : 33611 time to create 1 rle with old method : 0.03601717948913574 time for calcul the mask position with numpy : 0.049347877502441406 nb_pixel_total : 138 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.051972389221191406 nb_pixel_total : 117457 time to create 1 rle with old method : 0.1914377212524414 time for calcul the mask position with numpy : 0.08707022666931152 nb_pixel_total : 133814 time to create 1 rle with old method : 0.14695143699645996 time for calcul the mask position with numpy : 0.05097150802612305 nb_pixel_total : 2371 time to create 1 rle with old method : 0.0027267932891845703 time for calcul the mask position with numpy : 0.051409006118774414 nb_pixel_total : 109056 time to create 1 rle with old method : 0.11854100227355957 time for calcul the mask position with numpy : 0.052390098571777344 nb_pixel_total : 30377 time to create 1 rle with old method : 0.033876657485961914 time for calcul the mask position with numpy : 0.05077672004699707 nb_pixel_total : 53921 time to create 1 rle with old method : 0.05852031707763672 time for calcul the mask position with numpy : 0.05130887031555176 nb_pixel_total : 1632 time to create 1 rle with old method : 0.001878976821899414 time for calcul the mask position with numpy : 0.05079984664916992 nb_pixel_total : 104238 time to create 1 rle with old method : 0.14265847206115723 time for calcul the mask position with numpy : 0.05974698066711426 nb_pixel_total : 212627 time to create 1 rle with new method : 1.143045425415039 time for calcul the mask position with numpy : 0.051954030990600586 nb_pixel_total : 27514 time to create 1 rle with old method : 0.030991077423095703 time for calcul the mask position with numpy : 0.05112195014953613 nb_pixel_total : 23204 time to create 1 rle with old method : 0.026271820068359375 time for calcul the mask position with numpy : 0.05551028251647949 nb_pixel_total : 370343 time to create 1 rle with new method : 1.1894996166229248 time for calcul the mask position with numpy : 0.050939083099365234 nb_pixel_total : 22593 time to create 1 rle with old method : 0.03062748908996582 time for calcul the mask position with numpy : 0.06015324592590332 nb_pixel_total : 97553 time to create 1 rle with old method : 0.10842561721801758 time for calcul the mask position with numpy : 0.05212092399597168 nb_pixel_total : 399982 time to create 1 rle with new method : 1.1964137554168701 time for calcul the mask position with numpy : 0.05035877227783203 nb_pixel_total : 99533 time to create 1 rle with old method : 0.11287426948547363 time for calcul the mask position with numpy : 0.05114340782165527 nb_pixel_total : 53786 time to create 1 rle with old method : 0.05961298942565918 time for calcul the mask position with numpy : 0.05138206481933594 nb_pixel_total : 64842 time to create 1 rle with old method : 0.0707252025604248 time for calcul the mask position with numpy : 0.05361151695251465 nb_pixel_total : 434500 time to create 1 rle with new method : 1.4141621589660645 time for calcul the mask position with numpy : 0.052939414978027344 nb_pixel_total : 8832 time to create 1 rle with old method : 0.010477542877197266 time for calcul the mask position with numpy : 0.05376935005187988 nb_pixel_total : 133669 time to create 1 rle with old method : 0.1525132656097412 time for calcul the mask position with numpy : 0.053586483001708984 nb_pixel_total : 65316 time to create 1 rle with old method : 0.07536697387695312 time for calcul the mask position with numpy : 0.0540771484375 nb_pixel_total : 4357 time to create 1 rle with old method : 0.004994392395019531 time for calcul the mask position with numpy : 0.053746700286865234 nb_pixel_total : 23773 time to create 1 rle with old method : 0.038598060607910156 time for calcul the mask position with numpy : 0.05598282814025879 nb_pixel_total : 25705 time to create 1 rle with old method : 0.028676986694335938 time for calcul the mask position with numpy : 0.05172300338745117 nb_pixel_total : 28324 time to create 1 rle with old method : 0.03209209442138672 time for calcul the mask position with numpy : 0.05310320854187012 nb_pixel_total : 287559 time to create 1 rle with new method : 0.8673005104064941 time for calcul the mask position with numpy : 0.05402636528015137 nb_pixel_total : 197947 time to create 1 rle with new method : 1.2599270343780518 time for calcul the mask position with numpy : 0.07379651069641113 nb_pixel_total : 103009 time to create 1 rle with old method : 0.2374873161315918 time for calcul the mask position with numpy : 0.061826467514038086 nb_pixel_total : 181292 time to create 1 rle with new method : 1.189788579940796 time for calcul the mask position with numpy : 0.052222490310668945 nb_pixel_total : 79717 time to create 1 rle with old method : 0.10895729064941406 time for calcul the mask position with numpy : 0.05453300476074219 nb_pixel_total : 15819 time to create 1 rle with old method : 0.0184478759765625 time for calcul the mask position with numpy : 0.05329751968383789 nb_pixel_total : 55346 time to create 1 rle with old method : 0.06556320190429688 time for calcul the mask position with numpy : 0.22330212593078613 nb_pixel_total : 651475 time to create 1 rle with new method : 0.9208056926727295 time for calcul the mask position with numpy : 0.051500797271728516 nb_pixel_total : 38865 time to create 1 rle with old method : 0.04313015937805176 time for calcul the mask position with numpy : 0.050126075744628906 nb_pixel_total : 220672 time to create 1 rle with new method : 1.107645034790039 time for calcul the mask position with numpy : 0.04949760437011719 nb_pixel_total : 100457 time to create 1 rle with old method : 0.10858845710754395 time for calcul the mask position with numpy : 0.04912304878234863 nb_pixel_total : 34131 time to create 1 rle with old method : 0.03580927848815918 time for calcul the mask position with numpy : 0.04867148399353027 nb_pixel_total : 116683 time to create 1 rle with old method : 0.12838125228881836 time for calcul the mask position with numpy : 0.04986763000488281 nb_pixel_total : 278122 time to create 1 rle with new method : 0.9869675636291504 time for calcul the mask position with numpy : 0.05534982681274414 nb_pixel_total : 129908 time to create 1 rle with old method : 0.14570260047912598 time for calcul the mask position with numpy : 0.05110573768615723 nb_pixel_total : 14942 time to create 1 rle with old method : 0.017853736877441406 time for calcul the mask position with numpy : 0.05380678176879883 nb_pixel_total : 107639 time to create 1 rle with old method : 0.12505459785461426 time for calcul the mask position with numpy : 0.05228281021118164 nb_pixel_total : 78091 time to create 1 rle with old method : 0.08697247505187988 time for calcul the mask position with numpy : 0.05005621910095215 nb_pixel_total : 49549 time to create 1 rle with old method : 0.05610942840576172 time for calcul the mask position with numpy : 0.05328059196472168 nb_pixel_total : 476447 time to create 1 rle with new method : 1.0351893901824951 time for calcul the mask position with numpy : 0.05808448791503906 nb_pixel_total : 78087 time to create 1 rle with old method : 0.09848928451538086 time for calcul the mask position with numpy : 0.054212331771850586 nb_pixel_total : 269570 time to create 1 rle with new method : 1.0141470432281494 time for calcul the mask position with numpy : 0.05134010314941406 nb_pixel_total : 48609 time to create 1 rle with old method : 0.055216073989868164 time for calcul the mask position with numpy : 0.053887128829956055 nb_pixel_total : 91752 time to create 1 rle with old method : 0.10325360298156738 time for calcul the mask position with numpy : 0.0516505241394043 nb_pixel_total : 145692 time to create 1 rle with old method : 0.15532875061035156 time for calcul the mask position with numpy : 0.05048799514770508 nb_pixel_total : 66997 time to create 1 rle with old method : 0.07243180274963379 create new chi : 24.206170797348022 time to delete rle : 0.02251434326171875 batch 1 Loaded 59 chid ids of type : 4855 Number RLEs to save : 49192 TO DO : save crop sub photo not yet done ! save time : 3.0207571983337402 nb_obj : 64 nb_hashtags : 9 time to prepare the origin masks : 53.42460298538208 time for calcul the mask position with numpy : 0.5501449108123779 nb_pixel_total : 4139095 time to create 1 rle with new method : 1.3147623538970947 time for calcul the mask position with numpy : 0.05123758316040039 nb_pixel_total : 691 time to create 1 rle with old method : 0.0011723041534423828 time for calcul the mask position with numpy : 0.06200003623962402 nb_pixel_total : 383433 time to create 1 rle with new method : 1.2825045585632324 time for calcul the mask position with numpy : 0.05420494079589844 nb_pixel_total : 251364 time to create 1 rle with new method : 1.3747878074645996 time for calcul the mask position with numpy : 0.0520634651184082 nb_pixel_total : 46911 time to create 1 rle with old method : 0.05275273323059082 time for calcul the mask position with numpy : 0.05767321586608887 nb_pixel_total : 519892 time to create 1 rle with new method : 1.6478424072265625 time for calcul the mask position with numpy : 0.052794694900512695 nb_pixel_total : 12078 time to create 1 rle with old method : 0.01371908187866211 time for calcul the mask position with numpy : 0.05311131477355957 nb_pixel_total : 3306 time to create 1 rle with old method : 0.00461578369140625 time for calcul the mask position with numpy : 0.055715322494506836 nb_pixel_total : 82773 time to create 1 rle with old method : 0.09501242637634277 time for calcul the mask position with numpy : 0.05315041542053223 nb_pixel_total : 392524 time to create 1 rle with new method : 1.2376394271850586 time for calcul the mask position with numpy : 0.05342912673950195 nb_pixel_total : 2822 time to create 1 rle with old method : 0.003317117691040039 time for calcul the mask position with numpy : 0.050839900970458984 nb_pixel_total : 24236 time to create 1 rle with old method : 0.02623891830444336 time for calcul the mask position with numpy : 0.050937652587890625 nb_pixel_total : 41920 time to create 1 rle with old method : 0.0473480224609375 time for calcul the mask position with numpy : 0.05169391632080078 nb_pixel_total : 25708 time to create 1 rle with old method : 0.02869439125061035 time for calcul the mask position with numpy : 0.052370309829711914 nb_pixel_total : 176085 time to create 1 rle with new method : 2.373028516769409 time for calcul the mask position with numpy : 0.050144195556640625 nb_pixel_total : 6029 time to create 1 rle with old method : 0.0069065093994140625 time for calcul the mask position with numpy : 0.05080842971801758 nb_pixel_total : 23608 time to create 1 rle with old method : 0.025916099548339844 time for calcul the mask position with numpy : 0.050746917724609375 nb_pixel_total : 158 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.05302739143371582 nb_pixel_total : 544430 time to create 1 rle with new method : 1.2690112590789795 time for calcul the mask position with numpy : 0.05133223533630371 nb_pixel_total : 49965 time to create 1 rle with old method : 0.05532026290893555 time for calcul the mask position with numpy : 0.050911664962768555 nb_pixel_total : 44459 time to create 1 rle with old method : 0.05203413963317871 time for calcul the mask position with numpy : 0.05339789390563965 nb_pixel_total : 51391 time to create 1 rle with old method : 0.056853532791137695 time for calcul the mask position with numpy : 0.050351858139038086 nb_pixel_total : 28072 time to create 1 rle with old method : 0.0314791202545166 time for calcul the mask position with numpy : 0.05161857604980469 nb_pixel_total : 10167 time to create 1 rle with old method : 0.011283636093139648 time for calcul the mask position with numpy : 0.050743818283081055 nb_pixel_total : 70725 time to create 1 rle with old method : 0.08043622970581055 time for calcul the mask position with numpy : 0.1680927276611328 nb_pixel_total : 38469 time to create 1 rle with old method : 0.056867122650146484 time for calcul the mask position with numpy : 0.05943632125854492 nb_pixel_total : 137698 time to create 1 rle with old method : 0.1554274559020996 time for calcul the mask position with numpy : 0.052100419998168945 nb_pixel_total : 63133 time to create 1 rle with old method : 0.07155656814575195 time for calcul the mask position with numpy : 0.05204176902770996 nb_pixel_total : 46025 time to create 1 rle with old method : 0.052445411682128906 time for calcul the mask position with numpy : 0.05273175239562988 nb_pixel_total : 133044 time to create 1 rle with old method : 0.14951157569885254 time for calcul the mask position with numpy : 0.05190396308898926 nb_pixel_total : 81997 time to create 1 rle with old method : 0.09160542488098145 time for calcul the mask position with numpy : 0.051764488220214844 nb_pixel_total : 32889 time to create 1 rle with old method : 0.0365147590637207 time for calcul the mask position with numpy : 0.05245089530944824 nb_pixel_total : 193044 time to create 1 rle with new method : 1.1049480438232422 time for calcul the mask position with numpy : 0.052298545837402344 nb_pixel_total : 72386 time to create 1 rle with old method : 0.07996439933776855 time for calcul the mask position with numpy : 0.18828535079956055 nb_pixel_total : 74191 time to create 1 rle with old method : 0.08255696296691895 time for calcul the mask position with numpy : 0.05092263221740723 nb_pixel_total : 72521 time to create 1 rle with old method : 0.08037900924682617 time for calcul the mask position with numpy : 0.051743507385253906 nb_pixel_total : 11748 time to create 1 rle with old method : 0.013507604598999023 time for calcul the mask position with numpy : 0.05419611930847168 nb_pixel_total : 87591 time to create 1 rle with old method : 0.10025167465209961 time for calcul the mask position with numpy : 0.052376508712768555 nb_pixel_total : 141250 time to create 1 rle with old method : 0.15785598754882812 time for calcul the mask position with numpy : 0.05142402648925781 nb_pixel_total : 26943 time to create 1 rle with old method : 0.03055095672607422 time for calcul the mask position with numpy : 0.05575442314147949 nb_pixel_total : 291562 time to create 1 rle with new method : 1.6161093711853027 time for calcul the mask position with numpy : 0.052350521087646484 nb_pixel_total : 5201 time to create 1 rle with old method : 0.006386280059814453 time for calcul the mask position with numpy : 0.05648374557495117 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006442070007324219 time for calcul the mask position with numpy : 0.05603146553039551 nb_pixel_total : 352007 time to create 1 rle with new method : 1.0589406490325928 time for calcul the mask position with numpy : 0.05292630195617676 nb_pixel_total : 62942 time to create 1 rle with old method : 0.06957149505615234 time for calcul the mask position with numpy : 0.052480459213256836 nb_pixel_total : 51378 time to create 1 rle with old method : 0.06374788284301758 time for calcul the mask position with numpy : 0.06020927429199219 nb_pixel_total : 514 time to create 1 rle with old method : 0.0012264251708984375 time for calcul the mask position with numpy : 0.05218362808227539 nb_pixel_total : 84605 time to create 1 rle with old method : 0.09477615356445312 time for calcul the mask position with numpy : 0.05229687690734863 nb_pixel_total : 69072 time to create 1 rle with old method : 0.07883381843566895 time for calcul the mask position with numpy : 0.06284046173095703 nb_pixel_total : 744335 time to create 1 rle with new method : 1.6134529113769531 time for calcul the mask position with numpy : 0.05059051513671875 nb_pixel_total : 107747 time to create 1 rle with old method : 0.11662745475769043 time for calcul the mask position with numpy : 0.051566123962402344 nb_pixel_total : 138607 time to create 1 rle with old method : 0.1538984775543213 time for calcul the mask position with numpy : 0.05130624771118164 nb_pixel_total : 68497 time to create 1 rle with old method : 0.07510972023010254 time for calcul the mask position with numpy : 0.05023908615112305 nb_pixel_total : 55110 time to create 1 rle with old method : 0.05915427207946777 time for calcul the mask position with numpy : 0.06871652603149414 nb_pixel_total : 121616 time to create 1 rle with old method : 0.13045454025268555 time for calcul the mask position with numpy : 0.05365753173828125 nb_pixel_total : 177977 time to create 1 rle with new method : 1.5521626472473145 time for calcul the mask position with numpy : 0.05357217788696289 nb_pixel_total : 48469 time to create 1 rle with old method : 0.055777549743652344 time for calcul the mask position with numpy : 0.05284428596496582 nb_pixel_total : 31328 time to create 1 rle with old method : 0.03627610206604004 time for calcul the mask position with numpy : 0.055286407470703125 nb_pixel_total : 35470 time to create 1 rle with old method : 0.04069042205810547 time for calcul the mask position with numpy : 0.3450045585632324 nb_pixel_total : 1940536 time to create 1 rle with new method : 1.3292315006256104 time for calcul the mask position with numpy : 0.05277609825134277 nb_pixel_total : 146994 time to create 1 rle with old method : 0.16040921211242676 time for calcul the mask position with numpy : 0.051123619079589844 nb_pixel_total : 9992 time to create 1 rle with old method : 0.011152982711791992 time for calcul the mask position with numpy : 0.051720619201660156 nb_pixel_total : 179694 time to create 1 rle with new method : 1.357468605041504 time for calcul the mask position with numpy : 0.05359649658203125 nb_pixel_total : 84723 time to create 1 rle with old method : 0.09724974632263184 time for calcul the mask position with numpy : 0.05188727378845215 nb_pixel_total : 25580 time to create 1 rle with old method : 0.028805971145629883 create new chi : 28.233877420425415 time to delete rle : 0.004304170608520508 batch 1 Loaded 65 chid ids of type : 4855 Number RLEs to save : 50329 TO DO : save crop sub photo not yet done ! save time : 3.337587594985962 nb_obj : 92 nb_hashtags : 11 time to prepare the origin masks : 68.01460409164429 time for calcul the mask position with numpy : 0.4960517883300781 nb_pixel_total : 3679066 time to create 1 rle with new method : 1.40643310546875 time for calcul the mask position with numpy : 0.05245375633239746 nb_pixel_total : 102827 time to create 1 rle with old method : 0.11496710777282715 time for calcul the mask position with numpy : 0.06411337852478027 nb_pixel_total : 1361870 time to create 1 rle with new method : 1.1754333972930908 time for calcul the mask position with numpy : 0.05055379867553711 nb_pixel_total : 15398 time to create 1 rle with old method : 0.016959190368652344 time for calcul the mask position with numpy : 0.05114555358886719 nb_pixel_total : 13080 time to create 1 rle with old method : 0.015243053436279297 time for calcul the mask position with numpy : 0.050923824310302734 nb_pixel_total : 28706 time to create 1 rle with old method : 0.034052371978759766 time for calcul the mask position with numpy : 0.05074310302734375 nb_pixel_total : 7776 time to create 1 rle with old method : 0.009152889251708984 time for calcul the mask position with numpy : 0.05128049850463867 nb_pixel_total : 66053 time to create 1 rle with old method : 0.07933235168457031 time for calcul the mask position with numpy : 0.053436279296875 nb_pixel_total : 83265 time to create 1 rle with old method : 0.0900583267211914 time for calcul the mask position with numpy : 0.04924798011779785 nb_pixel_total : 4136 time to create 1 rle with old method : 0.005060434341430664 time for calcul the mask position with numpy : 0.1639246940612793 nb_pixel_total : 7027 time to create 1 rle with old method : 0.008159399032592773 time for calcul the mask position with numpy : 0.050748586654663086 nb_pixel_total : 47687 time to create 1 rle with old method : 0.05226469039916992 time for calcul the mask position with numpy : 0.05219745635986328 nb_pixel_total : 16580 time to create 1 rle with old method : 0.018006563186645508 time for calcul the mask position with numpy : 0.057602882385253906 nb_pixel_total : 1204449 time to create 1 rle with new method : 1.198007345199585 time for calcul the mask position with numpy : 0.050458669662475586 nb_pixel_total : 192909 time to create 1 rle with new method : 0.9853825569152832 time for calcul the mask position with numpy : 0.05047011375427246 nb_pixel_total : 962 time to create 1 rle with old method : 0.0012123584747314453 time for calcul the mask position with numpy : 0.05142688751220703 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003693103790283203 time for calcul the mask position with numpy : 0.05063915252685547 nb_pixel_total : 80227 time to create 1 rle with old method : 0.08554601669311523 time for calcul the mask position with numpy : 0.04978442192077637 nb_pixel_total : 176865 time to create 1 rle with new method : 1.1307144165039062 time for calcul the mask position with numpy : 0.04911231994628906 nb_pixel_total : 1328 time to create 1 rle with old method : 0.0014789104461669922 time for calcul the mask position with numpy : 0.04986381530761719 nb_pixel_total : 7844 time to create 1 rle with old method : 0.008851051330566406 time for calcul the mask position with numpy : 0.05026555061340332 nb_pixel_total : 2936 time to create 1 rle with old method : 1.0156595706939697 time for calcul the mask position with numpy : 0.05176877975463867 nb_pixel_total : 15087 time to create 1 rle with old method : 0.016097068786621094 time for calcul the mask position with numpy : 0.049185752868652344 nb_pixel_total : 44394 time to create 1 rle with old method : 0.04844951629638672 time for calcul the mask position with numpy : 0.16158485412597656 nb_pixel_total : 58265 time to create 1 rle with old method : 0.06172609329223633 time for calcul the mask position with numpy : 0.04969930648803711 nb_pixel_total : 16337 time to create 1 rle with old method : 0.01797032356262207 time for calcul the mask position with numpy : 0.051526784896850586 nb_pixel_total : 366637 time to create 1 rle with new method : 0.949385404586792 time for calcul the mask position with numpy : 0.0505826473236084 nb_pixel_total : 78492 time to create 1 rle with old method : 0.08376145362854004 time for calcul the mask position with numpy : 0.10672307014465332 nb_pixel_total : 11262 time to create 1 rle with old method : 0.012359380722045898 time for calcul the mask position with numpy : 0.051817893981933594 nb_pixel_total : 200428 time to create 1 rle with new method : 0.8707597255706787 time for calcul the mask position with numpy : 0.05158710479736328 nb_pixel_total : 7204 time to create 1 rle with old method : 0.008191108703613281 time for calcul the mask position with numpy : 0.05141448974609375 nb_pixel_total : 3490 time to create 1 rle with old method : 0.004244804382324219 time for calcul the mask position with numpy : 0.05131673812866211 nb_pixel_total : 252227 time to create 1 rle with new method : 1.225576400756836 time for calcul the mask position with numpy : 0.05446267127990723 nb_pixel_total : 57308 time to create 1 rle with old method : 0.06573963165283203 time for calcul the mask position with numpy : 0.05518364906311035 nb_pixel_total : 5537 time to create 1 rle with old method : 0.0065593719482421875 time for calcul the mask position with numpy : 0.053420305252075195 nb_pixel_total : 11146 time to create 1 rle with old method : 0.013085603713989258 time for calcul the mask position with numpy : 0.05344414710998535 nb_pixel_total : 17819 time to create 1 rle with old method : 0.02095174789428711 time for calcul the mask position with numpy : 0.053623199462890625 nb_pixel_total : 830 time to create 1 rle with old method : 0.0011241436004638672 time for calcul the mask position with numpy : 0.0562436580657959 nb_pixel_total : 70162 time to create 1 rle with old method : 0.08084297180175781 time for calcul the mask position with numpy : 0.054030656814575195 nb_pixel_total : 93372 time to create 1 rle with old method : 0.11144542694091797 time for calcul the mask position with numpy : 0.05545759201049805 nb_pixel_total : 474376 time to create 1 rle with new method : 1.6166775226593018 time for calcul the mask position with numpy : 0.05242562294006348 nb_pixel_total : 4033 time to create 1 rle with old method : 0.004821300506591797 time for calcul the mask position with numpy : 0.052872657775878906 nb_pixel_total : 9776 time to create 1 rle with old method : 0.018861055374145508 time for calcul the mask position with numpy : 0.0590825080871582 nb_pixel_total : 2928 time to create 1 rle with old method : 0.003764629364013672 time for calcul the mask position with numpy : 0.052965641021728516 nb_pixel_total : 62754 time to create 1 rle with old method : 0.0716404914855957 time for calcul the mask position with numpy : 0.05338430404663086 nb_pixel_total : 18420 time to create 1 rle with old method : 0.021317005157470703 time for calcul the mask position with numpy : 0.053713083267211914 nb_pixel_total : 71908 time to create 1 rle with old method : 0.0821535587310791 time for calcul the mask position with numpy : 0.05296683311462402 nb_pixel_total : 24463 time to create 1 rle with old method : 0.028293371200561523 time for calcul the mask position with numpy : 0.05249595642089844 nb_pixel_total : 12024 time to create 1 rle with old method : 0.014459848403930664 time for calcul the mask position with numpy : 0.05203390121459961 nb_pixel_total : 150518 time to create 1 rle with new method : 1.0466759204864502 time for calcul the mask position with numpy : 0.05114316940307617 nb_pixel_total : 48723 time to create 1 rle with old method : 0.05420064926147461 time for calcul the mask position with numpy : 0.051569223403930664 nb_pixel_total : 276866 time to create 1 rle with new method : 0.8671910762786865 time for calcul the mask position with numpy : 0.05033755302429199 nb_pixel_total : 40379 time to create 1 rle with old method : 0.043804168701171875 time for calcul the mask position with numpy : 0.04968714714050293 nb_pixel_total : 39913 time to create 1 rle with old method : 0.04471015930175781 time for calcul the mask position with numpy : 0.050545692443847656 nb_pixel_total : 222756 time to create 1 rle with new method : 0.9294917583465576 time for calcul the mask position with numpy : 0.05065727233886719 nb_pixel_total : 180981 time to create 1 rle with new method : 1.1109108924865723 time for calcul the mask position with numpy : 0.05406832695007324 nb_pixel_total : 30088 time to create 1 rle with old method : 0.03494405746459961 time for calcul the mask position with numpy : 0.05472397804260254 nb_pixel_total : 88429 time to create 1 rle with old method : 0.1011049747467041 time for calcul the mask position with numpy : 0.05434012413024902 nb_pixel_total : 70091 time to create 1 rle with old method : 0.08891057968139648 time for calcul the mask position with numpy : 0.053887367248535156 nb_pixel_total : 30983 time to create 1 rle with old method : 0.036078453063964844 time for calcul the mask position with numpy : 0.05386090278625488 nb_pixel_total : 56140 time to create 1 rle with old method : 0.0666351318359375 time for calcul the mask position with numpy : 0.05423545837402344 nb_pixel_total : 145097 time to create 1 rle with old method : 0.1668262481689453 time for calcul the mask position with numpy : 0.07761216163635254 nb_pixel_total : 575 time to create 1 rle with old method : 0.0012574195861816406 time for calcul the mask position with numpy : 0.05315113067626953 nb_pixel_total : 12037 time to create 1 rle with old method : 0.01370382308959961 time for calcul the mask position with numpy : 0.05361199378967285 nb_pixel_total : 24260 time to create 1 rle with old method : 0.02718806266784668 time for calcul the mask position with numpy : 0.05247330665588379 nb_pixel_total : 324219 time to create 1 rle with new method : 1.1921179294586182 time for calcul the mask position with numpy : 0.05205488204956055 nb_pixel_total : 50229 time to create 1 rle with old method : 0.06079888343811035 time for calcul the mask position with numpy : 0.053052663803100586 nb_pixel_total : 60552 time to create 1 rle with old method : 0.06851840019226074 time for calcul the mask position with numpy : 0.05400657653808594 nb_pixel_total : 51560 time to create 1 rle with old method : 0.06010556221008301 time for calcul the mask position with numpy : 0.05202746391296387 nb_pixel_total : 46666 time to create 1 rle with old method : 0.05145382881164551 time for calcul the mask position with numpy : 0.05125904083251953 nb_pixel_total : 76171 time to create 1 rle with old method : 0.08399009704589844 time for calcul the mask position with numpy : 0.051448822021484375 nb_pixel_total : 50457 time to create 1 rle with old method : 0.05634665489196777 time for calcul the mask position with numpy : 0.05048990249633789 nb_pixel_total : 2767 time to create 1 rle with old method : 0.0032837390899658203 time for calcul the mask position with numpy : 0.05244779586791992 nb_pixel_total : 193771 time to create 1 rle with new method : 1.0175349712371826 time for calcul the mask position with numpy : 0.052718400955200195 nb_pixel_total : 17837 time to create 1 rle with old method : 0.022150516510009766 time for calcul the mask position with numpy : 0.05323386192321777 nb_pixel_total : 35214 time to create 1 rle with old method : 0.04232478141784668 time for calcul the mask position with numpy : 0.053639888763427734 nb_pixel_total : 8878 time to create 1 rle with old method : 0.010390043258666992 time for calcul the mask position with numpy : 0.0563504695892334 nb_pixel_total : 337219 time to create 1 rle with new method : 1.3141484260559082 time for calcul the mask position with numpy : 0.05336737632751465 nb_pixel_total : 10940 time to create 1 rle with old method : 0.012304306030273438 time for calcul the mask position with numpy : 0.054625749588012695 nb_pixel_total : 439244 time to create 1 rle with new method : 1.5120298862457275 time for calcul the mask position with numpy : 0.05158519744873047 nb_pixel_total : 19859 time to create 1 rle with old method : 0.022846221923828125 time for calcul the mask position with numpy : 0.05272245407104492 nb_pixel_total : 105359 time to create 1 rle with old method : 0.12523221969604492 time for calcul the mask position with numpy : 0.05170893669128418 nb_pixel_total : 36352 time to create 1 rle with old method : 0.042296409606933594 time for calcul the mask position with numpy : 0.05210113525390625 nb_pixel_total : 5976 time to create 1 rle with old method : 0.006997585296630859 time for calcul the mask position with numpy : 0.05169224739074707 nb_pixel_total : 82873 time to create 1 rle with old method : 0.08841586112976074 time for calcul the mask position with numpy : 0.051448822021484375 nb_pixel_total : 68 time to create 1 rle with old method : 0.00015592575073242188 time for calcul the mask position with numpy : 0.05247688293457031 nb_pixel_total : 218727 time to create 1 rle with new method : 1.0037133693695068 time for calcul the mask position with numpy : 0.05268263816833496 nb_pixel_total : 3110 time to create 1 rle with old method : 0.003974199295043945 time for calcul the mask position with numpy : 0.051226139068603516 nb_pixel_total : 102671 time to create 1 rle with old method : 0.12853264808654785 time for calcul the mask position with numpy : 0.052429914474487305 nb_pixel_total : 45383 time to create 1 rle with old method : 0.05646371841430664 time for calcul the mask position with numpy : 0.05243182182312012 nb_pixel_total : 22551 time to create 1 rle with old method : 0.02669668197631836 time for calcul the mask position with numpy : 0.05327320098876953 nb_pixel_total : 80099 time to create 1 rle with old method : 0.09177112579345703 time for calcul the mask position with numpy : 0.05118298530578613 nb_pixel_total : 40698 time to create 1 rle with old method : 0.04492378234863281 create new chi : 31.093499898910522 time to delete rle : 0.00591278076171875 batch 1 Loaded 93 chid ids of type : 4855 Number RLEs to save : 64131 TO DO : save crop sub photo not yet done ! save time : 4.003856420516968 nb_obj : 53 nb_hashtags : 12 time to prepare the origin masks : 46.580952644348145 time for calcul the mask position with numpy : 0.6847047805786133 nb_pixel_total : 3083658 time to create 1 rle with new method : 1.462421178817749 time for calcul the mask position with numpy : 0.05339527130126953 nb_pixel_total : 193507 time to create 1 rle with new method : 1.4055793285369873 time for calcul the mask position with numpy : 0.05016922950744629 nb_pixel_total : 48886 time to create 1 rle with old method : 0.05505681037902832 time for calcul the mask position with numpy : 0.0576319694519043 nb_pixel_total : 356003 time to create 1 rle with new method : 1.2337932586669922 time for calcul the mask position with numpy : 0.477616548538208 nb_pixel_total : 3198470 time to create 1 rle with new method : 1.5692756175994873 time for calcul the mask position with numpy : 0.05246233940124512 nb_pixel_total : 83874 time to create 1 rle with old method : 0.09379196166992188 time for calcul the mask position with numpy : 0.05269503593444824 nb_pixel_total : 1381 time to create 1 rle with old method : 0.001986980438232422 time for calcul the mask position with numpy : 0.052377939224243164 nb_pixel_total : 36934 time to create 1 rle with old method : 0.04196476936340332 time for calcul the mask position with numpy : 0.05179095268249512 nb_pixel_total : 5491 time to create 1 rle with old method : 0.0065381526947021484 time for calcul the mask position with numpy : 0.05330300331115723 nb_pixel_total : 162734 time to create 1 rle with new method : 1.1932775974273682 time for calcul the mask position with numpy : 0.05254244804382324 nb_pixel_total : 134108 time to create 1 rle with old method : 0.14881348609924316 time for calcul the mask position with numpy : 0.05461406707763672 nb_pixel_total : 244407 time to create 1 rle with new method : 1.2726850509643555 time for calcul the mask position with numpy : 0.05727529525756836 nb_pixel_total : 248733 time to create 1 rle with new method : 1.4229838848114014 time for calcul the mask position with numpy : 0.0514523983001709 nb_pixel_total : 31658 time to create 1 rle with old method : 0.03693652153015137 time for calcul the mask position with numpy : 0.052739858627319336 nb_pixel_total : 69491 time to create 1 rle with old method : 0.07512259483337402 time for calcul the mask position with numpy : 0.050882577896118164 nb_pixel_total : 132479 time to create 1 rle with old method : 0.14438533782958984 time for calcul the mask position with numpy : 0.051125526428222656 nb_pixel_total : 6187 time to create 1 rle with old method : 0.007743358612060547 time for calcul the mask position with numpy : 0.05190467834472656 nb_pixel_total : 52300 time to create 1 rle with old method : 0.05804753303527832 time for calcul the mask position with numpy : 0.056150197982788086 nb_pixel_total : 490823 time to create 1 rle with new method : 2.197594165802002 time for calcul the mask position with numpy : 0.05084085464477539 nb_pixel_total : 9563 time to create 1 rle with old method : 0.011220216751098633 time for calcul the mask position with numpy : 0.050893545150756836 nb_pixel_total : 179646 time to create 1 rle with new method : 1.1201963424682617 time for calcul the mask position with numpy : 0.05381369590759277 nb_pixel_total : 178374 time to create 1 rle with new method : 1.196899652481079 time for calcul the mask position with numpy : 0.05105733871459961 nb_pixel_total : 960 time to create 1 rle with old method : 0.0011529922485351562 time for calcul the mask position with numpy : 0.0513460636138916 nb_pixel_total : 675 time to create 1 rle with old method : 0.0009500980377197266 time for calcul the mask position with numpy : 0.05251884460449219 nb_pixel_total : 38675 time to create 1 rle with old method : 0.04467177391052246 time for calcul the mask position with numpy : 0.0547482967376709 nb_pixel_total : 104502 time to create 1 rle with old method : 0.11835455894470215 time for calcul the mask position with numpy : 0.05172586441040039 nb_pixel_total : 347 time to create 1 rle with old method : 0.00051116943359375 time for calcul the mask position with numpy : 0.0516817569732666 nb_pixel_total : 5664 time to create 1 rle with old method : 0.006497859954833984 time for calcul the mask position with numpy : 0.05408954620361328 nb_pixel_total : 210902 time to create 1 rle with new method : 0.9963021278381348 time for calcul the mask position with numpy : 0.05165266990661621 nb_pixel_total : 91567 time to create 1 rle with old method : 0.10513782501220703 time for calcul the mask position with numpy : 0.05267643928527832 nb_pixel_total : 71559 time to create 1 rle with old method : 0.08066153526306152 time for calcul the mask position with numpy : 0.05248117446899414 nb_pixel_total : 70142 time to create 1 rle with old method : 0.07844376564025879 time for calcul the mask position with numpy : 0.05401897430419922 nb_pixel_total : 410878 time to create 1 rle with new method : 1.1174938678741455 time for calcul the mask position with numpy : 0.05367159843444824 nb_pixel_total : 95027 time to create 1 rle with old method : 0.10661530494689941 time for calcul the mask position with numpy : 0.05194449424743652 nb_pixel_total : 3173 time to create 1 rle with old method : 0.00420832633972168 time for calcul the mask position with numpy : 0.050591230392456055 nb_pixel_total : 107 time to create 1 rle with old method : 0.0002753734588623047 time for calcul the mask position with numpy : 0.04951620101928711 nb_pixel_total : 149797 time to create 1 rle with old method : 0.15920162200927734 time for calcul the mask position with numpy : 0.05206656455993652 nb_pixel_total : 31170 time to create 1 rle with old method : 0.036757469177246094 time for calcul the mask position with numpy : 0.05482649803161621 nb_pixel_total : 36890 time to create 1 rle with old method : 0.04213237762451172 time for calcul the mask position with numpy : 0.05424833297729492 nb_pixel_total : 133855 time to create 1 rle with old method : 0.15168523788452148 time for calcul the mask position with numpy : 0.05207085609436035 nb_pixel_total : 122680 time to create 1 rle with old method : 0.13284611701965332 time for calcul the mask position with numpy : 0.08538436889648438 nb_pixel_total : 1280146 time to create 1 rle with new method : 1.2906622886657715 time for calcul the mask position with numpy : 0.05547285079956055 nb_pixel_total : 559778 time to create 1 rle with new method : 1.1289095878601074 time for calcul the mask position with numpy : 0.05205512046813965 nb_pixel_total : 14345 time to create 1 rle with old method : 0.015882253646850586 time for calcul the mask position with numpy : 0.05200505256652832 nb_pixel_total : 179827 time to create 1 rle with new method : 1.1764800548553467 time for calcul the mask position with numpy : 0.05239582061767578 nb_pixel_total : 18583 time to create 1 rle with old method : 0.02073812484741211 time for calcul the mask position with numpy : 0.05092644691467285 nb_pixel_total : 118318 time to create 1 rle with old method : 0.12996888160705566 time for calcul the mask position with numpy : 0.05126309394836426 nb_pixel_total : 114664 time to create 1 rle with old method : 0.12362194061279297 time for calcul the mask position with numpy : 0.06809210777282715 nb_pixel_total : 642 time to create 1 rle with old method : 0.0015041828155517578 time for calcul the mask position with numpy : 0.05726170539855957 nb_pixel_total : 11458 time to create 1 rle with old method : 0.013474702835083008 time for calcul the mask position with numpy : 0.06478500366210938 nb_pixel_total : 50046 time to create 1 rle with old method : 0.09923934936523438 time for calcul the mask position with numpy : 0.08519625663757324 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0023632049560546875 time for calcul the mask position with numpy : 0.07075834274291992 nb_pixel_total : 41716 time to create 1 rle with old method : 0.05316925048828125 time for calcul the mask position with numpy : 0.05660843849182129 nb_pixel_total : 61387 time to create 1 rle with old method : 0.07160401344299316 create new chi : 26.72349786758423 time to delete rle : 0.005496025085449219 batch 1 Loaded 54 chid ids of type : 4855 Number RLEs to save : 47437 TO DO : save crop sub photo not yet done ! save time : 2.964951992034912 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 19.066120624542236 time for calcul the mask position with numpy : 0.07033395767211914 nb_pixel_total : 957276 time to create 1 rle with new method : 1.281726598739624 time for calcul the mask position with numpy : 0.07016158103942871 nb_pixel_total : 68067 time to create 1 rle with old method : 0.08507490158081055 time for calcul the mask position with numpy : 0.06311202049255371 nb_pixel_total : 25594 time to create 1 rle with old method : 0.02967071533203125 time for calcul the mask position with numpy : 0.07025265693664551 nb_pixel_total : 42461 time to create 1 rle with old method : 0.2793705463409424 time for calcul the mask position with numpy : 0.19597983360290527 nb_pixel_total : 218 time to create 1 rle with old method : 0.0005142688751220703 time for calcul the mask position with numpy : 0.10474753379821777 nb_pixel_total : 2953 time to create 1 rle with old method : 0.005608797073364258 time for calcul the mask position with numpy : 0.10597109794616699 nb_pixel_total : 434 time to create 1 rle with old method : 0.0010120868682861328 time for calcul the mask position with numpy : 0.14672517776489258 nb_pixel_total : 1885980 time to create 1 rle with new method : 0.9728825092315674 time for calcul the mask position with numpy : 0.7564351558685303 nb_pixel_total : 3879921 time to create 1 rle with new method : 1.438457727432251 time for calcul the mask position with numpy : 0.06268477439880371 nb_pixel_total : 814324 time to create 1 rle with new method : 1.2714133262634277 time for calcul the mask position with numpy : 0.9589169025421143 nb_pixel_total : 5301972 time to create 1 rle with new method : 1.367527961730957 create new chi : 9.571831941604614 time to delete rle : 0.002394437789916992 batch 1 Loaded 11 chid ids of type : 4855 Number RLEs to save : 22397 TO DO : save crop sub photo not yet done ! save time : 1.4787144660949707 map_output_result : {1357513267: (0.3491930774111121, 'Should be the crop_list due to order', 0.3668082785742541), 1357513088: (0.3491930774111121, 'Should be the crop_list due to order', 0.20215512021832785), 1357513084: (0.3491930774111121, 'Should be the crop_list due to order', 0.15378680688862856), 1357513082: (0.3491930774111121, 'Should be the crop_list due to order', 0.3992933534410608), 1357513074: (0.3491930774111121, 'Should be the crop_list due to order', 0.6239218279332892)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 5 /1357513267.Didn't retrieve data . /1357513088.Didn't retrieve data . /1357513084.Didn't retrieve data . /1357513082.Didn't retrieve data . /1357513074.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.016865015029907227 save_final save missing photos in datou_result : time spend for datou_step_exec : 369.2631187438965 time spend to save output : 0.018845558166503906 total time spend for step 5 : 369.281964302063 step6:crop_condition Tue May 13 03:30:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4855 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 282 chid ids of type : 4855 begin to crop the class : papier param for this class : {'min_score': 0.1} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3015255 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099884_780411 we have uploaded 43 photos in the portfolio 3015255 time of upload the photos Elapsed time : 11.47413945198059 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.1} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3015255 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099929_780411 we have uploaded 47 photos in the portfolio 3015255 time of upload the photos Elapsed time : 14.673278570175171 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.1} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3015255 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099951_780411 we have uploaded 16 photos in the portfolio 3015255 time of upload the photos Elapsed time : 5.093808650970459 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.1} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3015255 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099961_780411 we have uploaded 9 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.7285921573638916 we have finished the crop for the class : pet_clair begin to crop the class : pehd param for this class : {'min_score': 0.1} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099968_780411 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.2748088836669922 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.1} filtre for class : pet_fonce hashtag_id of this class : 2107755900 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : pet_fonce begin to crop the class : sac param for this class : {'min_score': 0.1} filtre for class : sac hashtag_id of this class : 492618350 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3015255 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099976_780411 we have uploaded 8 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.6321756839752197 we have finished the crop for the class : sac begin to crop the class : textiles param for this class : {'min_score': 0.1} filtre for class : textiles hashtag_id of this class : 494789423 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3015255 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099981_780411 we have uploaded 4 photos in the portfolio 3015255 time of upload the photos Elapsed time : 1.1258878707885742 we have finished the crop for the class : textiles begin to crop the class : verre param for this class : {'min_score': 0.1} filtre for class : verre hashtag_id of this class : 492631919 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747099984_780411 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.7111575603485107 we have finished the crop for the class : verre begin to crop the class : organique param for this class : {'min_score': 0.1} filtre for class : organique hashtag_id of this class : 530726390 begin to crop the class : dasri param for this class : {'min_score': 0.1} filtre for class : dasri hashtag_id of this class : 1608424396 begin to crop the class : masque param for this class : {'min_score': 0.1} filtre for class : masque hashtag_id of this class : 492626781 begin to crop the class : encombrant param for this class : {'min_score': 0.1} filtre for class : encombrant hashtag_id of this class : 605975549 begin to crop the class : autre param for this class : {'min_score': 0.1} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3015255 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747100014_780411 we have uploaded 19 photos in the portfolio 3015255 time of upload the photos Elapsed time : 4.591618776321411 we have finished the crop for the class : autre begin to crop the class : autre_emballage param for this class : {'min_score': 0.1} filtre for class : autre_emballage hashtag_id of this class : 2107760328 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3015255 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747100021_780411 we have uploaded 1 photos in the portfolio 3015255 time of upload the photos Elapsed time : 0.5657861232757568 we have finished the crop for the class : autre_emballage begin to crop the class : autre_non_emballage param for this class : {'min_score': 0.1} filtre for class : autre_non_emballage hashtag_id of this class : 2107760329 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3015255 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747100027_780411 we have uploaded 8 photos in the portfolio 3015255 time of upload the photos Elapsed time : 2.7921600341796875 we have finished the crop for the class : autre_non_emballage begin to crop the class : environnement param for this class : {'min_score': 0.1} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3015255 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747100139_780411 we have uploaded 39 photos in the portfolio 3015255 time of upload the photos Elapsed time : 9.694164037704468 we have finished the crop for the class : environnement delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 199 /1357763093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357763426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 602 time used for this insertion : 0.09640789031982422 save_final save missing photos in datou_result : time spend for datou_step_exec : 316.79442167282104 time spend to save output : 0.10094261169433594 total time spend for step 6 : 316.8953642845154 step7:ventilate_hashtags_in_portfolio Tue May 13 03:35:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22902876 get user id for portfolio 22902876 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902876 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902876 AND mptpi.`type`=4855 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902876 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902876 AND mptpi.`type`=4856 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','autre','flux_dev','mal_croppe','flou','film_dev_souple','sac_om_plein')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/22902949,22902950,22902951,22902952,22902953,22902954,22902955,22902956,22902957,22902958,22902959,22902960,22902961,22902962,22902963,22902964,22902965,22902966,22902967,22905416?tags=papier,carton,metal,pet_clair,pehd,flux_dev,film_dev_souple,ela,sac_om_plein,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,mal_croppe,flou,autre&datou_id_consolidate=4742&port_consolidate=22902876 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 1 /22902876. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01924610137939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7945396900177 time spend to save output : 0.022794246673583984 total time spend for step 7 : 3.817333936691284 step8:final Tue May 13 03:35:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357513267: ('0.28980767620746795',), 1357513088: ('0.28980767620746795',), 1357513084: ('0.28980767620746795',), 1357513082: ('0.28980767620746795',), 1357513074: ('0.28980767620746795',)} new output for save of step final : {1357513267: ('0.28980767620746795',), 1357513088: ('0.28980767620746795',), 1357513084: ('0.28980767620746795',), 1357513082: ('0.28980767620746795',), 1357513074: ('0.28980767620746795',)} [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 5 /1357513267.Didn't retrieve data . /1357513088.Didn't retrieve data . /1357513084.Didn't retrieve data . /1357513082.Didn't retrieve data . /1357513074.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01635146141052246 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10599732398986816 time spend to save output : 0.016694068908691406 total time spend for step 8 : 0.12269139289855957 step9:velours_tree Tue May 13 03:35:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13064312934875488 time spend to save output : 4.315376281738281e-05 total time spend for step 9 : 0.13068628311157227 step10:send_mail_cod Tue May 13 03:35:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22902876_13-05-2025_03_35_55.pdf 22905390 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229053901747100155 22905391 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229053911747100157 22905392 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229053921747100158 22905393 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229053931747100160 22905394 change filename to text .change filename to text .change filename to text .change filename to text .imagette229053941747100160 22905395 imagette229053951747100161 22905396 imagette229053961747100161 22905397 imagette229053971747100161 22905398 imagette229053981747100161 22905399 imagette229053991747100161 22905400 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229054001747100161 22905401 change filename to text .change filename to text .change filename to text .change filename to text .imagette229054011747100161 22905402 change filename to text .imagette229054021747100161 22905403 imagette229054031747100162 22905404 imagette229054041747100162 22905405 imagette229054051747100162 22905406 imagette229054061747100162 22905407 change filename to text .imagette229054071747100162 22905408 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229054081747100162 22905410 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229054101747100162 22905411 imagette229054111747100164 22905412 imagette229054121747100164 22905413 imagette229054131747100164 22905414 imagette229054141747100164 22905415 imagette229054151747100164 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22902876 and hashtag_type = 4855 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22902949,22902950,22902951,22902952,22902953,22902954,22902955,22902956,22902957,22902958,22902959,22902960,22902961,22902962,22902963,22902964,22902965,22902966,22902967,22905416?tags=papier,carton,metal,pet_clair,pehd,flux_dev,film_dev_souple,ela,sac_om_plein,textiles,verre,organique,dasri,masque,encombrant,autre_non_emballage,environnement,mal_croppe,flou,autre&datou_id_consolidate=4742&port_consolidate=22902876 your option no_mail is active, we will not send the real mail to your client args[1357513267] : ((1357513267, 1612.3359121881522, 2107751945), (1357513267, -0.30578283622165714, 496442774), '0.28980767620746795') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357513088] : ((1357513088, 1692.9190523456664, 2107751945), (1357513088, -0.383011893268146, 496442774), '0.28980767620746795') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357513084] : ((1357513084, 1803.0045827032109, 2107751945), (1357513084, -0.24933413401509677, 496442774), '0.28980767620746795') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357513082] : ((1357513082, 821.5602817923609, 2107751945), (1357513082, -0.3042249106869241, 496442774), '0.28980767620746795') We are sending mail with results at report@fotonower.com,cod@fotonower.com args[1357513074] : ((1357513074, 260.4178070519641, 492688767), (1357513074, -0.8526441927501963, 501862349), '0.28980767620746795') We are sending mail with results at report@fotonower.com,cod@fotonower.com refus_total : 0.28980767620746795 2022-04-13 10:29:59 0 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902876_13-05-2025_03_35_55.pdf results_Auto_P22902876_13-05-2025_03_35_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902876_13-05-2025_03_35_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4741','22902876','results_Auto_P22902876_13-05-2025_03_35_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902876_13-05-2025_03_35_55.pdf','pdf','','2.89','0.28980767620746795') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013562917709350586 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.22860836982727 time spend to save output : 0.013863325119018555 total time spend for step 10 : 13.242471694946289 step11:split_time_score Tue May 13 03:36:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('01', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10052025 22902876 Nombre de photos uploadées : 5 / 23040 (0%) 10052025 22902876 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 10052025 22902876 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00034880638122558594 elapsed_time : insert_dashboard_record_day_entry 0.023804903030395508 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2280055167718577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862238_10-05-2025_15_49_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862238 AND mptpi.`type`=4855 To do Qualite : 0.39773799115774777 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22862239_10-05-2025_16_04_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22862239 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22862239 AND mptpi.`type`=4855 To do Qualite : 0.40074268083807946 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902875_13-05-2025_03_21_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902875 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902875 AND mptpi.`type`=4855 To do Qualite : 0.28980767620746795 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902876_13-05-2025_03_35_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902876 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902876 AND mptpi.`type`=4855 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902877 order by id desc limit 1 Qualite : 0.43946735457882824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22902878_13-05-2025_02_31_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22902878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22902878 AND mptpi.`type`=4855 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10052025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357513267, 1357513088, 1357513084, 1357513082, 1357513074] Looping around the photos to save general results len do output : 1 /22902876Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513267', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513088', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513084', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513082', None, None, None, None, None, '2833132') ('4741', None, None, None, None, None, None, None, '2833132') ('4741', '22902876', '1357513074', None, None, None, None, None, '2833132') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.017083406448364258 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3791399002075195 time spend to save output : 0.017261981964111328 total time spend for step 11 : 1.3964018821716309 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 552.91user 276.60system 14:44.77elapsed 93%CPU (0avgtext+0avgdata 6925836maxresident)k 1211256inputs+647272outputs (15785major+43473813minor)pagefaults 0swaps