import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3453304 load datou : 4741 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5732, 'mask_refus_amiens_050123', 16384, 25088, 'mask_refus_amiens_050123', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 1, 5, 13, 23, 59), datetime.datetime(2023, 1, 5, 13, 23, 59)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) load thcls load THCL from format json or kwargs add thcl : 3453 in CacheModelConfig load THCL from format json or kwargs add thcl : 3783 in CacheModelConfig load pdts add pdt : 5732 in CacheModelConfig add pdt : 5972 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4741, datou_cur_ids : ['2709794'] with mtr_portfolio_ids : ['21916090'] and first list_photo_ids : [] new path : /proc/3453304/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13156 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 13160 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13160 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13158 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13157 crop_condition is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 13157 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13161 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13159 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13159 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 13156 doesn't seem to be define in the database( WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13161 doesn't seem to be define in the database( WARNING : type of input 3 of step 13159 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13163 have datatype=6 whereas input 2 of step 13157 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 0 of step 13162 have datatype=6 whereas input 2 of step 13157 have datatype=None We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13161 have datatype=10 whereas input 3 of step 13164 have datatype=6 WARNING : output 0 of step 13161 have datatype=10 whereas input 0 of step 13166 have datatype=18 WARNING : type of input 5 of step 13164 doesn't seem to be define in the database( WARNING : output 0 of step 13166 have datatype=11 whereas input 5 of step 13164 have datatype=None WARNING : type of input 2 of step 13157 doesn't seem to be define in the database( WARNING : output 1 of step 13158 have datatype=7 whereas input 2 of step 13157 have datatype=None WARNING : type of output 3 of step 13157 doesn't seem to be define in the database( WARNING : type of input 3 of step 13161 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13163 doesn't seem to be define in the database( WARNING : type of output 2 of step 13160 doesn't seem to be define in the database( WARNING : type of input 1 of step 13162 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, mask_detect, blur_detection, brightness, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 2.2416415214538574 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Apr 1 07:01:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 400 wait 20 seconds l 3637 free memory gpu now : 400 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-01 07:01:55.934960: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-01 07:01:55.963173: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-01 07:01:55.966053: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb0fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-01 07:01:55.966125: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-01 07:01:55.970681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-01 07:01:56.250891: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x428af060 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-01 07:01:56.250978: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-01 07:01:56.252290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 07:01:56.253550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 07:01:56.259152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 07:01:56.262776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 07:01:56.264355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 07:01:56.268732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 07:01:56.270685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 07:01:56.278610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 07:01:56.280230: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 07:01:56.280352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 07:01:56.281142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 07:01:56.281161: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 07:01:56.281173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 07:01:56.282506: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4822 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-01 07:01:56.634837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 07:01:56.634960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 07:01:56.634987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 07:01:56.635008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 07:01:56.635029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 07:01:56.635050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 07:01:56.635070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 07:01:56.635091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 07:01:56.636296: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 07:01:56.637550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-01 07:01:56.637586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-01 07:01:56.637605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 07:01:56.637634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-01 07:01:56.637653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-01 07:01:56.637670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-01 07:01:56.637688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-01 07:01:56.637705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 07:01:56.638996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-01 07:01:56.639038: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-01 07:01:56.639049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-01 07:01:56.639059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-01 07:01:56.640266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4822 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl3783 thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5972, 'learn_entrant_syctomXV_111023', 16384, 25088, 'learn_entrant_syctomXV_111023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 10, 11, 15, 57, 35), datetime.datetime(2023, 10, 11, 15, 57, 35)) {'thcl': {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'], 'list_hashtags_csv': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'svm_hashtag_type_desc': 5972, 'photo_desc_type': 5972, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_entrant_syctomXV_111023 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_entrant_syctomXV_111023 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-01 07:02:11.961772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-01 07:02:12.311089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-01 07:02:13.935065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_entrant_syctomXV_111023 /data/models_weight/learn_entrant_syctomXV_111023/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2023-10-26 16:36:43 create time in s3 : 2023-10-11 13:57:17 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 4160.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 3454310 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 400 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5281 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3783 Catched exception ! Connect or reconnect ! thcls : [{'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 3783, 'mtr_user_id': 31, 'name': 'learn_entrant_syctomXV_111023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4853, 'photo_desc_type': 5972, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5972 ['background', 'sac', 'textiles', 'verre', 'organique', 'dasri', 'masque', 'encombrant', 'autre_emballage', 'autre_non_emballage', 'environnement'] time for calcul the mask position with numpy : 0.005708932876586914 nb_pixel_total : 186774 time to create 1 rle with new method : 0.012362003326416016 length of segment : 606 time for calcul the mask position with numpy : 0.004789829254150391 nb_pixel_total : 222463 time to create 1 rle with new method : 0.01602458953857422 length of segment : 857 time for calcul the mask position with numpy : 0.001832723617553711 nb_pixel_total : 72158 time to create 1 rle with old method : 0.09722375869750977 length of segment : 468 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 45248 time to create 1 rle with old method : 0.053812503814697266 length of segment : 222 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 14686 time to create 1 rle with old method : 0.017325878143310547 length of segment : 225 time for calcul the mask position with numpy : 0.0015511512756347656 nb_pixel_total : 76983 time to create 1 rle with old method : 0.09427571296691895 length of segment : 476 time for calcul the mask position with numpy : 0.0002810955047607422 nb_pixel_total : 13399 time to create 1 rle with old method : 0.014994382858276367 length of segment : 138 time for calcul the mask position with numpy : 0.0007393360137939453 nb_pixel_total : 39403 time to create 1 rle with old method : 0.04499006271362305 length of segment : 302 time for calcul the mask position with numpy : 0.0016531944274902344 nb_pixel_total : 72420 time to create 1 rle with old method : 0.0938119888305664 length of segment : 374 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 22923 time to create 1 rle with old method : 0.035047054290771484 length of segment : 341 time for calcul the mask position with numpy : 0.0006330013275146484 nb_pixel_total : 19963 time to create 1 rle with old method : 0.025918245315551758 length of segment : 200 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 8607 time to create 1 rle with old method : 0.012042045593261719 length of segment : 192 time for calcul the mask position with numpy : 0.0008678436279296875 nb_pixel_total : 37565 time to create 1 rle with old method : 0.05052495002746582 length of segment : 286 time for calcul the mask position with numpy : 0.0032987594604492188 nb_pixel_total : 148014 time to create 1 rle with old method : 0.17583298683166504 length of segment : 451 time for calcul the mask position with numpy : 0.014737367630004883 nb_pixel_total : 395532 time to create 1 rle with new method : 0.022190093994140625 length of segment : 586 time for calcul the mask position with numpy : 0.0013687610626220703 nb_pixel_total : 99088 time to create 1 rle with old method : 0.10547995567321777 length of segment : 373 time for calcul the mask position with numpy : 0.0007228851318359375 nb_pixel_total : 43524 time to create 1 rle with old method : 0.05127882957458496 length of segment : 264 time for calcul the mask position with numpy : 0.003171682357788086 nb_pixel_total : 226860 time to create 1 rle with new method : 0.012908458709716797 length of segment : 963 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 10765 time to create 1 rle with old method : 0.012184381484985352 length of segment : 201 time for calcul the mask position with numpy : 0.00032401084899902344 nb_pixel_total : 2096 time to create 1 rle with old method : 0.002512216567993164 length of segment : 118 time for calcul the mask position with numpy : 0.0012590885162353516 nb_pixel_total : 59428 time to create 1 rle with old method : 0.07847166061401367 length of segment : 349 time for calcul the mask position with numpy : 0.0018563270568847656 nb_pixel_total : 109982 time to create 1 rle with old method : 0.12614846229553223 length of segment : 367 time for calcul the mask position with numpy : 0.0005674362182617188 nb_pixel_total : 23445 time to create 1 rle with old method : 0.02970266342163086 length of segment : 215 time for calcul the mask position with numpy : 0.001132965087890625 nb_pixel_total : 19189 time to create 1 rle with old method : 0.021886825561523438 length of segment : 139 time for calcul the mask position with numpy : 0.0011591911315917969 nb_pixel_total : 55907 time to create 1 rle with old method : 0.06109786033630371 length of segment : 307 time for calcul the mask position with numpy : 0.002473115921020508 nb_pixel_total : 173767 time to create 1 rle with new method : 0.008459329605102539 length of segment : 787 time for calcul the mask position with numpy : 0.002246379852294922 nb_pixel_total : 141815 time to create 1 rle with old method : 0.18218111991882324 length of segment : 449 time for calcul the mask position with numpy : 0.001674652099609375 nb_pixel_total : 92471 time to create 1 rle with old method : 0.10130047798156738 length of segment : 290 time for calcul the mask position with numpy : 0.003354787826538086 nb_pixel_total : 159229 time to create 1 rle with new method : 0.013602256774902344 length of segment : 519 time for calcul the mask position with numpy : 0.001407623291015625 nb_pixel_total : 79605 time to create 1 rle with old method : 0.09039878845214844 length of segment : 297 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 21958 time to create 1 rle with old method : 0.02662944793701172 length of segment : 136 time for calcul the mask position with numpy : 0.0007367134094238281 nb_pixel_total : 14769 time to create 1 rle with old method : 0.01836872100830078 length of segment : 202 time for calcul the mask position with numpy : 0.00842905044555664 nb_pixel_total : 333279 time to create 1 rle with new method : 0.2050018310546875 length of segment : 472 time for calcul the mask position with numpy : 0.003973245620727539 nb_pixel_total : 316984 time to create 1 rle with new method : 0.013214111328125 length of segment : 419 time for calcul the mask position with numpy : 0.0009443759918212891 nb_pixel_total : 32169 time to create 1 rle with old method : 0.03846287727355957 length of segment : 238 time for calcul the mask position with numpy : 0.00020551681518554688 nb_pixel_total : 8898 time to create 1 rle with old method : 0.01060342788696289 length of segment : 69 time for calcul the mask position with numpy : 0.003035306930541992 nb_pixel_total : 157871 time to create 1 rle with new method : 0.006577491760253906 length of segment : 415 time for calcul the mask position with numpy : 0.00583338737487793 nb_pixel_total : 308799 time to create 1 rle with new method : 0.015396833419799805 length of segment : 535 time for calcul the mask position with numpy : 0.005612850189208984 nb_pixel_total : 153108 time to create 1 rle with new method : 0.011995792388916016 length of segment : 828 time for calcul the mask position with numpy : 0.04396843910217285 nb_pixel_total : 951466 time to create 1 rle with new method : 0.47158288955688477 length of segment : 1478 time for calcul the mask position with numpy : 0.0015683174133300781 nb_pixel_total : 59351 time to create 1 rle with old method : 0.06803464889526367 length of segment : 297 time for calcul the mask position with numpy : 0.003540515899658203 nb_pixel_total : 63492 time to create 1 rle with old method : 0.07108402252197266 length of segment : 685 time for calcul the mask position with numpy : 0.0007529258728027344 nb_pixel_total : 21844 time to create 1 rle with old method : 0.0260162353515625 length of segment : 162 time for calcul the mask position with numpy : 0.001583099365234375 nb_pixel_total : 68968 time to create 1 rle with old method : 0.07719683647155762 length of segment : 420 time for calcul the mask position with numpy : 0.0007426738739013672 nb_pixel_total : 33671 time to create 1 rle with old method : 0.03910350799560547 length of segment : 258 time for calcul the mask position with numpy : 0.003397703170776367 nb_pixel_total : 112350 time to create 1 rle with old method : 0.12789416313171387 length of segment : 589 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 21881 time to create 1 rle with old method : 0.026261568069458008 length of segment : 159 time for calcul the mask position with numpy : 0.0005164146423339844 nb_pixel_total : 15045 time to create 1 rle with old method : 0.017542600631713867 length of segment : 180 time for calcul the mask position with numpy : 0.0019278526306152344 nb_pixel_total : 60157 time to create 1 rle with old method : 0.06865143775939941 length of segment : 327 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 14987 time to create 1 rle with old method : 0.017279624938964844 length of segment : 175 time for calcul the mask position with numpy : 0.0005726814270019531 nb_pixel_total : 18572 time to create 1 rle with old method : 0.022005081176757812 length of segment : 151 time for calcul the mask position with numpy : 0.0014538764953613281 nb_pixel_total : 50689 time to create 1 rle with old method : 0.05700421333312988 length of segment : 298 time for calcul the mask position with numpy : 0.0046634674072265625 nb_pixel_total : 213765 time to create 1 rle with new method : 0.007858037948608398 length of segment : 341 time for calcul the mask position with numpy : 0.00874471664428711 nb_pixel_total : 429094 time to create 1 rle with new method : 0.016809940338134766 length of segment : 670 time for calcul the mask position with numpy : 0.0023374557495117188 nb_pixel_total : 98937 time to create 1 rle with old method : 0.12073087692260742 length of segment : 343 time for calcul the mask position with numpy : 0.004819393157958984 nb_pixel_total : 205855 time to create 1 rle with new method : 0.0072515010833740234 length of segment : 504 time for calcul the mask position with numpy : 0.0052950382232666016 nb_pixel_total : 256514 time to create 1 rle with new method : 0.008355855941772461 length of segment : 865 time for calcul the mask position with numpy : 0.0048084259033203125 nb_pixel_total : 262050 time to create 1 rle with new method : 0.006939888000488281 length of segment : 427 time for calcul the mask position with numpy : 0.001241445541381836 nb_pixel_total : 41694 time to create 1 rle with old method : 0.04700350761413574 length of segment : 312 time for calcul the mask position with numpy : 0.008777856826782227 nb_pixel_total : 465393 time to create 1 rle with new method : 0.022158384323120117 length of segment : 1002 time for calcul the mask position with numpy : 0.004670858383178711 nb_pixel_total : 299654 time to create 1 rle with new method : 0.013094186782836914 length of segment : 543 time for calcul the mask position with numpy : 0.0012652873992919922 nb_pixel_total : 57366 time to create 1 rle with old method : 0.06515932083129883 length of segment : 492 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 34088 time to create 1 rle with old method : 0.05582380294799805 length of segment : 266 time for calcul the mask position with numpy : 0.003099203109741211 nb_pixel_total : 253881 time to create 1 rle with new method : 0.007483720779418945 length of segment : 831 time for calcul the mask position with numpy : 0.013154268264770508 nb_pixel_total : 546019 time to create 1 rle with new method : 0.1778249740600586 length of segment : 851 time for calcul the mask position with numpy : 0.007365703582763672 nb_pixel_total : 164393 time to create 1 rle with new method : 0.014810800552368164 length of segment : 813 time for calcul the mask position with numpy : 0.001253366470336914 nb_pixel_total : 50390 time to create 1 rle with old method : 0.07066607475280762 length of segment : 247 time for calcul the mask position with numpy : 0.0029439926147460938 nb_pixel_total : 113003 time to create 1 rle with old method : 0.12572050094604492 length of segment : 479 time for calcul the mask position with numpy : 0.0021283626556396484 nb_pixel_total : 114833 time to create 1 rle with old method : 0.14924001693725586 length of segment : 395 time for calcul the mask position with numpy : 0.0008628368377685547 nb_pixel_total : 43036 time to create 1 rle with old method : 0.049689531326293945 length of segment : 156 time for calcul the mask position with numpy : 0.003079652786254883 nb_pixel_total : 180883 time to create 1 rle with new method : 0.006480693817138672 length of segment : 618 time for calcul the mask position with numpy : 0.0037026405334472656 nb_pixel_total : 186009 time to create 1 rle with new method : 0.006872892379760742 length of segment : 649 time for calcul the mask position with numpy : 0.002062082290649414 nb_pixel_total : 91341 time to create 1 rle with old method : 0.10359025001525879 length of segment : 381 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 40917 time to create 1 rle with old method : 0.04597115516662598 length of segment : 265 time for calcul the mask position with numpy : 0.0187833309173584 nb_pixel_total : 752214 time to create 1 rle with new method : 0.10844111442565918 length of segment : 2064 time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 34182 time to create 1 rle with old method : 0.03874492645263672 length of segment : 299 time for calcul the mask position with numpy : 0.00031113624572753906 nb_pixel_total : 12377 time to create 1 rle with old method : 0.014234781265258789 length of segment : 192 time for calcul the mask position with numpy : 0.0017397403717041016 nb_pixel_total : 61794 time to create 1 rle with old method : 0.07384586334228516 length of segment : 272 time for calcul the mask position with numpy : 0.0008873939514160156 nb_pixel_total : 20735 time to create 1 rle with old method : 0.024409055709838867 length of segment : 212 time for calcul the mask position with numpy : 0.0016405582427978516 nb_pixel_total : 87149 time to create 1 rle with old method : 0.09897732734680176 length of segment : 222 time for calcul the mask position with numpy : 0.0012090206146240234 nb_pixel_total : 45796 time to create 1 rle with old method : 0.05379891395568848 length of segment : 338 time for calcul the mask position with numpy : 0.0012557506561279297 nb_pixel_total : 38252 time to create 1 rle with old method : 0.04332995414733887 length of segment : 319 time for calcul the mask position with numpy : 0.0023946762084960938 nb_pixel_total : 90256 time to create 1 rle with old method : 0.10145401954650879 length of segment : 366 time for calcul the mask position with numpy : 0.22789883613586426 nb_pixel_total : 3359323 time to create 1 rle with new method : 0.6357104778289795 length of segment : 3378 time for calcul the mask position with numpy : 0.43229103088378906 nb_pixel_total : 4364693 time to create 1 rle with new method : 0.4322991371154785 length of segment : 1823 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 24209 time to create 1 rle with old method : 0.027115583419799805 length of segment : 230 time spent for convertir_results : 16.1222927570343 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 86 chid ids of type : 4854 Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 104.68558287620544 time spend to save output : 0.5188789367675781 total time spend for step 1 : 105.20446181297302 step2:mask_detect Tue Apr 1 07:03:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5281 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-01 07:03:20.737958: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-01 07:03:20.763158: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-01 07:03:20.765204: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb0ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-01 07:03:20.765254: I tensorflow/compiler/xla/service/serlocal folder : /data/models_weight/mask_refus_amiens_050123 /data/models_weight/mask_refus_amiens_050123/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2023-01-05 13:44:07 create time in s3 : 2023-01-05 12:23:52 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.91250 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 56 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 66 NEW PHOTO Processing 1 images image shape: (4160, 3120, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 4160.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 3457758 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 181 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5281 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl3453 Catched exception ! Connect or reconnect ! thcls : [{'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 3453, 'mtr_user_id': 31, 'name': 'mask_refus_amiens_050123', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 4485, 'photo_desc_type': 5732, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5732 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.059098243713378906 nb_pixel_total : 345531 time to create 1 rle with new method : 0.20055294036865234 length of segment : 1012 time for calcul the mask position with numpy : 0.008133411407470703 nb_pixel_total : 311896 time to create 1 rle with new method : 0.013911724090576172 length of segment : 691 time for calcul the mask position with numpy : 0.0075626373291015625 nb_pixel_total : 337377 time to create 1 rle with new method : 0.019148588180541992 length of segment : 894 time for calcul the mask position with numpy : 0.0012738704681396484 nb_pixel_total : 43297 time to create 1 rle with old method : 0.0475773811340332 length of segment : 224 time for calcul the mask position with numpy : 0.013267993927001953 nb_pixel_total : 437518 time to create 1 rle with new method : 0.047699928283691406 length of segment : 764 time for calcul the mask position with numpy : 0.0010156631469726562 nb_pixel_total : 37852 time to create 1 rle with old method : 0.041046857833862305 length of segment : 302 time for calcul the mask position with numpy : 0.002134084701538086 nb_pixel_total : 80280 time to create 1 rle with old method : 0.08819150924682617 length of segment : 481 time for calcul the mask position with numpy : 0.0249025821685791 nb_pixel_total : 227538 time to create 1 rle with new method : 0.013437509536743164 length of segment : 641 time for calcul the mask position with numpy : 0.006644010543823242 nb_pixel_total : 271924 time to create 1 rle with new method : 0.019243955612182617 length of segment : 876 time for calcul the mask position with numpy : 0.002427816390991211 nb_pixel_total : 67186 time to create 1 rle with old method : 0.09174990653991699 length of segment : 278 time for calcul the mask position with numpy : 0.00922536849975586 nb_pixel_total : 32424 time to create 1 rle with old method : 0.038629770278930664 length of segment : 232 time for calcul the mask position with numpy : 0.003909111022949219 nb_pixel_total : 199698 time to create 1 rle with new method : 0.010690450668334961 length of segment : 545 time for calcul the mask position with numpy : 0.008342504501342773 nb_pixel_total : 394445 time to create 1 rle with new method : 0.021072864532470703 length of segment : 1185 time for calcul the mask position with numpy : 0.003186464309692383 nb_pixel_total : 77561 time to create 1 rle with old method : 0.08599853515625 length of segment : 390 time for calcul the mask position with numpy : 0.006340503692626953 nb_pixel_total : 56782 time to create 1 rle with old method : 0.08735871315002441 length of segment : 302 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 14220 time to create 1 rle with old method : 0.016268014907836914 length of segment : 172 time for calcul the mask position with numpy : 0.0007443428039550781 nb_pixel_total : 24393 time to create 1 rle with old method : 0.027393341064453125 length of segment : 236 time for calcul the mask position with numpy : 0.03305411338806152 nb_pixel_total : 283254 time to create 1 rle with new method : 0.02977776527404785 length of segment : 956 time for calcul the mask position with numpy : 0.001771688461303711 nb_pixel_total : 89036 time to create 1 rle with old method : 0.11477899551391602 length of segment : 407 time for calcul the mask position with numpy : 0.0013451576232910156 nb_pixel_total : 47367 time to create 1 rle with old method : 0.05304980278015137 length of segment : 304 time for calcul the mask position with numpy : 0.001279592514038086 nb_pixel_total : 22861 time to create 1 rle with old method : 0.026480913162231445 length of segment : 271 time for calcul the mask position with numpy : 0.0034270286560058594 nb_pixel_total : 135117 time to create 1 rle with old method : 0.14573407173156738 length of segment : 609 time for calcul the mask position with numpy : 0.0006628036499023438 nb_pixel_total : 22611 time to create 1 rle with old method : 0.024554729461669922 length of segment : 205 time for calcul the mask position with numpy : 0.005110263824462891 nb_pixel_total : 160433 time to create 1 rle with new method : 0.013116598129272461 length of segment : 571 time for calcul the mask position with numpy : 0.0009195804595947266 nb_pixel_total : 32509 time to create 1 rle with old method : 0.03500008583068848 length of segment : 289 time for calcul the mask position with numpy : 0.0008921623229980469 nb_pixel_total : 37043 time to create 1 rle with old method : 0.04124593734741211 length of segment : 287 time for calcul the mask position with numpy : 0.003801107406616211 nb_pixel_total : 125978 time to create 1 rle with old method : 0.15869402885437012 length of segment : 539 time for calcul the mask position with numpy : 0.002996683120727539 nb_pixel_total : 59066 time to create 1 rle with old method : 0.0626976490020752 length of segment : 654 time for calcul the mask position with numpy : 0.017429828643798828 nb_pixel_total : 236805 time to create 1 rle with new method : 0.01637864112854004 length of segment : 860 time for calcul the mask position with numpy : 0.0018630027770996094 nb_pixel_total : 86889 time to create 1 rle with old method : 0.09448599815368652 length of segment : 371 time for calcul the mask position with numpy : 0.002389192581176758 nb_pixel_total : 118309 time to create 1 rle with old method : 0.12848186492919922 length of segment : 358 time for calcul the mask position with numpy : 0.00868844985961914 nb_pixel_total : 416085 time to create 1 rle with new method : 0.02280259132385254 length of segment : 1046 time for calcul the mask position with numpy : 0.019346952438354492 nb_pixel_total : 591003 time to create 1 rle with new method : 0.044172048568725586 length of segment : 770 time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 43214 time to create 1 rle with old method : 0.04834246635437012 length of segment : 237 time for calcul the mask position with numpy : 0.002548694610595703 nb_pixel_total : 138428 time to create 1 rle with old method : 0.15672874450683594 length of segment : 360 time for calcul the mask position with numpy : 0.0019795894622802734 nb_pixel_total : 25538 time to create 1 rle with old method : 0.028803110122680664 length of segment : 552 time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 32962 time to create 1 rle with old method : 0.03630208969116211 length of segment : 364 time for calcul the mask position with numpy : 0.005015373229980469 nb_pixel_total : 121451 time to create 1 rle with old method : 0.1382286548614502 length of segment : 636 time for calcul the mask position with numpy : 0.0032918453216552734 nb_pixel_total : 106799 time to create 1 rle with old method : 0.13738107681274414 length of segment : 514 time for calcul the mask position with numpy : 0.004086017608642578 nb_pixel_total : 187183 time to create 1 rle with new method : 0.01031804084777832 length of segment : 535 time for calcul the mask position with numpy : 0.006920814514160156 nb_pixel_total : 282078 time to create 1 rle with new method : 0.019684314727783203 length of segment : 900 time for calcul the mask position with numpy : 0.0008594989776611328 nb_pixel_total : 44314 time to create 1 rle with old method : 0.04717683792114258 length of segment : 258 time for calcul the mask position with numpy : 0.0028035640716552734 nb_pixel_total : 144675 time to create 1 rle with old method : 0.15550565719604492 length of segment : 461 time for calcul the mask position with numpy : 0.007330179214477539 nb_pixel_total : 301581 time to create 1 rle with new method : 0.018759727478027344 length of segment : 891 time for calcul the mask position with numpy : 0.0028760433197021484 nb_pixel_total : 141781 time to create 1 rle with old method : 0.15737581253051758 length of segment : 375 time for calcul the mask position with numpy : 0.0024869441986083984 nb_pixel_total : 138294 time to create 1 rle with old method : 0.17031526565551758 length of segment : 446 time for calcul the mask position with numpy : 0.0008065700531005859 nb_pixel_total : 14087 time to create 1 rle with old method : 0.01563429832458496 length of segment : 194 time for calcul the mask position with numpy : 0.0032846927642822266 nb_pixel_total : 166106 time to create 1 rle with new method : 0.02586054801940918 length of segment : 467 time for calcul the mask position with numpy : 0.0025129318237304688 nb_pixel_total : 54200 time to create 1 rle with old method : 0.05621528625488281 length of segment : 371 time for calcul the mask position with numpy : 0.0012569427490234375 nb_pixel_total : 35981 time to create 1 rle with old method : 0.03896594047546387 length of segment : 402 time for calcul the mask position with numpy : 0.0005254745483398438 nb_pixel_total : 8767 time to create 1 rle with old method : 0.010535717010498047 length of segment : 185 time for calcul the mask position with numpy : 0.0030455589294433594 nb_pixel_total : 131991 time to create 1 rle with old method : 0.1415853500366211 length of segment : 542 time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 45105 time to create 1 rle with old method : 0.04821944236755371 length of segment : 257 time for calcul the mask position with numpy : 0.04826784133911133 nb_pixel_total : 1126380 time to create 1 rle with new method : 0.09258127212524414 length of segment : 1380 time for calcul the mask position with numpy : 0.0022814273834228516 nb_pixel_total : 91235 time to create 1 rle with old method : 0.1025688648223877 length of segment : 337 time for calcul the mask position with numpy : 0.004386186599731445 nb_pixel_total : 164571 time to create 1 rle with new method : 0.0118255615234375 length of segment : 589 time for calcul the mask position with numpy : 0.0018641948699951172 nb_pixel_total : 77637 time to create 1 rle with old method : 0.09934639930725098 length of segment : 626 time for calcul the mask position with numpy : 0.003141164779663086 nb_pixel_total : 134436 time to create 1 rle with old method : 0.148972749710083 length of segment : 451 time for calcul the mask position with numpy : 0.002077341079711914 nb_pixel_total : 96224 time to create 1 rle with old method : 0.10468864440917969 length of segment : 504 time for calcul the mask position with numpy : 0.01279449462890625 nb_pixel_total : 606138 time to create 1 rle with new method : 0.05450582504272461 length of segment : 948 time for calcul the mask position with numpy : 0.0017976760864257812 nb_pixel_total : 19777 time to create 1 rle with old method : 0.02268385887145996 length of segment : 309 time for calcul the mask position with numpy : 0.0013175010681152344 nb_pixel_total : 68010 time to create 1 rle with old method : 0.07677340507507324 length of segment : 347 time for calcul the mask position with numpy : 0.003280162811279297 nb_pixel_total : 108820 time to create 1 rle with old method : 0.11725831031799316 length of segment : 533 time for calcul the mask position with numpy : 0.0011954307556152344 nb_pixel_total : 41998 time to create 1 rle with old method : 0.04526066780090332 length of segment : 278 time for calcul the mask position with numpy : 0.0061168670654296875 nb_pixel_total : 271558 time to create 1 rle with new method : 0.019593000411987305 length of segment : 887 time for calcul the mask position with numpy : 0.011870145797729492 nb_pixel_total : 548921 time to create 1 rle with new method : 0.02929377555847168 length of segment : 745 time for calcul the mask position with numpy : 0.01646280288696289 nb_pixel_total : 682321 time to create 1 rle with new method : 0.08483338356018066 length of segment : 1065 time for calcul the mask position with numpy : 0.022807836532592773 nb_pixel_total : 1141607 time to create 1 rle with new method : 0.3995075225830078 length of segment : 1367 time for calcul the mask position with numpy : 0.0045948028564453125 nb_pixel_total : 219231 time to create 1 rle with new method : 0.013284444808959961 length of segment : 651 time for calcul the mask position with numpy : 0.0046880245208740234 nb_pixel_total : 293995 time to create 1 rle with new method : 0.012626886367797852 length of segment : 1055 time for calcul the mask position with numpy : 0.004477500915527344 nb_pixel_total : 152377 time to create 1 rle with new method : 0.005916595458984375 length of segment : 412 time for calcul the mask position with numpy : 0.008959293365478516 nb_pixel_total : 255400 time to create 1 rle with new method : 0.012000083923339844 length of segment : 537 time for calcul the mask position with numpy : 0.01879405975341797 nb_pixel_total : 912163 time to create 1 rle with new method : 0.20441985130310059 length of segment : 767 time for calcul the mask position with numpy : 0.01055288314819336 nb_pixel_total : 562396 time to create 1 rle with new method : 0.06289052963256836 length of segment : 851 time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 20351 time to create 1 rle with old method : 0.023083925247192383 length of segment : 127 time for calcul the mask position with numpy : 0.002315044403076172 nb_pixel_total : 115432 time to create 1 rle with old method : 0.1247403621673584 length of segment : 338 time for calcul the mask position with numpy : 0.01182699203491211 nb_pixel_total : 613856 time to create 1 rle with new method : 0.029494047164916992 length of segment : 1263 time for calcul the mask position with numpy : 0.0009608268737792969 nb_pixel_total : 37373 time to create 1 rle with old method : 0.04133915901184082 length of segment : 208 time for calcul the mask position with numpy : 0.0007221698760986328 nb_pixel_total : 26039 time to create 1 rle with old method : 0.030106067657470703 length of segment : 263 time for calcul the mask position with numpy : 0.009479761123657227 nb_pixel_total : 402376 time to create 1 rle with new method : 0.0148773193359375 length of segment : 539 time for calcul the mask position with numpy : 0.001863241195678711 nb_pixel_total : 119394 time to create 1 rle with old method : 0.1295454502105713 length of segment : 304 time for calcul the mask position with numpy : 0.042528390884399414 nb_pixel_total : 2316117 time to create 1 rle with new method : 0.7334558963775635 length of segment : 2072 time for calcul the mask position with numpy : 0.0015742778778076172 nb_pixel_total : 69468 time to create 1 rle with old method : 0.07949066162109375 length of segment : 318 time for calcul the mask position with numpy : 0.0010709762573242188 nb_pixel_total : 37003 time to create 1 rle with old method : 0.04258584976196289 length of segment : 190 time for calcul the mask position with numpy : 0.0017061233520507812 nb_pixel_total : 56772 time to create 1 rle with old method : 0.06436920166015625 length of segment : 249 time for calcul the mask position with numpy : 0.0020072460174560547 nb_pixel_total : 92120 time to create 1 rle with old method : 0.1087961196899414 length of segment : 375 time for calcul the mask position with numpy : 0.0013210773468017578 nb_pixel_total : 60046 time to create 1 rle with old method : 0.06743216514587402 length of segment : 289 time for calcul the mask position with numpy : 0.002712249755859375 nb_pixel_total : 97053 time to create 1 rle with old method : 0.10855412483215332 length of segment : 530 time for calcul the mask position with numpy : 0.0035910606384277344 nb_pixel_total : 158669 time to create 1 rle with new method : 0.010680437088012695 length of segment : 674 time for calcul the mask position with numpy : 0.0012886524200439453 nb_pixel_total : 49272 time to create 1 rle with old method : 0.0677652359008789 length of segment : 272 time for calcul the mask position with numpy : 0.0008389949798583984 nb_pixel_total : 46190 time to create 1 rle with old method : 0.05193781852722168 length of segment : 243 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 9755 time to create 1 rle with old method : 0.011594772338867188 length of segment : 212 time for calcul the mask position with numpy : 0.014524221420288086 nb_pixel_total : 651363 time to create 1 rle with new method : 0.057985544204711914 length of segment : 1012 time for calcul the mask position with numpy : 0.0010228157043457031 nb_pixel_total : 34005 time to create 1 rle with old method : 0.038964271545410156 length of segment : 265 time for calcul the mask position with numpy : 0.003499746322631836 nb_pixel_total : 72184 time to create 1 rle with old method : 0.08163309097290039 length of segment : 563 time for calcul the mask position with numpy : 0.0030503273010253906 nb_pixel_total : 115035 time to create 1 rle with old method : 0.12429332733154297 length of segment : 576 time for calcul the mask position with numpy : 0.001180887222290039 nb_pixel_total : 45522 time to create 1 rle with old method : 0.050826072692871094 length of segment : 263 time for calcul the mask position with numpy : 0.0010843276977539062 nb_pixel_total : 65965 time to create 1 rle with old method : 0.07107234001159668 length of segment : 278 time for calcul the mask position with numpy : 0.00431370735168457 nb_pixel_total : 217685 time to create 1 rle with new method : 0.013889312744140625 length of segment : 905 time for calcul the mask position with numpy : 0.011924028396606445 nb_pixel_total : 619028 time to create 1 rle with new method : 0.5518443584442139 length of segment : 1166 time for calcul the mask position with numpy : 0.0007536411285400391 nb_pixel_total : 41810 time to create 1 rle with old method : 0.05489754676818848 length of segment : 235 time for calcul the mask position with numpy : 0.004004001617431641 nb_pixel_total : 128854 time to create 1 rle with old method : 0.15456795692443848 length of segment : 257 time for calcul the mask position with numpy : 0.0015206336975097656 nb_pixel_total : 65987 time to create 1 rle with old method : 0.07665681838989258 length of segment : 459 time for calcul the mask position with numpy : 0.0011782646179199219 nb_pixel_total : 56527 time to create 1 rle with old method : 0.06267237663269043 length of segment : 274 time for calcul the mask position with numpy : 0.011886358261108398 nb_pixel_total : 634083 time to create 1 rle with new method : 0.06333422660827637 length of segment : 984 time for calcul the mask position with numpy : 0.004372358322143555 nb_pixel_total : 203117 time to create 1 rle with new method : 0.01342153549194336 length of segment : 529 time for calcul the mask position with numpy : 0.002516508102416992 nb_pixel_total : 102688 time to create 1 rle with old method : 0.12042593955993652 length of segment : 528 time for calcul the mask position with numpy : 0.00457453727722168 nb_pixel_total : 199233 time to create 1 rle with new method : 0.013667821884155273 length of segment : 550 time for calcul the mask position with numpy : 0.015732526779174805 nb_pixel_total : 642443 time to create 1 rle with new method : 0.29298901557922363 length of segment : 1062 time for calcul the mask position with numpy : 0.0031223297119140625 nb_pixel_total : 159107 time to create 1 rle with new method : 0.00939321517944336 length of segment : 643 time for calcul the mask position with numpy : 0.0014388561248779297 nb_pixel_total : 42563 time to create 1 rle with old method : 0.059205055236816406 length of segment : 309 time for calcul the mask position with numpy : 0.0015087127685546875 nb_pixel_total : 78920 time to create 1 rle with old method : 0.08841657638549805 length of segment : 503 time for calcul the mask position with numpy : 0.001988649368286133 nb_pixel_total : 98022 time to create 1 rle with old method : 0.10960626602172852 length of segment : 372 time for calcul the mask position with numpy : 0.0030956268310546875 nb_pixel_total : 159569 time to create 1 rle with new method : 0.008560419082641602 length of segment : 631 time for calcul the mask position with numpy : 0.0012073516845703125 nb_pixel_total : 50311 time to create 1 rle with old method : 0.056632280349731445 length of segment : 342 time for calcul the mask position with numpy : 0.01282191276550293 nb_pixel_total : 474403 time to create 1 rle with new method : 0.10795760154724121 length of segment : 1204 time for calcul the mask position with numpy : 0.0022439956665039062 nb_pixel_total : 79176 time to create 1 rle with old method : 0.08941030502319336 length of segment : 326 time for calcul the mask position with numpy : 0.0008852481842041016 nb_pixel_total : 36497 time to create 1 rle with old method : 0.04150891304016113 length of segment : 212 time for calcul the mask position with numpy : 0.0021696090698242188 nb_pixel_total : 81414 time to create 1 rle with old method : 0.09504151344299316 length of segment : 341 time for calcul the mask position with numpy : 0.0018725395202636719 nb_pixel_total : 94382 time to create 1 rle with old method : 0.13182616233825684 length of segment : 377 time for calcul the mask position with numpy : 0.0014116764068603516 nb_pixel_total : 62111 time to create 1 rle with old method : 0.07006287574768066 length of segment : 369 time for calcul the mask position with numpy : 0.006584644317626953 nb_pixel_total : 135854 time to create 1 rle with old method : 0.15349411964416504 length of segment : 268 time for calcul the mask position with numpy : 0.001708984375 nb_pixel_total : 83247 time to create 1 rle with old method : 0.09549689292907715 length of segment : 277 time for calcul the mask position with numpy : 0.010334014892578125 nb_pixel_total : 190712 time to create 1 rle with new method : 0.011647701263427734 length of segment : 861 time for calcul the mask position with numpy : 0.0037832260131835938 nb_pixel_total : 182805 time to create 1 rle with new method : 0.01028132438659668 length of segment : 558 time for calcul the mask position with numpy : 0.004860639572143555 nb_pixel_total : 173782 time to create 1 rle with new method : 0.014445781707763672 length of segment : 546 time for calcul the mask position with numpy : 0.0011720657348632812 nb_pixel_total : 45861 time to create 1 rle with old method : 0.04975533485412598 length of segment : 351 time for calcul the mask position with numpy : 0.024978160858154297 nb_pixel_total : 609768 time to create 1 rle with new method : 0.0251767635345459 length of segment : 995 time for calcul the mask position with numpy : 0.0069599151611328125 nb_pixel_total : 166876 time to create 1 rle with new method : 0.008518695831298828 length of segment : 496 time for calcul the mask position with numpy : 0.005941867828369141 nb_pixel_total : 199019 time to create 1 rle with new method : 0.017651796340942383 length of segment : 510 time for calcul the mask position with numpy : 0.0018186569213867188 nb_pixel_total : 85209 time to create 1 rle with old method : 0.09509754180908203 length of segment : 233 time for calcul the mask position with numpy : 0.0008981227874755859 nb_pixel_total : 40164 time to create 1 rle with old method : 0.045094966888427734 length of segment : 227 time for calcul the mask position with numpy : 0.0016417503356933594 nb_pixel_total : 89192 time to create 1 rle with old method : 0.09819984436035156 length of segment : 255 time for calcul the mask position with numpy : 0.011824846267700195 nb_pixel_total : 260219 time to create 1 rle with new method : 0.018427371978759766 length of segment : 673 time for calcul the mask position with numpy : 0.0011990070343017578 nb_pixel_total : 58366 time to create 1 rle with old method : 0.06522941589355469 length of segment : 378 time for calcul the mask position with numpy : 0.001260995864868164 nb_pixel_total : 51667 time to create 1 rle with old method : 0.0576934814453125 length of segment : 200 time for calcul the mask position with numpy : 0.004367351531982422 nb_pixel_total : 71824 time to create 1 rle with old method : 0.08062052726745605 length of segment : 440 time for calcul the mask position with numpy : 0.0010182857513427734 nb_pixel_total : 41832 time to create 1 rle with old method : 0.046801090240478516 length of segment : 203 time for calcul the mask position with numpy : 0.003648996353149414 nb_pixel_total : 84969 time to create 1 rle with old method : 0.09729671478271484 length of segment : 296 time for calcul the mask position with numpy : 0.004576444625854492 nb_pixel_total : 186811 time to create 1 rle with new method : 0.013962745666503906 length of segment : 870 time for calcul the mask position with numpy : 0.0035359859466552734 nb_pixel_total : 138588 time to create 1 rle with old method : 0.15674781799316406 length of segment : 457 time for calcul the mask position with numpy : 0.005628347396850586 nb_pixel_total : 172140 time to create 1 rle with new method : 0.017043590545654297 length of segment : 532 time for calcul the mask position with numpy : 0.0019922256469726562 nb_pixel_total : 88261 time to create 1 rle with old method : 0.11873292922973633 length of segment : 318 time for calcul the mask position with numpy : 0.003543853759765625 nb_pixel_total : 115244 time to create 1 rle with old method : 0.15484023094177246 length of segment : 418 time for calcul the mask position with numpy : 0.0020127296447753906 nb_pixel_total : 19403 time to create 1 rle with old method : 0.021617650985717773 length of segment : 226 time for calcul the mask position with numpy : 0.0017499923706054688 nb_pixel_total : 62276 time to create 1 rle with old method : 0.06866025924682617 length of segment : 418 time for calcul the mask position with numpy : 0.047425031661987305 nb_pixel_total : 658617 time to create 1 rle with new method : 0.8112738132476807 length of segment : 902 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 25269 time to create 1 rle with old method : 0.028472423553466797 length of segment : 273 time for calcul the mask position with numpy : 0.00619053840637207 nb_pixel_total : 85770 time to create 1 rle with old method : 0.12198042869567871 length of segment : 527 time for calcul the mask position with numpy : 0.0008790493011474609 nb_pixel_total : 17640 time to create 1 rle with old method : 0.02165842056274414 length of segment : 133 time for calcul the mask position with numpy : 0.005574703216552734 nb_pixel_total : 125571 time to create 1 rle with old method : 0.14058446884155273 length of segment : 753 time for calcul the mask position with numpy : 0.008613109588623047 nb_pixel_total : 222642 time to create 1 rle with new method : 0.018411636352539062 length of segment : 801 time for calcul the mask position with numpy : 0.0016062259674072266 nb_pixel_total : 90476 time to create 1 rle with old method : 0.11776590347290039 length of segment : 327 time for calcul the mask position with numpy : 0.007997751235961914 nb_pixel_total : 374692 time to create 1 rle with new method : 0.03572535514831543 length of segment : 625 time for calcul the mask position with numpy : 0.0047149658203125 nb_pixel_total : 99420 time to create 1 rle with old method : 0.14365935325622559 length of segment : 302 time for calcul the mask position with numpy : 0.0013213157653808594 nb_pixel_total : 17626 time to create 1 rle with old method : 0.020371198654174805 length of segment : 253 time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 22867 time to create 1 rle with old method : 0.02573704719543457 length of segment : 209 time for calcul the mask position with numpy : 0.0007534027099609375 nb_pixel_total : 30891 time to create 1 rle with old method : 0.03600716590881348 length of segment : 258 time for calcul the mask position with numpy : 0.0015382766723632812 nb_pixel_total : 72504 time to create 1 rle with old method : 0.08151817321777344 length of segment : 229 time for calcul the mask position with numpy : 0.0010650157928466797 nb_pixel_total : 52528 time to create 1 rle with old method : 0.05896568298339844 length of segment : 268 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 17072 time to create 1 rle with old method : 0.019832611083984375 length of segment : 111 time for calcul the mask position with numpy : 0.0019865036010742188 nb_pixel_total : 31918 time to create 1 rle with old method : 0.035518646240234375 length of segment : 209 time for calcul the mask position with numpy : 0.07255268096923828 nb_pixel_total : 1385417 time to create 1 rle with new method : 0.3070077896118164 length of segment : 753 time for calcul the mask position with numpy : 0.0334925651550293 nb_pixel_total : 1377553 time to create 1 rle with new method : 0.17579245567321777 length of segment : 738 time for calcul the mask position with numpy : 0.028148889541625977 nb_pixel_total : 471550 time to create 1 rle with new method : 0.03315901756286621 length of segment : 782 time for calcul the mask position with numpy : 0.0015652179718017578 nb_pixel_total : 47362 time to create 1 rle with old method : 0.06706833839416504 length of segment : 380 time for calcul the mask position with numpy : 0.0023527145385742188 nb_pixel_total : 62940 time to create 1 rle with old method : 0.10027623176574707 length of segment : 258 time for calcul the mask position with numpy : 0.0023012161254882812 nb_pixel_total : 81452 time to create 1 rle with old method : 0.09465360641479492 length of segment : 279 time for calcul the mask position with numpy : 0.003258228302001953 nb_pixel_total : 68895 time to create 1 rle with old method : 0.07693815231323242 length of segment : 335 time for calcul the mask position with numpy : 0.00080108642578125 nb_pixel_total : 30119 time to create 1 rle with old method : 0.045763492584228516 length of segment : 262 time for calcul the mask position with numpy : 0.003217458724975586 nb_pixel_total : 150883 time to create 1 rle with new method : 0.009843111038208008 length of segment : 611 time for calcul the mask position with numpy : 0.003209352493286133 nb_pixel_total : 87998 time to create 1 rle with old method : 0.0976858139038086 length of segment : 585 time for calcul the mask position with numpy : 0.0038347244262695312 nb_pixel_total : 62308 time to create 1 rle with old method : 0.08204507827758789 length of segment : 385 time for calcul the mask position with numpy : 0.008636236190795898 nb_pixel_total : 184838 time to create 1 rle with new method : 0.01152348518371582 length of segment : 490 time for calcul the mask position with numpy : 0.001973390579223633 nb_pixel_total : 80815 time to create 1 rle with old method : 0.0899043083190918 length of segment : 308 time for calcul the mask position with numpy : 0.0008628368377685547 nb_pixel_total : 39839 time to create 1 rle with old method : 0.04470539093017578 length of segment : 175 time for calcul the mask position with numpy : 0.0010788440704345703 nb_pixel_total : 39945 time to create 1 rle with old method : 0.04497504234313965 length of segment : 254 time for calcul the mask position with numpy : 0.0043833255767822266 nb_pixel_total : 208450 time to create 1 rle with new method : 0.013705730438232422 length of segment : 359 time for calcul the mask position with numpy : 0.0024797916412353516 nb_pixel_total : 113715 time to create 1 rle with old method : 0.14705944061279297 length of segment : 490 time for calcul the mask position with numpy : 0.0014727115631103516 nb_pixel_total : 62996 time to create 1 rle with old method : 0.07057714462280273 length of segment : 295 time for calcul the mask position with numpy : 0.007101774215698242 nb_pixel_total : 193619 time to create 1 rle with new method : 0.010689020156860352 length of segment : 653 time for calcul the mask position with numpy : 0.001032114028930664 nb_pixel_total : 36043 time to create 1 rle with old method : 0.040715932846069336 length of segment : 231 time for calcul the mask position with numpy : 0.0012874603271484375 nb_pixel_total : 65627 time to create 1 rle with old method : 0.07142257690429688 length of segment : 311 time for calcul the mask position with numpy : 0.0025603771209716797 nb_pixel_total : 129621 time to create 1 rle with old method : 0.14336895942687988 length of segment : 599 time for calcul the mask position with numpy : 0.008919954299926758 nb_pixel_total : 153741 time to create 1 rle with new method : 0.021511077880859375 length of segment : 843 time for calcul the mask position with numpy : 0.0008292198181152344 nb_pixel_total : 39624 time to create 1 rle with old method : 0.044667720794677734 length of segment : 196 time for calcul the mask position with numpy : 0.002943754196166992 nb_pixel_total : 108235 time to create 1 rle with old method : 0.12370562553405762 length of segment : 393 time for calcul the mask position with numpy : 0.0011432170867919922 nb_pixel_total : 53633 time to create 1 rle with old method : 0.0596156120300293 length of segment : 265 time for calcul the mask position with numpy : 0.003994464874267578 nb_pixel_total : 159161 time to create 1 rle with new method : 0.01300811767578125 length of segment : 408 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 38317 time to create 1 rle with old method : 0.04332399368286133 length of segment : 201 time for calcul the mask position with numpy : 0.0017330646514892578 nb_pixel_total : 79416 time to create 1 rle with old method : 0.08978605270385742 length of segment : 309 time for calcul the mask position with numpy : 0.0015149116516113281 nb_pixel_total : 83110 time to create 1 rle with old method : 0.09360170364379883 length of segment : 337 time for calcul the mask position with numpy : 0.002825498580932617 nb_pixel_total : 120337 time to create 1 rle with old method : 0.13567900657653809 length of segment : 509 time for calcul the mask position with numpy : 0.19441866874694824 nb_pixel_total : 1827933 time to create 1 rle with new method : 0.6109237670898438 length of segment : 2539 time for calcul the mask position with numpy : 0.02383279800415039 nb_pixel_total : 128531 time to create 1 rle with old method : 0.15999770164489746 length of segment : 413 time for calcul the mask position with numpy : 0.0026404857635498047 nb_pixel_total : 131783 time to create 1 rle with old method : 0.14337730407714844 length of segment : 504 time for calcul the mask position with numpy : 0.014276742935180664 nb_pixel_total : 616686 time to create 1 rle with new method : 0.0395963191986084 length of segment : 1057 time for calcul the mask position with numpy : 0.005809307098388672 nb_pixel_total : 264767 time to create 1 rle with new method : 0.015445470809936523 length of segment : 653 time for calcul the mask position with numpy : 0.0010280609130859375 nb_pixel_total : 44335 time to create 1 rle with old method : 0.04769182205200195 length of segment : 342 time for calcul the mask position with numpy : 0.003674745559692383 nb_pixel_total : 167505 time to create 1 rle with new method : 0.011792182922363281 length of segment : 570 time for calcul the mask position with numpy : 0.0014295578002929688 nb_pixel_total : 54314 time to create 1 rle with old method : 0.06045866012573242 length of segment : 389 time for calcul the mask position with numpy : 0.007539510726928711 nb_pixel_total : 364312 time to create 1 rle with new method : 0.02170109748840332 length of segment : 943 time for calcul the mask position with numpy : 0.003069162368774414 nb_pixel_total : 127308 time to create 1 rle with old method : 0.1578693389892578 length of segment : 860 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 14401 time to create 1 rle with old method : 0.015959501266479492 length of segment : 223 time for calcul the mask position with numpy : 0.0037817955017089844 nb_pixel_total : 200858 time to create 1 rle with new method : 0.009850502014160156 length of segment : 627 time for calcul the mask position with numpy : 0.0040857791900634766 nb_pixel_total : 126749 time to create 1 rle with old method : 0.14501190185546875 length of segment : 794 time for calcul the mask position with numpy : 0.00482177734375 nb_pixel_total : 322865 time to create 1 rle with new method : 0.011746644973754883 length of segment : 500 time for calcul the mask position with numpy : 0.03712749481201172 nb_pixel_total : 1188399 time to create 1 rle with new method : 0.20867252349853516 length of segment : 1727 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 42497 time to create 1 rle with old method : 0.05988883972167969 length of segment : 245 time for calcul the mask position with numpy : 0.001161813735961914 nb_pixel_total : 32580 time to create 1 rle with old method : 0.037595272064208984 length of segment : 306 time for calcul the mask position with numpy : 0.0056078433990478516 nb_pixel_total : 326459 time to create 1 rle with new method : 0.015181541442871094 length of segment : 553 time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 12175 time to create 1 rle with old method : 0.014266490936279297 length of segment : 235 time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 35309 time to create 1 rle with old method : 0.03975415229797363 length of segment : 217 time for calcul the mask position with numpy : 0.0013365745544433594 nb_pixel_total : 59340 time to create 1 rle with old method : 0.06858086585998535 length of segment : 497 time for calcul the mask position with numpy : 0.008706808090209961 nb_pixel_total : 472471 time to create 1 rle with new method : 0.025290250778198242 length of segment : 566 time for calcul the mask position with numpy : 0.002611398696899414 nb_pixel_total : 136002 time to create 1 rle with old method : 0.16807150840759277 length of segment : 374 time for calcul the mask position with numpy : 0.0029730796813964844 nb_pixel_total : 134191 time to create 1 rle with old method : 0.1448383331298828 length of segment : 373 time for calcul the mask position with numpy : 0.004296302795410156 nb_pixel_total : 210355 time to create 1 rle with new method : 0.012074470520019531 length of segment : 813 time for calcul the mask position with numpy : 0.0014448165893554688 nb_pixel_total : 82466 time to create 1 rle with old method : 0.09129834175109863 length of segment : 330 time for calcul the mask position with numpy : 0.0010907649993896484 nb_pixel_total : 44444 time to create 1 rle with old method : 0.04920673370361328 length of segment : 294 time for calcul the mask position with numpy : 0.0031957626342773438 nb_pixel_total : 161833 time to create 1 rle with new method : 0.009168624877929688 length of segment : 559 time for calcul the mask position with numpy : 0.0014691352844238281 nb_pixel_total : 59332 time to create 1 rle with old method : 0.06539225578308105 length of segment : 259 time for calcul the mask position with numpy : 0.0016632080078125 nb_pixel_total : 72863 time to create 1 rle with old method : 0.08073139190673828 length of segment : 423 time for calcul the mask position with numpy : 0.0011317729949951172 nb_pixel_total : 47299 time to create 1 rle with old method : 0.05095171928405762 length of segment : 478 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 22907 time to create 1 rle with old method : 0.025776386260986328 length of segment : 260 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 19762 time to create 1 rle with old method : 0.021731138229370117 length of segment : 153 time for calcul the mask position with numpy : 0.0034453868865966797 nb_pixel_total : 152706 time to create 1 rle with new method : 0.010996818542480469 length of segment : 446 time for calcul the mask position with numpy : 0.0018444061279296875 nb_pixel_total : 102303 time to create 1 rle with old method : 0.11269927024841309 length of segment : 460 time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 30496 time to create 1 rle with old method : 0.03349947929382324 length of segment : 259 time for calcul the mask position with numpy : 0.007279634475708008 nb_pixel_total : 383387 time to create 1 rle with new method : 0.020847558975219727 length of segment : 712 time for calcul the mask position with numpy : 0.000263214111328125 nb_pixel_total : 11767 time to create 1 rle with old method : 0.01403355598449707 length of segment : 94 time for calcul the mask position with numpy : 0.005133628845214844 nb_pixel_total : 185920 time to create 1 rle with new method : 0.017412900924682617 length of segment : 994 time for calcul the mask position with numpy : 0.0026302337646484375 nb_pixel_total : 125395 time to create 1 rle with old method : 0.14121294021606445 length of segment : 605 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 21329 time to create 1 rle with old method : 0.02460622787475586 length of segment : 209 time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 28705 time to create 1 rle with old method : 0.03283262252807617 length of segment : 376 time for calcul the mask position with numpy : 0.0007569789886474609 nb_pixel_total : 28178 time to create 1 rle with old method : 0.032233238220214844 length of segment : 228 time for calcul the mask position with numpy : 0.0012426376342773438 nb_pixel_total : 49124 time to create 1 rle with old method : 0.05650067329406738 length of segment : 232 time for calcul the mask position with numpy : 0.01722097396850586 nb_pixel_total : 368625 time to create 1 rle with new method : 0.12384319305419922 length of segment : 1583 time for calcul the mask position with numpy : 0.006431102752685547 nb_pixel_total : 226065 time to create 1 rle with new method : 0.02540278434753418 length of segment : 990 time for calcul the mask position with numpy : 0.002047300338745117 nb_pixel_total : 58133 time to create 1 rle with old method : 0.08183002471923828 length of segment : 361 time for calcul the mask position with numpy : 0.005198478698730469 nb_pixel_total : 223140 time to create 1 rle with new method : 0.016852140426635742 length of segment : 758 time for calcul the mask position with numpy : 0.0032167434692382812 nb_pixel_total : 69107 time to create 1 rle with old method : 0.08279061317443848 length of segment : 507 time for calcul the mask position with numpy : 0.004977703094482422 nb_pixel_total : 95073 time to create 1 rle with old method : 0.11552715301513672 length of segment : 767 time for calcul the mask position with numpy : 0.0021355152130126953 nb_pixel_total : 41394 time to create 1 rle with old method : 0.047003984451293945 length of segment : 478 time for calcul the mask position with numpy : 0.0018641948699951172 nb_pixel_total : 73489 time to create 1 rle with old method : 0.08791637420654297 length of segment : 336 time for calcul the mask position with numpy : 0.0035028457641601562 nb_pixel_total : 104037 time to create 1 rle with old method : 0.1254286766052246 length of segment : 535 time for calcul the mask position with numpy : 0.0020036697387695312 nb_pixel_total : 79009 time to create 1 rle with old method : 0.08874750137329102 length of segment : 432 time for calcul the mask position with numpy : 0.0006971359252929688 nb_pixel_total : 37312 time to create 1 rle with old method : 0.04291558265686035 length of segment : 276 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 34052 time to create 1 rle with old method : 0.039016008377075195 length of segment : 179 time for calcul the mask position with numpy : 0.004105329513549805 nb_pixel_total : 202548 time to create 1 rle with new method : 0.01299142837524414 length of segment : 820 time for calcul the mask position with numpy : 0.0013928413391113281 nb_pixel_total : 48759 time to create 1 rle with old method : 0.05385231971740723 length of segment : 205 time for calcul the mask position with numpy : 0.0021948814392089844 nb_pixel_total : 100300 time to create 1 rle with old method : 0.11341309547424316 length of segment : 559 time for calcul the mask position with numpy : 0.0031833648681640625 nb_pixel_total : 129498 time to create 1 rle with old method : 0.14528632164001465 length of segment : 406 time for calcul the mask position with numpy : 0.001552581787109375 nb_pixel_total : 75786 time to create 1 rle with old method : 0.08415794372558594 length of segment : 302 time for calcul the mask position with numpy : 0.004127979278564453 nb_pixel_total : 210065 time to create 1 rle with new method : 0.010405302047729492 length of segment : 465 time for calcul the mask position with numpy : 0.0009911060333251953 nb_pixel_total : 47137 time to create 1 rle with old method : 0.052092790603637695 length of segment : 386 time for calcul the mask position with numpy : 0.005360841751098633 nb_pixel_total : 224708 time to create 1 rle with new method : 0.016515016555786133 length of segment : 939 time for calcul the mask position with numpy : 0.003931999206542969 nb_pixel_total : 213865 time to create 1 rle with new method : 0.011079549789428711 length of segment : 598 time for calcul the mask position with numpy : 0.004224300384521484 nb_pixel_total : 217615 time to create 1 rle with new method : 0.012140989303588867 length of segment : 695 time for calcul the mask position with numpy : 0.007319927215576172 nb_pixel_total : 321662 time to create 1 rle with new method : 0.020951032638549805 length of segment : 809 time for calcul the mask position with numpy : 0.0017809867858886719 nb_pixel_total : 81666 time to create 1 rle with old method : 0.09073686599731445 length of segment : 480 time for calcul the mask position with numpy : 0.0026509761810302734 nb_pixel_total : 126670 time to create 1 rle with old method : 0.14171481132507324 length of segment : 509 time for calcul the mask position with numpy : 0.0016596317291259766 nb_pixel_total : 89914 time to create 1 rle with old method : 0.09988141059875488 length of segment : 384 time for calcul the mask position with numpy : 0.0034799575805664062 nb_pixel_total : 154793 time to create 1 rle with new method : 0.010523557662963867 length of segment : 686 time for calcul the mask position with numpy : 0.0027344226837158203 nb_pixel_total : 135649 time to create 1 rle with old method : 0.150221586227417 length of segment : 657 time for calcul the mask position with numpy : 0.004714488983154297 nb_pixel_total : 181951 time to create 1 rle with new method : 0.014864921569824219 length of segment : 373 time for calcul the mask position with numpy : 0.0007374286651611328 nb_pixel_total : 26782 time to create 1 rle with old method : 0.03119182586669922 length of segment : 196 time for calcul the mask position with numpy : 0.0041730403900146484 nb_pixel_total : 227112 time to create 1 rle with new method : 0.011928081512451172 length of segment : 661 time for calcul the mask position with numpy : 0.009572982788085938 nb_pixel_total : 426882 time to create 1 rle with new method : 0.0458979606628418 length of segment : 943 time for calcul the mask position with numpy : 0.0017247200012207031 nb_pixel_total : 74642 time to create 1 rle with old method : 0.08399343490600586 length of segment : 328 time for calcul the mask position with numpy : 0.00767970085144043 nb_pixel_total : 450834 time to create 1 rle with new method : 0.017685890197753906 length of segment : 664 time for calcul the mask position with numpy : 0.0011794567108154297 nb_pixel_total : 37259 time to create 1 rle with old method : 0.04130864143371582 length of segment : 352 time for calcul the mask position with numpy : 0.0014197826385498047 nb_pixel_total : 70174 time to create 1 rle with old method : 0.07880568504333496 length of segment : 298 time for calcul the mask position with numpy : 0.005270242691040039 nb_pixel_total : 325145 time to create 1 rle with new method : 0.013439416885375977 length of segment : 540 time for calcul the mask position with numpy : 0.0022666454315185547 nb_pixel_total : 116647 time to create 1 rle with old method : 0.12859582901000977 length of segment : 260 time for calcul the mask position with numpy : 0.006421804428100586 nb_pixel_total : 233231 time to create 1 rle with new method : 0.017853975296020508 length of segment : 444 time for calcul the mask position with numpy : 0.012814044952392578 nb_pixel_total : 639207 time to create 1 rle with new method : 0.04494333267211914 length of segment : 996 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 16701 time to create 1 rle with old method : 0.018739700317382812 length of segment : 162 time for calcul the mask position with numpy : 0.0035266876220703125 nb_pixel_total : 200013 time to create 1 rle with new method : 0.00837564468383789 length of segment : 308 time for calcul the mask position with numpy : 0.0027191638946533203 nb_pixel_total : 163849 time to create 1 rle with new method : 0.00714111328125 length of segment : 619 time for calcul the mask position with numpy : 0.0026237964630126953 nb_pixel_total : 147472 time to create 1 rle with old method : 0.16338753700256348 length of segment : 488 time for calcul the mask position with numpy : 0.0040476322174072266 nb_pixel_total : 247909 time to create 1 rle with new method : 0.01000523567199707 length of segment : 436 time for calcul the mask position with numpy : 0.00089263916015625 nb_pixel_total : 20684 time to create 1 rle with old method : 0.025524616241455078 length of segment : 192 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 48617 time to create 1 rle with old method : 0.05391240119934082 length of segment : 292 time for calcul the mask position with numpy : 0.001790761947631836 nb_pixel_total : 76789 time to create 1 rle with old method : 0.08552908897399902 length of segment : 348 time for calcul the mask position with numpy : 0.003838777542114258 nb_pixel_total : 189153 time to create 1 rle with new method : 0.011898040771484375 length of segment : 507 time for calcul the mask position with numpy : 0.004179954528808594 nb_pixel_total : 218330 time to create 1 rle with new method : 0.011857032775878906 length of segment : 873 time for calcul the mask position with numpy : 0.0029544830322265625 nb_pixel_total : 126219 time to create 1 rle with old method : 0.14256882667541504 length of segment : 485 time for calcul the mask position with numpy : 0.004778146743774414 nb_pixel_total : 211726 time to create 1 rle with new method : 0.013907432556152344 length of segment : 534 time for calcul the mask position with numpy : 0.00625920295715332 nb_pixel_total : 242776 time to create 1 rle with new method : 0.019570350646972656 length of segment : 551 time for calcul the mask position with numpy : 0.004414081573486328 nb_pixel_total : 183747 time to create 1 rle with new method : 0.013770103454589844 length of segment : 737 time for calcul the mask position with numpy : 0.0016875267028808594 nb_pixel_total : 85017 time to create 1 rle with old method : 0.09400224685668945 length of segment : 228 time for calcul the mask position with numpy : 0.0008845329284667969 nb_pixel_total : 34799 time to create 1 rle with old method : 0.039080142974853516 length of segment : 288 time for calcul the mask position with numpy : 0.021193504333496094 nb_pixel_total : 902603 time to create 1 rle with new method : 0.39408159255981445 length of segment : 1124 time for calcul the mask position with numpy : 0.0041103363037109375 nb_pixel_total : 243973 time to create 1 rle with new method : 0.012168169021606445 length of segment : 803 time for calcul the mask position with numpy : 0.022536277770996094 nb_pixel_total : 880110 time to create 1 rle with new method : 0.11292219161987305 length of segment : 2107 time for calcul the mask position with numpy : 0.02342844009399414 nb_pixel_total : 1318431 time to create 1 rle with new method : 0.39624452590942383 length of segment : 1577 time for calcul the mask position with numpy : 0.0016875267028808594 nb_pixel_total : 72246 time to create 1 rle with old method : 0.08040833473205566 length of segment : 783 time for calcul the mask position with numpy : 0.0007174015045166016 nb_pixel_total : 30119 time to create 1 rle with old method : 0.033812522888183594 length of segment : 224 time for calcul the mask position with numpy : 0.0005998611450195312 nb_pixel_total : 25279 time to create 1 rle with old method : 0.028764009475708008 length of segment : 186 time for calcul the mask position with numpy : 0.0031380653381347656 nb_pixel_total : 198539 time to create 1 rle with new method : 0.008700132369995117 length of segment : 844 time for calcul the mask position with numpy : 0.0006644725799560547 nb_pixel_total : 9674 time to create 1 rle with old method : 0.011288881301879883 length of segment : 150 time for calcul the mask position with numpy : 0.0017421245574951172 nb_pixel_total : 98916 time to create 1 rle with old method : 0.11063718795776367 length of segment : 473 time for calcul the mask position with numpy : 0.0010600090026855469 nb_pixel_total : 51861 time to create 1 rle with old method : 0.05821824073791504 length of segment : 288 time for calcul the mask position with numpy : 0.018239736557006836 nb_pixel_total : 930646 time to create 1 rle with new method : 0.09508180618286133 length of segment : 1264 time for calcul the mask position with numpy : 0.0020411014556884766 nb_pixel_total : 98803 time to create 1 rle with old method : 0.11089229583740234 length of segment : 386 time for calcul the mask position with numpy : 0.0030035972595214844 nb_pixel_total : 144066 time to create 1 rle with old method : 0.15755558013916016 length of segment : 616 time for calcul the mask position with numpy : 0.008584022521972656 nb_pixel_total : 368550 time to create 1 rle with new method : 0.03511929512023926 length of segment : 1309 time for calcul the mask position with numpy : 0.006795644760131836 nb_pixel_total : 348944 time to create 1 rle with new method : 0.01937556266784668 length of segment : 713 time for calcul the mask position with numpy : 0.0035712718963623047 nb_pixel_total : 152213 time to create 1 rle with new method : 0.010869979858398438 length of segment : 775 time for calcul the mask position with numpy : 0.0011529922485351562 nb_pixel_total : 58356 time to create 1 rle with old method : 0.08233308792114258 length of segment : 234 time for calcul the mask position with numpy : 0.0025637149810791016 nb_pixel_total : 127805 time to create 1 rle with old method : 0.13803482055664062 length of segment : 620 time for calcul the mask position with numpy : 0.00437617301940918 nb_pixel_total : 170109 time to create 1 rle with new method : 0.013126850128173828 length of segment : 536 time for calcul the mask position with numpy : 0.0011701583862304688 nb_pixel_total : 54607 time to create 1 rle with old method : 0.061122894287109375 length of segment : 327 time for calcul the mask position with numpy : 0.0016932487487792969 nb_pixel_total : 82387 time to create 1 rle with old method : 0.09155631065368652 length of segment : 521 time for calcul the mask position with numpy : 0.0031118392944335938 nb_pixel_total : 113017 time to create 1 rle with old method : 0.13338589668273926 length of segment : 752 time for calcul the mask position with numpy : 0.004136085510253906 nb_pixel_total : 215692 time to create 1 rle with new method : 0.011338472366333008 length of segment : 532 time for calcul the mask position with numpy : 0.001997232437133789 nb_pixel_total : 86444 time to create 1 rle with old method : 0.09255743026733398 length of segment : 533 time for calcul the mask position with numpy : 0.003221273422241211 nb_pixel_total : 100651 time to create 1 rle with old method : 0.1085352897644043 length of segment : 426 time for calcul the mask position with numpy : 0.002610445022583008 nb_pixel_total : 91500 time to create 1 rle with old method : 0.09697246551513672 length of segment : 637 time for calcul the mask position with numpy : 0.0011370182037353516 nb_pixel_total : 31129 time to create 1 rle with old method : 0.03399801254272461 length of segment : 227 time for calcul the mask position with numpy : 0.01892852783203125 nb_pixel_total : 658064 time to create 1 rle with new method : 0.05912947654724121 length of segment : 813 time for calcul the mask position with numpy : 0.0009541511535644531 nb_pixel_total : 46593 time to create 1 rle with old method : 0.05238056182861328 length of segment : 251 time for calcul the mask position with numpy : 0.0014598369598388672 nb_pixel_total : 57214 time to create 1 rle with old method : 0.06867527961730957 length of segment : 254 time for calcul the mask position with numpy : 0.00048279762268066406 nb_pixel_total : 12745 time to create 1 rle with old method : 0.015222549438476562 length of segment : 220 time for calcul the mask position with numpy : 0.0017118453979492188 nb_pixel_total : 76520 time to create 1 rle with old method : 0.09487676620483398 length of segment : 340 time for calcul the mask position with numpy : 0.007989645004272461 nb_pixel_total : 340767 time to create 1 rle with new method : 0.021509647369384766 length of segment : 1189 time for calcul the mask position with numpy : 0.0022878646850585938 nb_pixel_total : 118958 time to create 1 rle with old method : 0.13174128532409668 length of segment : 422 time for calcul the mask position with numpy : 0.009424209594726562 nb_pixel_total : 327537 time to create 1 rle with new method : 0.02512335777282715 length of segment : 639 time for calcul the mask position with numpy : 0.009285449981689453 nb_pixel_total : 262097 time to create 1 rle with new method : 0.02926945686340332 length of segment : 981 time for calcul the mask position with numpy : 0.001397848129272461 nb_pixel_total : 63975 time to create 1 rle with old method : 0.0709230899810791 length of segment : 277 time for calcul the mask position with numpy : 0.0011644363403320312 nb_pixel_total : 54410 time to create 1 rle with old method : 0.061569929122924805 length of segment : 304 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 26685 time to create 1 rle with old method : 0.03011775016784668 length of segment : 251 time for calcul the mask position with numpy : 0.024045705795288086 nb_pixel_total : 946719 time to create 1 rle with new method : 0.10887980461120605 length of segment : 1283 time for calcul the mask position with numpy : 0.009748220443725586 nb_pixel_total : 362773 time to create 1 rle with new method : 0.021781444549560547 length of segment : 890 time for calcul the mask position with numpy : 0.0012950897216796875 nb_pixel_total : 61785 time to create 1 rle with old method : 0.06983280181884766 length of segment : 321 time for calcul the mask position with numpy : 0.001626729965209961 nb_pixel_total : 69803 time to create 1 rle with old method : 0.09508967399597168 length of segment : 477 time for calcul the mask position with numpy : 0.003193378448486328 nb_pixel_total : 170579 time to create 1 rle with new method : 0.009884119033813477 length of segment : 234 time for calcul the mask position with numpy : 0.0033941268920898438 nb_pixel_total : 114122 time to create 1 rle with old method : 0.12723493576049805 length of segment : 618 time for calcul the mask position with numpy : 0.0006451606750488281 nb_pixel_total : 28054 time to create 1 rle with old method : 0.03253817558288574 length of segment : 177 time for calcul the mask position with numpy : 0.0007941722869873047 nb_pixel_total : 32063 time to create 1 rle with old method : 0.03789877891540527 length of segment : 166 time for calcul the mask position with numpy : 0.00402522087097168 nb_pixel_total : 142875 time to create 1 rle with old method : 0.16953253746032715 length of segment : 603 time for calcul the mask position with numpy : 0.01820826530456543 nb_pixel_total : 824827 time to create 1 rle with new method : 0.11568903923034668 length of segment : 1833 time for calcul the mask position with numpy : 0.016487836837768555 nb_pixel_total : 695545 time to create 1 rle with new method : 0.09329533576965332 length of segment : 786 time for calcul the mask position with numpy : 0.0009555816650390625 nb_pixel_total : 12876 time to create 1 rle with old method : 0.0330967903137207 length of segment : 210 time for calcul the mask position with numpy : 0.0011243820190429688 nb_pixel_total : 49531 time to create 1 rle with old method : 0.0565946102142334 length of segment : 269 time for calcul the mask position with numpy : 0.0027713775634765625 nb_pixel_total : 77744 time to create 1 rle with old method : 0.08838844299316406 length of segment : 600 time for calcul the mask position with numpy : 0.003864765167236328 nb_pixel_total : 168041 time to create 1 rle with new method : 0.01025080680847168 length of segment : 402 time for calcul the mask position with numpy : 0.001745462417602539 nb_pixel_total : 71624 time to create 1 rle with old method : 0.09162259101867676 length of segment : 264 time for calcul the mask position with numpy : 0.001714468002319336 nb_pixel_total : 65841 time to create 1 rle with old method : 0.07977509498596191 length of segment : 275 time for calcul the mask position with numpy : 0.003222227096557617 nb_pixel_total : 152320 time to create 1 rle with new method : 0.00852203369140625 length of segment : 552 time for calcul the mask position with numpy : 0.002268552780151367 nb_pixel_total : 95011 time to create 1 rle with old method : 0.13636136054992676 length of segment : 365 time for calcul the mask position with numpy : 0.0023894309997558594 nb_pixel_total : 98005 time to create 1 rle with old method : 0.11488652229309082 length of segment : 284 time for calcul the mask position with numpy : 0.006950855255126953 nb_pixel_total : 388845 time to create 1 rle with new method : 0.028107166290283203 length of segment : 770 time for calcul the mask position with numpy : 0.004925966262817383 nb_pixel_total : 148863 time to create 1 rle with old method : 0.16018223762512207 length of segment : 719 time for calcul the mask position with numpy : 0.01695561408996582 nb_pixel_total : 519916 time to create 1 rle with new method : 0.11094856262207031 length of segment : 1909 time for calcul the mask position with numpy : 0.0006110668182373047 nb_pixel_total : 30884 time to create 1 rle with old method : 0.03377175331115723 length of segment : 373 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 22946 time to create 1 rle with old method : 0.026162385940551758 length of segment : 243 time for calcul the mask position with numpy : 0.03120565414428711 nb_pixel_total : 625764 time to create 1 rle with new method : 0.2213144302368164 length of segment : 2353 time for calcul the mask position with numpy : 0.0022346973419189453 nb_pixel_total : 97544 time to create 1 rle with old method : 0.13248467445373535 length of segment : 436 time for calcul the mask position with numpy : 0.0025877952575683594 nb_pixel_total : 110645 time to create 1 rle with old method : 0.1388225555419922 length of segment : 414 time for calcul the mask position with numpy : 0.0013287067413330078 nb_pixel_total : 60598 time to create 1 rle with old method : 0.07268881797790527 length of segment : 253 time for calcul the mask position with numpy : 0.0019195079803466797 nb_pixel_total : 93511 time to create 1 rle with old method : 0.1096487045288086 length of segment : 334 time for calcul the mask position with numpy : 0.004941463470458984 nb_pixel_total : 199801 time to create 1 rle with new method : 0.012231826782226562 length of segment : 463 time for calcul the mask position with numpy : 0.0008864402770996094 nb_pixel_total : 48657 time to create 1 rle with old method : 0.055457115173339844 length of segment : 194 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 280317 time to create 1 rle with new method : 0.03508448600769043 length of segment : 843 time for calcul the mask position with numpy : 0.0011203289031982422 nb_pixel_total : 49487 time to create 1 rle with old method : 0.05598902702331543 length of segment : 217 time for calcul the mask position with numpy : 0.0022344589233398438 nb_pixel_total : 120411 time to create 1 rle with old method : 0.13311386108398438 length of segment : 367 time for calcul the mask position with numpy : 0.004816532135009766 nb_pixel_total : 182424 time to create 1 rle with new method : 0.019417524337768555 length of segment : 400 time for calcul the mask position with numpy : 0.0029892921447753906 nb_pixel_total : 156039 time to create 1 rle with new method : 0.007823705673217773 length of segment : 435 time for calcul the mask position with numpy : 0.0018038749694824219 nb_pixel_total : 78999 time to create 1 rle with old method : 0.09429192543029785 length of segment : 345 time for calcul the mask position with numpy : 0.0014150142669677734 nb_pixel_total : 19202 time to create 1 rle with old method : 0.022634267807006836 length of segment : 339 time for calcul the mask position with numpy : 0.0014965534210205078 nb_pixel_total : 73681 time to create 1 rle with old method : 0.08251953125 length of segment : 422 time for calcul the mask position with numpy : 0.0032248497009277344 nb_pixel_total : 195628 time to create 1 rle with new method : 0.010345220565795898 length of segment : 656 time for calcul the mask position with numpy : 0.0026400089263916016 nb_pixel_total : 141726 time to create 1 rle with old method : 0.1604299545288086 length of segment : 560 time for calcul the mask position with numpy : 0.0033354759216308594 nb_pixel_total : 192531 time to create 1 rle with new method : 0.01441645622253418 length of segment : 661 time for calcul the mask position with numpy : 0.003057718276977539 nb_pixel_total : 122965 time to create 1 rle with old method : 0.13671445846557617 length of segment : 554 time for calcul the mask position with numpy : 0.0019724369049072266 nb_pixel_total : 96494 time to create 1 rle with old method : 0.1279902458190918 length of segment : 326 time for calcul the mask position with numpy : 0.005472660064697266 nb_pixel_total : 160144 time to create 1 rle with new method : 0.019811153411865234 length of segment : 926 time for calcul the mask position with numpy : 0.002901315689086914 nb_pixel_total : 116842 time to create 1 rle with old method : 0.12960338592529297 length of segment : 477 time for calcul the mask position with numpy : 0.002442598342895508 nb_pixel_total : 131539 time to create 1 rle with old method : 0.14654755592346191 length of segment : 457 time for calcul the mask position with numpy : 0.0014805793762207031 nb_pixel_total : 69703 time to create 1 rle with old method : 0.07945990562438965 length of segment : 303 time for calcul the mask position with numpy : 0.0015511512756347656 nb_pixel_total : 72481 time to create 1 rle with old method : 0.08187603950500488 length of segment : 304 time for calcul the mask position with numpy : 0.0025572776794433594 nb_pixel_total : 116751 time to create 1 rle with old method : 0.15433025360107422 length of segment : 337 time for calcul the mask position with numpy : 0.5274019241333008 nb_pixel_total : 4058986 time to create 1 rle with new method : 1.2969577312469482 length of segment : 3308 time for calcul the mask position with numpy : 0.0050470829010009766 nb_pixel_total : 367096 time to create 1 rle with new method : 0.012323141098022461 length of segment : 696 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 27091 time to create 1 rle with old method : 0.03042459487915039 length of segment : 248 time for calcul the mask position with numpy : 0.0008871555328369141 nb_pixel_total : 65818 time to create 1 rle with old method : 0.07493996620178223 length of segment : 316 time for calcul the mask position with numpy : 0.0004999637603759766 nb_pixel_total : 37881 time to create 1 rle with old method : 0.05803561210632324 length of segment : 246 time for calcul the mask position with numpy : 0.0007061958312988281 nb_pixel_total : 61963 time to create 1 rle with old method : 0.0693049430847168 length of segment : 278 time for calcul the mask position with numpy : 0.010986566543579102 nb_pixel_total : 697231 time to create 1 rle with new method : 0.03655076026916504 length of segment : 1175 time for calcul the mask position with numpy : 0.014834880828857422 nb_pixel_total : 329978 time to create 1 rle with new method : 0.32300591468811035 length of segment : 881 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 69803 time to create 1 rle with old method : 0.07952213287353516 length of segment : 455 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 36538 time to create 1 rle with old method : 0.040248870849609375 length of segment : 154 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 25224 time to create 1 rle with old method : 0.02831292152404785 length of segment : 165 time for calcul the mask position with numpy : 0.0012984275817871094 nb_pixel_total : 112789 time to create 1 rle with old method : 0.1258711814880371 length of segment : 177 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 17940 time to create 1 rle with old method : 0.02054619789123535 length of segment : 109 time spent for convertir_results : 73.39384269714355 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 483 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 save missing photos in datou_result : time spend for datou_step_exec : 220.36585974693298 time spend to save output : 0.3506052494049072 total time spend for step 2 : 220.7164649963379 step3:blur_detection Tue Apr 1 07:06:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: variance laplacian (4160, 3120) 2110.8450056297497 (4160, 3120) 1031.6186350648197 (4160, 3120) 636.576680645326 (4160, 3120) 1249.610931132207 (4160, 3120) 3335.8826189881606 (4160, 3120) 2431.3849205165825 (4160, 3120) 1326.6687168376432 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.015757322311401367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.013161897659301758 save missing photos in datou_result : time spend for datou_step_exec : 3.402050256729126 time spend to save output : 0.03398895263671875 total time spend for step 3 : 3.4360392093658447 step4:brightness Tue Apr 1 07:07:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1743483690_3453304_1349041168_7c2f96d51b570a6332bfe24c4d580abe.jpg treat image : temp/1743483690_3453304_1349041164_b571693283997e66e34fa8c6a8f5bd0e.jpg treat image : temp/1743483690_3453304_1349041154_fa17e2774585bda2d8948510aa5c21e5.jpg treat image : temp/1743483690_3453304_1349041147_089f42a410550353a84e74c114ca3730.jpg treat image : temp/1743483690_3453304_1349041131_f6978e549b8ee3456d2c1038855865e9.jpg treat image : temp/1743483690_3453304_1349041117_8f644d2e27e06a8b15acfe33ecb057a7.jpg treat image : temp/1743483690_3453304_1349040967_4d41962d2a312fc840088b9109c67edc.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 7 time used for this insertion : 0.013634443283081055 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 7 time used for this insertion : 0.013830900192260742 save missing photos in datou_result : time spend for datou_step_exec : 13.039434432983398 time spend to save output : 0.032463788986206055 total time spend for step 4 : 13.071898221969604 step5:rle_unique_nms_with_priority Tue Apr 1 07:07:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 483 chid ids of type : 4854 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 81 nb_hashtags : 9 time to prepare the origin masks : 81.6806492805481 time for calcul the mask position with numpy : 0.7047433853149414 nb_pixel_total : 3693587 time to create 1 rle with new method : 2.0407509803771973 time for calcul the mask position with numpy : 0.05137753486633301 nb_pixel_total : 9488 time to create 1 rle with old method : 0.010848283767700195 time for calcul the mask position with numpy : 0.05463862419128418 nb_pixel_total : 68622 time to create 1 rle with old method : 0.07227754592895508 time for calcul the mask position with numpy : 0.05196046829223633 nb_pixel_total : 36379 time to create 1 rle with old method : 0.038928985595703125 time for calcul the mask position with numpy : 0.0567624568939209 nb_pixel_total : 300774 time to create 1 rle with new method : 1.693263292312622 time for calcul the mask position with numpy : 0.055031538009643555 nb_pixel_total : 118116 time to create 1 rle with old method : 0.13083934783935547 time for calcul the mask position with numpy : 0.05425453186035156 nb_pixel_total : 14596 time to create 1 rle with old method : 0.016481876373291016 time for calcul the mask position with numpy : 0.05387282371520996 nb_pixel_total : 7386 time to create 1 rle with old method : 0.00867772102355957 time for calcul the mask position with numpy : 0.05642867088317871 nb_pixel_total : 95810 time to create 1 rle with old method : 0.11410903930664062 time for calcul the mask position with numpy : 0.05979108810424805 nb_pixel_total : 186468 time to create 1 rle with new method : 2.287853956222534 time for calcul the mask position with numpy : 0.054056644439697266 nb_pixel_total : 77777 time to create 1 rle with old method : 0.08344292640686035 time for calcul the mask position with numpy : 0.05245471000671387 nb_pixel_total : 22441 time to create 1 rle with old method : 0.024338722229003906 time for calcul the mask position with numpy : 0.05269622802734375 nb_pixel_total : 160067 time to create 1 rle with new method : 1.656834363937378 time for calcul the mask position with numpy : 0.05447697639465332 nb_pixel_total : 59936 time to create 1 rle with old method : 0.07804656028747559 time for calcul the mask position with numpy : 0.05925893783569336 nb_pixel_total : 164109 time to create 1 rle with new method : 1.50040864944458 time for calcul the mask position with numpy : 0.05440974235534668 nb_pixel_total : 4356 time to create 1 rle with old method : 0.006146669387817383 time for calcul the mask position with numpy : 0.06059622764587402 nb_pixel_total : 77159 time to create 1 rle with old method : 0.08712291717529297 time for calcul the mask position with numpy : 0.05449652671813965 nb_pixel_total : 462 time to create 1 rle with old method : 0.0010373592376708984 time for calcul the mask position with numpy : 0.07733535766601562 nb_pixel_total : 600968 time to create 1 rle with new method : 1.5157105922698975 time for calcul the mask position with numpy : 0.05395340919494629 nb_pixel_total : 24345 time to create 1 rle with old method : 0.02605414390563965 time for calcul the mask position with numpy : 0.05215334892272949 nb_pixel_total : 73245 time to create 1 rle with old method : 0.07917284965515137 time for calcul the mask position with numpy : 0.05215048789978027 nb_pixel_total : 2451 time to create 1 rle with old method : 0.0026569366455078125 time for calcul the mask position with numpy : 0.051680564880371094 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008449077606201172 time for calcul the mask position with numpy : 0.05343341827392578 nb_pixel_total : 134958 time to create 1 rle with old method : 0.15031814575195312 time for calcul the mask position with numpy : 0.054618120193481445 nb_pixel_total : 106684 time to create 1 rle with old method : 0.11392426490783691 time for calcul the mask position with numpy : 0.05469632148742676 nb_pixel_total : 436816 time to create 1 rle with new method : 2.2714149951934814 time for calcul the mask position with numpy : 0.05385446548461914 nb_pixel_total : 22789 time to create 1 rle with old method : 0.025363445281982422 time for calcul the mask position with numpy : 0.057091474533081055 nb_pixel_total : 8585 time to create 1 rle with old method : 0.009856462478637695 time for calcul the mask position with numpy : 0.0541539192199707 nb_pixel_total : 45093 time to create 1 rle with old method : 0.05409383773803711 time for calcul the mask position with numpy : 0.05422806739807129 nb_pixel_total : 187063 time to create 1 rle with new method : 1.9492466449737549 time for calcul the mask position with numpy : 0.05596160888671875 nb_pixel_total : 72745 time to create 1 rle with old method : 0.08390688896179199 time for calcul the mask position with numpy : 0.05698704719543457 nb_pixel_total : 8135 time to create 1 rle with old method : 0.009188175201416016 time for calcul the mask position with numpy : 0.05310225486755371 nb_pixel_total : 47199 time to create 1 rle with old method : 0.05128145217895508 time for calcul the mask position with numpy : 0.05264401435852051 nb_pixel_total : 45652 time to create 1 rle with old method : 0.05150938034057617 time for calcul the mask position with numpy : 0.05304694175720215 nb_pixel_total : 86776 time to create 1 rle with old method : 0.09483885765075684 time for calcul the mask position with numpy : 0.05403900146484375 nb_pixel_total : 16996 time to create 1 rle with old method : 0.018568754196166992 time for calcul the mask position with numpy : 0.05289053916931152 nb_pixel_total : 4573 time to create 1 rle with old method : 0.0053653717041015625 time for calcul the mask position with numpy : 0.059641361236572266 nb_pixel_total : 37777 time to create 1 rle with old method : 0.05422687530517578 time for calcul the mask position with numpy : 0.06139874458312988 nb_pixel_total : 270920 time to create 1 rle with new method : 1.3639633655548096 time for calcul the mask position with numpy : 0.05264139175415039 nb_pixel_total : 520 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.05242633819580078 nb_pixel_total : 72048 time to create 1 rle with old method : 0.0785675048828125 time for calcul the mask position with numpy : 0.052306175231933594 nb_pixel_total : 7285 time to create 1 rle with old method : 0.008417367935180664 time for calcul the mask position with numpy : 0.05293393135070801 nb_pixel_total : 37 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.05305743217468262 nb_pixel_total : 277789 time to create 1 rle with new method : 1.3910202980041504 time for calcul the mask position with numpy : 0.05359625816345215 nb_pixel_total : 144663 time to create 1 rle with old method : 0.15762710571289062 time for calcul the mask position with numpy : 0.05310845375061035 nb_pixel_total : 41725 time to create 1 rle with old method : 0.04488420486450195 time for calcul the mask position with numpy : 0.05291295051574707 nb_pixel_total : 14158 time to create 1 rle with old method : 0.015372514724731445 time for calcul the mask position with numpy : 0.05528092384338379 nb_pixel_total : 337319 time to create 1 rle with new method : 1.4806747436523438 time for calcul the mask position with numpy : 0.05218029022216797 nb_pixel_total : 3408 time to create 1 rle with old method : 0.004186391830444336 time for calcul the mask position with numpy : 0.055112600326538086 nb_pixel_total : 394564 time to create 1 rle with new method : 0.7982470989227295 time for calcul the mask position with numpy : 0.05467343330383301 nb_pixel_total : 32336 time to create 1 rle with old method : 0.035859107971191406 time for calcul the mask position with numpy : 0.05543398857116699 nb_pixel_total : 13315 time to create 1 rle with old method : 0.015680551528930664 time for calcul the mask position with numpy : 0.0538020133972168 nb_pixel_total : 13081 time to create 1 rle with old method : 0.014729022979736328 time for calcul the mask position with numpy : 0.05576014518737793 nb_pixel_total : 345329 time to create 1 rle with new method : 1.0241732597351074 time for calcul the mask position with numpy : 0.06217169761657715 nb_pixel_total : 20665 time to create 1 rle with old method : 0.029432058334350586 time for calcul the mask position with numpy : 0.05432248115539551 nb_pixel_total : 95609 time to create 1 rle with old method : 0.10515475273132324 time for calcul the mask position with numpy : 0.055069684982299805 nb_pixel_total : 36961 time to create 1 rle with old method : 0.041442155838012695 time for calcul the mask position with numpy : 0.05531120300292969 nb_pixel_total : 282438 time to create 1 rle with new method : 1.0861213207244873 time for calcul the mask position with numpy : 0.05464673042297363 nb_pixel_total : 199329 time to create 1 rle with new method : 1.7544357776641846 time for calcul the mask position with numpy : 0.05439281463623047 nb_pixel_total : 88917 time to create 1 rle with old method : 0.09928774833679199 time for calcul the mask position with numpy : 0.06379914283752441 nb_pixel_total : 1116685 time to create 1 rle with new method : 1.4011855125427246 time for calcul the mask position with numpy : 0.05254411697387695 nb_pixel_total : 20104 time to create 1 rle with old method : 0.022473812103271484 time for calcul the mask position with numpy : 0.05208706855773926 nb_pixel_total : 3770 time to create 1 rle with old method : 0.004420280456542969 time for calcul the mask position with numpy : 0.054857730865478516 nb_pixel_total : 226871 time to create 1 rle with new method : 1.529444932937622 time for calcul the mask position with numpy : 0.05203676223754883 nb_pixel_total : 3926 time to create 1 rle with old method : 0.004848003387451172 time for calcul the mask position with numpy : 0.05399966239929199 nb_pixel_total : 138018 time to create 1 rle with old method : 0.14966273307800293 time for calcul the mask position with numpy : 0.052591800689697266 nb_pixel_total : 32314 time to create 1 rle with old method : 0.03443169593811035 time for calcul the mask position with numpy : 0.05222058296203613 nb_pixel_total : 49500 time to create 1 rle with old method : 0.0537562370300293 time for calcul the mask position with numpy : 0.054581403732299805 nb_pixel_total : 227318 time to create 1 rle with new method : 1.4062442779541016 time for calcul the mask position with numpy : 0.05442333221435547 nb_pixel_total : 56628 time to create 1 rle with old method : 0.07828092575073242 time for calcul the mask position with numpy : 0.05476689338684082 nb_pixel_total : 54121 time to create 1 rle with old method : 0.05866742134094238 time for calcul the mask position with numpy : 0.05172848701477051 nb_pixel_total : 8583 time to create 1 rle with old method : 0.010159730911254883 time for calcul the mask position with numpy : 0.05612945556640625 nb_pixel_total : 279380 time to create 1 rle with new method : 1.3157949447631836 time for calcul the mask position with numpy : 0.058876991271972656 nb_pixel_total : 13384 time to create 1 rle with old method : 0.022447824478149414 time for calcul the mask position with numpy : 0.06115317344665527 nb_pixel_total : 590228 time to create 1 rle with new method : 1.804640293121338 time for calcul the mask position with numpy : 0.05232667922973633 nb_pixel_total : 2280 time to create 1 rle with old method : 0.002683877944946289 time for calcul the mask position with numpy : 0.0539243221282959 nb_pixel_total : 4861 time to create 1 rle with old method : 0.005614042282104492 time for calcul the mask position with numpy : 0.05637311935424805 nb_pixel_total : 311746 time to create 1 rle with new method : 1.2588474750518799 time for calcul the mask position with numpy : 0.05345654487609863 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0015447139739990234 time for calcul the mask position with numpy : 0.052799224853515625 nb_pixel_total : 44275 time to create 1 rle with old method : 0.047953128814697266 time for calcul the mask position with numpy : 0.05305886268615723 nb_pixel_total : 19841 time to create 1 rle with old method : 0.021834373474121094 time for calcul the mask position with numpy : 0.053214073181152344 nb_pixel_total : 14030 time to create 1 rle with old method : 0.01523447036743164 create new chi : 41.33434581756592 time to delete rle : 0.03580474853515625 batch 1 Loaded 82 chid ids of type : 4855 Number RLEs to save : 69031 TO DO : save crop sub photo not yet done ! save time : 19.837714672088623 nb_obj : 59 nb_hashtags : 10 time to prepare the origin masks : 59.738162994384766 time for calcul the mask position with numpy : 1.7069742679595947 nb_pixel_total : 3244563 time to create 1 rle with new method : 3.463818311691284 time for calcul the mask position with numpy : 0.05385327339172363 nb_pixel_total : 152188 time to create 1 rle with new method : 2.1102914810180664 time for calcul the mask position with numpy : 0.05813336372375488 nb_pixel_total : 254991 time to create 1 rle with new method : 2.181389093399048 time for calcul the mask position with numpy : 0.05341696739196777 nb_pixel_total : 36941 time to create 1 rle with old method : 0.04163002967834473 time for calcul the mask position with numpy : 0.0552363395690918 nb_pixel_total : 36308 time to create 1 rle with old method : 0.039717674255371094 time for calcul the mask position with numpy : 0.05395627021789551 nb_pixel_total : 58002 time to create 1 rle with old method : 0.06541085243225098 time for calcul the mask position with numpy : 0.05579948425292969 nb_pixel_total : 72112 time to create 1 rle with old method : 0.07991409301757812 time for calcul the mask position with numpy : 0.05325603485107422 nb_pixel_total : 6461 time to create 1 rle with old method : 0.007351875305175781 time for calcul the mask position with numpy : 0.05648350715637207 nb_pixel_total : 394719 time to create 1 rle with new method : 1.4519190788269043 time for calcul the mask position with numpy : 0.053025245666503906 nb_pixel_total : 44418 time to create 1 rle with old method : 0.04889178276062012 time for calcul the mask position with numpy : 0.05305814743041992 nb_pixel_total : 96772 time to create 1 rle with old method : 0.10609006881713867 time for calcul the mask position with numpy : 0.05340981483459473 nb_pixel_total : 2328 time to create 1 rle with old method : 0.0028040409088134766 time for calcul the mask position with numpy : 0.05383801460266113 nb_pixel_total : 26485 time to create 1 rle with old method : 0.029572248458862305 time for calcul the mask position with numpy : 0.05333375930786133 nb_pixel_total : 47839 time to create 1 rle with old method : 0.053310394287109375 time for calcul the mask position with numpy : 0.053736209869384766 nb_pixel_total : 54240 time to create 1 rle with old method : 0.06041717529296875 time for calcul the mask position with numpy : 0.054123878479003906 nb_pixel_total : 147807 time to create 1 rle with old method : 0.1634819507598877 time for calcul the mask position with numpy : 0.05291152000427246 nb_pixel_total : 7956 time to create 1 rle with old method : 0.008989095687866211 time for calcul the mask position with numpy : 0.056627750396728516 nb_pixel_total : 115236 time to create 1 rle with old method : 0.12728500366210938 time for calcul the mask position with numpy : 0.05333709716796875 nb_pixel_total : 25647 time to create 1 rle with old method : 0.028735876083374023 time for calcul the mask position with numpy : 0.05357551574707031 nb_pixel_total : 56446 time to create 1 rle with old method : 0.061888933181762695 time for calcul the mask position with numpy : 0.05804777145385742 nb_pixel_total : 502050 time to create 1 rle with new method : 1.6192631721496582 time for calcul the mask position with numpy : 0.055960893630981445 nb_pixel_total : 3614 time to create 1 rle with old method : 0.004347085952758789 time for calcul the mask position with numpy : 0.05769848823547363 nb_pixel_total : 119206 time to create 1 rle with old method : 0.13629889488220215 time for calcul the mask position with numpy : 0.05554080009460449 nb_pixel_total : 9500 time to create 1 rle with old method : 0.011308908462524414 time for calcul the mask position with numpy : 0.055970191955566406 nb_pixel_total : 17448 time to create 1 rle with old method : 0.021090030670166016 time for calcul the mask position with numpy : 0.06139111518859863 nb_pixel_total : 649493 time to create 1 rle with new method : 1.391033411026001 time for calcul the mask position with numpy : 0.04902815818786621 nb_pixel_total : 42439 time to create 1 rle with old method : 0.04374861717224121 time for calcul the mask position with numpy : 0.0488278865814209 nb_pixel_total : 5665 time to create 1 rle with old method : 0.006372690200805664 time for calcul the mask position with numpy : 0.051019906997680664 nb_pixel_total : 202520 time to create 1 rle with new method : 1.2279949188232422 time for calcul the mask position with numpy : 0.05005908012390137 nb_pixel_total : 2913 time to create 1 rle with old method : 0.003552675247192383 time for calcul the mask position with numpy : 0.05054926872253418 nb_pixel_total : 91869 time to create 1 rle with old method : 0.09592866897583008 time for calcul the mask position with numpy : 0.04912137985229492 nb_pixel_total : 70381 time to create 1 rle with old method : 0.07162618637084961 time for calcul the mask position with numpy : 0.26218438148498535 nb_pixel_total : 2301136 time to create 1 rle with new method : 1.6253819465637207 time for calcul the mask position with numpy : 0.04861640930175781 nb_pixel_total : 25926 time to create 1 rle with old method : 0.026706695556640625 time for calcul the mask position with numpy : 0.048831939697265625 nb_pixel_total : 102422 time to create 1 rle with old method : 0.10415434837341309 time for calcul the mask position with numpy : 0.04964780807495117 nb_pixel_total : 273283 time to create 1 rle with new method : 1.3889579772949219 time for calcul the mask position with numpy : 0.050531864166259766 nb_pixel_total : 128205 time to create 1 rle with old method : 0.1351468563079834 time for calcul the mask position with numpy : 0.052367210388183594 nb_pixel_total : 244513 time to create 1 rle with new method : 1.42006516456604 time for calcul the mask position with numpy : 0.057920217514038086 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.05082345008850098 nb_pixel_total : 33899 time to create 1 rle with old method : 0.03400254249572754 time for calcul the mask position with numpy : 0.0504298210144043 nb_pixel_total : 59896 time to create 1 rle with old method : 0.06131339073181152 time for calcul the mask position with numpy : 0.0490875244140625 nb_pixel_total : 5382 time to create 1 rle with old method : 0.005845785140991211 time for calcul the mask position with numpy : 0.053517818450927734 nb_pixel_total : 156908 time to create 1 rle with new method : 1.5971338748931885 time for calcul the mask position with numpy : 0.051184892654418945 nb_pixel_total : 218658 time to create 1 rle with new method : 1.40606689453125 time for calcul the mask position with numpy : 0.05038881301879883 nb_pixel_total : 15536 time to create 1 rle with old method : 0.016439199447631836 time for calcul the mask position with numpy : 0.0504148006439209 nb_pixel_total : 28046 time to create 1 rle with old method : 0.030771493911743164 time for calcul the mask position with numpy : 0.05937004089355469 nb_pixel_total : 618340 time to create 1 rle with new method : 1.4388031959533691 time for calcul the mask position with numpy : 0.050364017486572266 nb_pixel_total : 5734 time to create 1 rle with old method : 0.0065500736236572266 time for calcul the mask position with numpy : 0.05096721649169922 nb_pixel_total : 66999 time to create 1 rle with old method : 0.0706186294555664 time for calcul the mask position with numpy : 0.05047416687011719 nb_pixel_total : 34185 time to create 1 rle with old method : 0.0387423038482666 time for calcul the mask position with numpy : 0.05013751983642578 nb_pixel_total : 2065 time to create 1 rle with old method : 0.002172231674194336 time for calcul the mask position with numpy : 0.05080866813659668 nb_pixel_total : 49869 time to create 1 rle with old method : 0.051851511001586914 time for calcul the mask position with numpy : 0.053464651107788086 nb_pixel_total : 293862 time to create 1 rle with new method : 1.3416392803192139 time for calcul the mask position with numpy : 0.04993009567260742 nb_pixel_total : 158494 time to create 1 rle with new method : 1.3401131629943848 time for calcul the mask position with numpy : 0.04939675331115723 nb_pixel_total : 46085 time to create 1 rle with old method : 0.04856085777282715 time for calcul the mask position with numpy : 0.23047900199890137 nb_pixel_total : 910529 time to create 1 rle with new method : 1.1210370063781738 time for calcul the mask position with numpy : 0.05331587791442871 nb_pixel_total : 560959 time to create 1 rle with new method : 1.378300666809082 time for calcul the mask position with numpy : 0.048887014389038086 nb_pixel_total : 20276 time to create 1 rle with old method : 0.020598888397216797 time for calcul the mask position with numpy : 0.0485382080078125 nb_pixel_total : 9681 time to create 1 rle with old method : 0.01034235954284668 time for calcul the mask position with numpy : 0.04938387870788574 nb_pixel_total : 9645 time to create 1 rle with old method : 0.009797334671020508 create new chi : 35.404075384140015 time to delete rle : 0.006245851516723633 Catched exception ! Connect or reconnect ! ERROR in datou_step_exec, will save and exit ! Unable to connect to sql.fotonower.com : (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2615, in datou_step_exec return post_process.datou_step_rle_unique_nms_with_priority(param, json_param, args, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_post_processing.py", line 2836, in datou_step_rle_unique_nms_with_priority context.save_crop_hashtag_ids_obj(list_new_chis, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 1625, in save_crop_hashtag_ids_obj return self.DQ.save_crop_hashtag_ids_obj(new_crops_tiles_to_save_as_obj, verbose) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/datou_queries.py", line 1085, in save_crop_hashtag_ids_obj self.gq.insert_many(query, list_values_crop_hashtag_ids) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 154, in insert_many self.connect() File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 46, in connect raise Exception("Unable to connect to " + str(self.host) + " : " + str(e)) [1349041168, 1349041164, 1349041154, 1349041147, 1349041131, 1349041117, 1349040967] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 Catched exception ! Connect or reconnect ! exception in save_final Unable to connect to sql.fotonower.com : (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") query : insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_tup_unique : [('4741', '21916090', '1349041168', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349041164', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349041154', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349041147', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349041131', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349041117', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794'), ('4741', '21916090', '1349040967', '[>, , , , \'Unable to connect to sql.fotonower.com : (2003, "Can\\\'t connect to MySQL server on \\\'sql.fotonower.com:3306\\\' (111)")\']', '-1', '-1.0', '501120777', '1.0', '2709794')] time used for this insertion : 0.01318359375 save_final ERROR in last step rle_unique_nms_with_priority, Unable to connect to sql.fotonower.com : (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") time spend for datou_step_exec : 238.9903016090393 time spend to save output : 0.023586034774780273 total time spend for step 4 : 239.0138876438141 Catched exception ! Connect or reconnect ! Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 144, in insert_many cursor.executemany(query, args[:limit]) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 235, in executemany return self._do_execute_many(q_prefix, q_values, q_postfix, args, File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 264, in _do_execute_many rows += self.execute(sql + postfix) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 209, in execute res = self._query(query) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 315, in _query db.query(q) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 239, in query _mysql.connection.query(self, query) MySQLdb._exceptions.OperationalError: (2013, 'Lost connection to MySQL server during query') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 43, in connect self.db = MySQLdb.connect(host=self.host, db=self.dbname, user=self.user, passwd=self.password) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/__init__.py", line 84, in Connect return Connection(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 179, in __init__ super(Connection, self).__init__(*args, **kwargs2) MySQLdb._exceptions.OperationalError: (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2615, in datou_step_exec return post_process.datou_step_rle_unique_nms_with_priority(param, json_param, args, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_post_processing.py", line 2836, in datou_step_rle_unique_nms_with_priority context.save_crop_hashtag_ids_obj(list_new_chis, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 1625, in save_crop_hashtag_ids_obj return self.DQ.save_crop_hashtag_ids_obj(new_crops_tiles_to_save_as_obj, verbose) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/datou_queries.py", line 1085, in save_crop_hashtag_ids_obj self.gq.insert_many(query, list_values_crop_hashtag_ids) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 154, in insert_many self.connect() File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 46, in connect raise Exception("Unable to connect to " + str(self.host) + " : " + str(e)) Exception: Unable to connect to sql.fotonower.com : (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 100, in insert number = cursor.execute(query, args) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 209, in execute res = self._query(query) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 315, in _query db.query(q) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 239, in query _mysql.connection.query(self, query) MySQLdb._exceptions.OperationalError: (2013, 'Lost connection to MySQL server during query') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 43, in connect self.db = MySQLdb.connect(host=self.host, db=self.dbname, user=self.user, passwd=self.password) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/__init__.py", line 84, in Connect return Connection(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 179, in __init__ super(Connection, self).__init__(*args, **kwargs2) MySQLdb._exceptions.OperationalError: (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") During handling of the above exception, another exception occurred: Traceback (most recent call last): File "prod/datou.py", line 270, in ret = batchDatouCurrent(context, datou_id, mtr_portfolio_ids, list_photo_ids, limit, offset, rand, save, File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 621, in batchDatouCurrent ret = batchDatouExec(context, datou_id, mtr_portfolio_ids, list_photo_ids, list_input_json, limit, File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 819, in batchDatouExec output, datou_failed_to_relaunch = datou_exec(datou, input, cache, context, map_info, save, list_pids, verbose, mtr_user_id, is_last_batch, end_time) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2368, in datou_exec context.update_current_state(map_info["datou_cur_ids"], 0, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 1875, in update_current_state self.DQ.update_current_state(map_info_datou_cur_ids, status, verbose) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/datou_queries.py", line 170, in update_current_state self.gq.insert(query) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 110, in insert self.connect() File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 46, in connect raise Exception("Unable to connect to " + str(self.host) + " : " + str(e)) Exception: Unable to connect to sql.fotonower.com : (2003, "Can't connect to MySQL server on 'sql.fotonower.com:3306' (111)") Command exited with non-zero status 1 276.65user 281.98system 9:49.92elapsed 94%CPU (0avgtext+0avgdata 8516216maxresident)k 3590632inputs+89824outputs (102217major+32814080minor)pagefaults 0swaps