python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4016637 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 19>10 please execute split_portfolio.py -i 20065069 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2529531'] with mtr_portfolio_ids : ['20065069'] and first list_photo_ids : [] new path : /proc/4016637/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.7518484592437744 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 09:34:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 09:34:33.291527: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 09:34:33.319683: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 09:34:33.321744: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3660000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 09:34:33.321801: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 09:34:33.325799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 09:34:33.472241: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x324acbb0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 09:34:33.472290: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 09:34:33.473697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:34:33.474102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:34:33.477268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:34:33.480232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:34:33.480719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:34:33.483451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:34:33.484821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:34:33.489962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:34:33.491404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:34:33.491475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:34:33.492241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 09:34:33.492256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 09:34:33.492265: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 09:34:33.493534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 09:34:33.762659: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:34:33.762794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:34:33.762819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:34:33.762843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:34:33.762865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:34:33.762888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:34:33.762910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:34:33.762932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:34:33.764564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:34:33.765926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 09:34:33.765964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 09:34:33.765983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:34:33.766000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 09:34:33.766016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 09:34:33.766034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 09:34:33.766050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 09:34:33.766067: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 09:34:33.767739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 09:34:33.767780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 09:34:33.767790: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 09:34:33.767801: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 09:34:33.769207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 09:34:41.633092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 09:34:41.828117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 59 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 71 Detection mask done ! Trying to reset tf kernel 4016934 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.0031690597534179688 nb_pixel_total : 112988 time to create 1 rle with old method : 0.12140560150146484 length of segment : 457 time for calcul the mask position with numpy : 0.002146005630493164 nb_pixel_total : 106706 time to create 1 rle with old method : 0.14017224311828613 length of segment : 334 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0013492107391357422 length of segment : 38 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 14445 time to create 1 rle with old method : 0.01582050323486328 length of segment : 121 time for calcul the mask position with numpy : 0.00023293495178222656 nb_pixel_total : 7624 time to create 1 rle with old method : 0.00867462158203125 length of segment : 113 time for calcul the mask position with numpy : 0.00177001953125 nb_pixel_total : 72093 time to create 1 rle with old method : 0.07536625862121582 length of segment : 411 time for calcul the mask position with numpy : 0.002774953842163086 nb_pixel_total : 115767 time to create 1 rle with old method : 0.12519407272338867 length of segment : 472 time for calcul the mask position with numpy : 0.0008749961853027344 nb_pixel_total : 38513 time to create 1 rle with old method : 0.04184079170227051 length of segment : 223 time for calcul the mask position with numpy : 0.00048661231994628906 nb_pixel_total : 21929 time to create 1 rle with old method : 0.025143861770629883 length of segment : 237 time for calcul the mask position with numpy : 0.00026917457580566406 nb_pixel_total : 8139 time to create 1 rle with old method : 0.013179779052734375 length of segment : 129 time for calcul the mask position with numpy : 0.0004591941833496094 nb_pixel_total : 12174 time to create 1 rle with old method : 0.01989459991455078 length of segment : 150 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 4992 time to create 1 rle with old method : 0.005651712417602539 length of segment : 89 time for calcul the mask position with numpy : 0.001760244369506836 nb_pixel_total : 99253 time to create 1 rle with old method : 0.10254669189453125 length of segment : 622 time for calcul the mask position with numpy : 0.002005338668823242 nb_pixel_total : 71174 time to create 1 rle with old method : 0.09559178352355957 length of segment : 570 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 24177 time to create 1 rle with old method : 0.025346755981445312 length of segment : 158 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 1185 time to create 1 rle with old method : 0.00130462646484375 length of segment : 51 time for calcul the mask position with numpy : 0.0003676414489746094 nb_pixel_total : 14794 time to create 1 rle with old method : 0.015595197677612305 length of segment : 111 time for calcul the mask position with numpy : 0.0002143383026123047 nb_pixel_total : 5588 time to create 1 rle with old method : 0.005728960037231445 length of segment : 100 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 16159 time to create 1 rle with old method : 0.016966819763183594 length of segment : 126 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 2526 time to create 1 rle with old method : 0.0028014183044433594 length of segment : 66 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 12276 time to create 1 rle with old method : 0.013566255569458008 length of segment : 85 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006351470947265625 length of segment : 28 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1265 time to create 1 rle with old method : 0.00145721435546875 length of segment : 46 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 5624 time to create 1 rle with old method : 0.00606083869934082 length of segment : 116 time for calcul the mask position with numpy : 0.00018143653869628906 nb_pixel_total : 1650 time to create 1 rle with old method : 0.0019576549530029297 length of segment : 60 time for calcul the mask position with numpy : 0.0002491474151611328 nb_pixel_total : 7545 time to create 1 rle with old method : 0.007864952087402344 length of segment : 127 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 4920 time to create 1 rle with old method : 0.005093812942504883 length of segment : 70 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 1711 time to create 1 rle with old method : 0.001829385757446289 length of segment : 52 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 2143 time to create 1 rle with old method : 0.0022573471069335938 length of segment : 56 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 2949 time to create 1 rle with old method : 0.0030791759490966797 length of segment : 95 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 12387 time to create 1 rle with old method : 0.012094497680664062 length of segment : 210 time for calcul the mask position with numpy : 0.00031638145446777344 nb_pixel_total : 12439 time to create 1 rle with old method : 0.012851476669311523 length of segment : 127 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007548332214355469 length of segment : 37 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 2451 time to create 1 rle with old method : 0.00255584716796875 length of segment : 70 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 3910 time to create 1 rle with old method : 0.004386425018310547 length of segment : 61 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 3465 time to create 1 rle with old method : 0.0036613941192626953 length of segment : 78 time for calcul the mask position with numpy : 0.0006694793701171875 nb_pixel_total : 26149 time to create 1 rle with old method : 0.026762008666992188 length of segment : 175 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 3940 time to create 1 rle with old method : 0.0042111873626708984 length of segment : 70 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0015392303466796875 length of segment : 72 time for calcul the mask position with numpy : 0.0004813671112060547 nb_pixel_total : 18554 time to create 1 rle with old method : 0.01877284049987793 length of segment : 151 time for calcul the mask position with numpy : 0.001970052719116211 nb_pixel_total : 99136 time to create 1 rle with old method : 0.0987091064453125 length of segment : 398 time for calcul the mask position with numpy : 0.002327442169189453 nb_pixel_total : 87539 time to create 1 rle with old method : 0.08723902702331543 length of segment : 384 time for calcul the mask position with numpy : 0.0024852752685546875 nb_pixel_total : 91420 time to create 1 rle with old method : 0.09225153923034668 length of segment : 428 time for calcul the mask position with numpy : 0.0025281906127929688 nb_pixel_total : 113240 time to create 1 rle with old method : 0.11431884765625 length of segment : 529 time for calcul the mask position with numpy : 0.0018739700317382812 nb_pixel_total : 78619 time to create 1 rle with old method : 0.08032369613647461 length of segment : 422 time for calcul the mask position with numpy : 0.0019834041595458984 nb_pixel_total : 96794 time to create 1 rle with old method : 0.09585452079772949 length of segment : 397 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0011909008026123047 length of segment : 46 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 17157 time to create 1 rle with old method : 0.017969846725463867 length of segment : 122 time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 9352 time to create 1 rle with old method : 0.009790658950805664 length of segment : 103 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 2131 time to create 1 rle with old method : 0.0023877620697021484 length of segment : 40 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 6491 time to create 1 rle with old method : 0.006654500961303711 length of segment : 142 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 2844 time to create 1 rle with old method : 0.0031795501708984375 length of segment : 63 time for calcul the mask position with numpy : 0.0006296634674072266 nb_pixel_total : 23499 time to create 1 rle with old method : 0.024626731872558594 length of segment : 100 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.00048661231994628906 length of segment : 19 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 4410 time to create 1 rle with old method : 0.004656314849853516 length of segment : 70 time for calcul the mask position with numpy : 0.0002913475036621094 nb_pixel_total : 9121 time to create 1 rle with old method : 0.009364604949951172 length of segment : 117 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 9347 time to create 1 rle with old method : 0.009801626205444336 length of segment : 124 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 10156 time to create 1 rle with old method : 0.010495424270629883 length of segment : 138 time for calcul the mask position with numpy : 0.0003204345703125 nb_pixel_total : 8058 time to create 1 rle with old method : 0.008238077163696289 length of segment : 166 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 4237 time to create 1 rle with old method : 0.004413127899169922 length of segment : 80 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0015270709991455078 length of segment : 52 time for calcul the mask position with numpy : 0.00020742416381835938 nb_pixel_total : 8179 time to create 1 rle with old method : 0.008103609085083008 length of segment : 124 time for calcul the mask position with numpy : 0.000579833984375 nb_pixel_total : 20781 time to create 1 rle with old method : 0.021547317504882812 length of segment : 133 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2001 time to create 1 rle with old method : 0.002028942108154297 length of segment : 108 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 4281 time to create 1 rle with old method : 0.004374504089355469 length of segment : 93 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 4230 time to create 1 rle with old method : 0.0043070316314697266 length of segment : 147 time for calcul the mask position with numpy : 0.00039005279541015625 nb_pixel_total : 14761 time to create 1 rle with old method : 0.014620542526245117 length of segment : 203 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 1440 time to create 1 rle with old method : 0.0015668869018554688 length of segment : 46 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1695 time to create 1 rle with old method : 0.0018763542175292969 length of segment : 42 time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 2790 time to create 1 rle with old method : 0.0030260086059570312 length of segment : 45 time for calcul the mask position with numpy : 0.00020122528076171875 nb_pixel_total : 6917 time to create 1 rle with old method : 0.011451244354248047 length of segment : 96 time for calcul the mask position with numpy : 0.00014400482177734375 nb_pixel_total : 2338 time to create 1 rle with old method : 0.0024230480194091797 length of segment : 104 time for calcul the mask position with numpy : 0.004975318908691406 nb_pixel_total : 97375 time to create 1 rle with old method : 0.09521174430847168 length of segment : 366 time for calcul the mask position with numpy : 0.004975080490112305 nb_pixel_total : 104836 time to create 1 rle with old method : 0.10907125473022461 length of segment : 440 time for calcul the mask position with numpy : 0.001626729965209961 nb_pixel_total : 23429 time to create 1 rle with old method : 0.025071144104003906 length of segment : 262 time for calcul the mask position with numpy : 0.003949642181396484 nb_pixel_total : 100175 time to create 1 rle with old method : 0.10870504379272461 length of segment : 387 time for calcul the mask position with numpy : 0.004021644592285156 nb_pixel_total : 96297 time to create 1 rle with old method : 0.10728263854980469 length of segment : 477 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 11516 time to create 1 rle with old method : 0.012778520584106445 length of segment : 104 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 5283 time to create 1 rle with old method : 0.0062181949615478516 length of segment : 67 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 1552 time to create 1 rle with old method : 0.0017290115356445312 length of segment : 51 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 14562 time to create 1 rle with old method : 0.01600503921508789 length of segment : 128 time for calcul the mask position with numpy : 0.00410151481628418 nb_pixel_total : 84310 time to create 1 rle with old method : 0.08999228477478027 length of segment : 352 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 4485 time to create 1 rle with old method : 0.005292177200317383 length of segment : 45 time for calcul the mask position with numpy : 0.00440669059753418 nb_pixel_total : 104961 time to create 1 rle with old method : 0.11469197273254395 length of segment : 471 time for calcul the mask position with numpy : 0.0013768672943115234 nb_pixel_total : 31660 time to create 1 rle with old method : 0.03487968444824219 length of segment : 188 time for calcul the mask position with numpy : 0.0005779266357421875 nb_pixel_total : 9082 time to create 1 rle with old method : 0.010693550109863281 length of segment : 104 time for calcul the mask position with numpy : 0.0012633800506591797 nb_pixel_total : 14539 time to create 1 rle with old method : 0.016821861267089844 length of segment : 203 time for calcul the mask position with numpy : 0.0010509490966796875 nb_pixel_total : 14866 time to create 1 rle with old method : 0.016431808471679688 length of segment : 161 time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 4712 time to create 1 rle with old method : 0.005478620529174805 length of segment : 68 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 9219 time to create 1 rle with old method : 0.009877443313598633 length of segment : 234 time for calcul the mask position with numpy : 0.0011794567108154297 nb_pixel_total : 25612 time to create 1 rle with old method : 0.027019023895263672 length of segment : 203 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 2711 time to create 1 rle with old method : 0.003221273422241211 length of segment : 87 time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 10763 time to create 1 rle with old method : 0.011386632919311523 length of segment : 128 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 10124 time to create 1 rle with old method : 0.01052713394165039 length of segment : 252 time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 5914 time to create 1 rle with old method : 0.00677943229675293 length of segment : 106 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 2323 time to create 1 rle with old method : 0.0025634765625 length of segment : 66 time for calcul the mask position with numpy : 0.003384828567504883 nb_pixel_total : 17443 time to create 1 rle with old method : 0.018970966339111328 length of segment : 163 time for calcul the mask position with numpy : 0.0005338191986083984 nb_pixel_total : 5383 time to create 1 rle with old method : 0.005998849868774414 length of segment : 162 time for calcul the mask position with numpy : 0.0014123916625976562 nb_pixel_total : 30302 time to create 1 rle with old method : 0.033360958099365234 length of segment : 213 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 5991 time to create 1 rle with old method : 0.0067713260650634766 length of segment : 95 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 706 time to create 1 rle with old method : 0.0007703304290771484 length of segment : 42 time for calcul the mask position with numpy : 0.000576019287109375 nb_pixel_total : 9226 time to create 1 rle with old method : 0.009775876998901367 length of segment : 127 time for calcul the mask position with numpy : 0.0004367828369140625 nb_pixel_total : 6631 time to create 1 rle with old method : 0.0070569515228271484 length of segment : 98 time for calcul the mask position with numpy : 0.0004439353942871094 nb_pixel_total : 4967 time to create 1 rle with old method : 0.0056340694427490234 length of segment : 137 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 4986 time to create 1 rle with old method : 0.0052947998046875 length of segment : 93 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 6831 time to create 1 rle with old method : 0.007361650466918945 length of segment : 136 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 4688 time to create 1 rle with old method : 0.005292654037475586 length of segment : 67 time for calcul the mask position with numpy : 0.0012030601501464844 nb_pixel_total : 16069 time to create 1 rle with old method : 0.01723003387451172 length of segment : 200 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 9784 time to create 1 rle with old method : 0.01631021499633789 length of segment : 124 time for calcul the mask position with numpy : 0.005917787551879883 nb_pixel_total : 113256 time to create 1 rle with old method : 0.12531590461730957 length of segment : 398 time for calcul the mask position with numpy : 0.0032906532287597656 nb_pixel_total : 110262 time to create 1 rle with old method : 0.11573028564453125 length of segment : 393 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 1246 time to create 1 rle with old method : 0.0013613700866699219 length of segment : 50 time for calcul the mask position with numpy : 0.0034132003784179688 nb_pixel_total : 79972 time to create 1 rle with old method : 0.08940315246582031 length of segment : 433 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 6217 time to create 1 rle with old method : 0.0071332454681396484 length of segment : 108 time for calcul the mask position with numpy : 0.004255771636962891 nb_pixel_total : 99247 time to create 1 rle with old method : 0.10082030296325684 length of segment : 514 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 3841 time to create 1 rle with old method : 0.004271268844604492 length of segment : 63 time for calcul the mask position with numpy : 0.003449678421020508 nb_pixel_total : 92611 time to create 1 rle with old method : 0.0952310562133789 length of segment : 526 time for calcul the mask position with numpy : 0.0006749629974365234 nb_pixel_total : 10361 time to create 1 rle with old method : 0.010830163955688477 length of segment : 225 time for calcul the mask position with numpy : 0.0034215450286865234 nb_pixel_total : 88658 time to create 1 rle with old method : 0.09184932708740234 length of segment : 413 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 7814 time to create 1 rle with old method : 0.00835418701171875 length of segment : 93 time for calcul the mask position with numpy : 0.0015158653259277344 nb_pixel_total : 18082 time to create 1 rle with old method : 0.01925182342529297 length of segment : 375 time for calcul the mask position with numpy : 0.0008654594421386719 nb_pixel_total : 19327 time to create 1 rle with old method : 0.01995682716369629 length of segment : 135 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 6151 time to create 1 rle with old method : 0.006382465362548828 length of segment : 76 time for calcul the mask position with numpy : 0.0013206005096435547 nb_pixel_total : 21372 time to create 1 rle with old method : 0.021998882293701172 length of segment : 160 time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 15018 time to create 1 rle with old method : 0.015722990036010742 length of segment : 164 time for calcul the mask position with numpy : 0.0010018348693847656 nb_pixel_total : 18120 time to create 1 rle with old method : 0.01916337013244629 length of segment : 193 time for calcul the mask position with numpy : 0.0007452964782714844 nb_pixel_total : 10107 time to create 1 rle with old method : 0.011225461959838867 length of segment : 247 time for calcul the mask position with numpy : 0.0004229545593261719 nb_pixel_total : 6885 time to create 1 rle with old method : 0.007956504821777344 length of segment : 75 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 4525 time to create 1 rle with old method : 0.0052623748779296875 length of segment : 71 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 3190 time to create 1 rle with old method : 0.0033991336822509766 length of segment : 69 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 2772 time to create 1 rle with old method : 0.0029091835021972656 length of segment : 73 time for calcul the mask position with numpy : 0.0004761219024658203 nb_pixel_total : 7284 time to create 1 rle with old method : 0.008059501647949219 length of segment : 113 time for calcul the mask position with numpy : 0.0002791881561279297 nb_pixel_total : 3531 time to create 1 rle with old method : 0.003973484039306641 length of segment : 53 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 9995 time to create 1 rle with old method : 0.010518074035644531 length of segment : 99 time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 6646 time to create 1 rle with old method : 0.0069773197174072266 length of segment : 98 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 18469 time to create 1 rle with old method : 0.018918991088867188 length of segment : 191 time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 6547 time to create 1 rle with old method : 0.0074803829193115234 length of segment : 115 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 16465 time to create 1 rle with old method : 0.017755746841430664 length of segment : 178 time for calcul the mask position with numpy : 0.0005228519439697266 nb_pixel_total : 16651 time to create 1 rle with old method : 0.017169713973999023 length of segment : 148 time for calcul the mask position with numpy : 0.0002582073211669922 nb_pixel_total : 3862 time to create 1 rle with old method : 0.004269838333129883 length of segment : 138 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0014410018920898438 length of segment : 44 time for calcul the mask position with numpy : 0.00017499923706054688 nb_pixel_total : 920 time to create 1 rle with old method : 0.0010178089141845703 length of segment : 53 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 1978 time to create 1 rle with old method : 0.0023453235626220703 length of segment : 52 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007047653198242188 length of segment : 23 time for calcul the mask position with numpy : 0.0034160614013671875 nb_pixel_total : 75465 time to create 1 rle with old method : 0.07918143272399902 length of segment : 364 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0015423297882080078 length of segment : 58 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 8099 time to create 1 rle with old method : 0.00820016860961914 length of segment : 103 time for calcul the mask position with numpy : 0.0041370391845703125 nb_pixel_total : 100745 time to create 1 rle with old method : 0.10526585578918457 length of segment : 458 time for calcul the mask position with numpy : 0.003481626510620117 nb_pixel_total : 95861 time to create 1 rle with old method : 0.0990438461303711 length of segment : 486 time for calcul the mask position with numpy : 0.00372314453125 nb_pixel_total : 96175 time to create 1 rle with old method : 0.09793758392333984 length of segment : 465 time for calcul the mask position with numpy : 0.004174947738647461 nb_pixel_total : 116600 time to create 1 rle with old method : 0.12098860740661621 length of segment : 414 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 25784 time to create 1 rle with old method : 0.027530193328857422 length of segment : 220 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 22580 time to create 1 rle with old method : 0.02430582046508789 length of segment : 176 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 8612 time to create 1 rle with old method : 0.009227514266967773 length of segment : 105 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0016469955444335938 length of segment : 47 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 7629 time to create 1 rle with old method : 0.008448123931884766 length of segment : 104 time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 9281 time to create 1 rle with old method : 0.010504007339477539 length of segment : 80 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 5262 time to create 1 rle with old method : 0.005977153778076172 length of segment : 75 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 16195 time to create 1 rle with old method : 0.01818227767944336 length of segment : 147 time for calcul the mask position with numpy : 0.0005600452423095703 nb_pixel_total : 11744 time to create 1 rle with old method : 0.013157129287719727 length of segment : 140 time for calcul the mask position with numpy : 0.0003178119659423828 nb_pixel_total : 4691 time to create 1 rle with old method : 0.005087375640869141 length of segment : 78 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 7484 time to create 1 rle with old method : 0.008178472518920898 length of segment : 111 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 11137 time to create 1 rle with old method : 0.011911630630493164 length of segment : 120 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 12869 time to create 1 rle with old method : 0.013455629348754883 length of segment : 218 time for calcul the mask position with numpy : 0.0024700164794921875 nb_pixel_total : 85886 time to create 1 rle with old method : 0.08736491203308105 length of segment : 580 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 10130 time to create 1 rle with old method : 0.010299444198608398 length of segment : 142 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 3052 time to create 1 rle with old method : 0.003419637680053711 length of segment : 64 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 5680 time to create 1 rle with old method : 0.0064356327056884766 length of segment : 139 time for calcul the mask position with numpy : 0.0017380714416503906 nb_pixel_total : 32381 time to create 1 rle with old method : 0.03451085090637207 length of segment : 450 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 5307 time to create 1 rle with old method : 0.00608062744140625 length of segment : 121 time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 7380 time to create 1 rle with old method : 0.0076100826263427734 length of segment : 159 time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 14186 time to create 1 rle with old method : 0.014837503433227539 length of segment : 186 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 2944 time to create 1 rle with old method : 0.003281831741333008 length of segment : 65 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 2690 time to create 1 rle with old method : 0.003176450729370117 length of segment : 60 time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 7705 time to create 1 rle with old method : 0.00807642936706543 length of segment : 179 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005471706390380859 length of segment : 30 time for calcul the mask position with numpy : 0.004144430160522461 nb_pixel_total : 104771 time to create 1 rle with old method : 0.13621926307678223 length of segment : 385 time for calcul the mask position with numpy : 0.003429889678955078 nb_pixel_total : 78990 time to create 1 rle with old method : 0.08189201354980469 length of segment : 395 time for calcul the mask position with numpy : 0.003099203109741211 nb_pixel_total : 86803 time to create 1 rle with old method : 0.08826875686645508 length of segment : 341 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 725 time to create 1 rle with old method : 0.0009870529174804688 length of segment : 32 time for calcul the mask position with numpy : 0.003353595733642578 nb_pixel_total : 98394 time to create 1 rle with old method : 0.10471224784851074 length of segment : 440 time for calcul the mask position with numpy : 0.004056215286254883 nb_pixel_total : 85629 time to create 1 rle with old method : 0.08747410774230957 length of segment : 675 time for calcul the mask position with numpy : 0.0011169910430908203 nb_pixel_total : 25461 time to create 1 rle with old method : 0.03793525695800781 length of segment : 187 time for calcul the mask position with numpy : 0.0024280548095703125 nb_pixel_total : 92108 time to create 1 rle with old method : 0.09818172454833984 length of segment : 424 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0014684200286865234 length of segment : 46 time for calcul the mask position with numpy : 0.0004756450653076172 nb_pixel_total : 9135 time to create 1 rle with old method : 0.009426116943359375 length of segment : 120 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 5967 time to create 1 rle with old method : 0.00679326057434082 length of segment : 105 time for calcul the mask position with numpy : 0.00023984909057617188 nb_pixel_total : 5196 time to create 1 rle with old method : 0.005368947982788086 length of segment : 100 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 4355 time to create 1 rle with old method : 0.0046651363372802734 length of segment : 82 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 6703 time to create 1 rle with old method : 0.00740504264831543 length of segment : 137 time for calcul the mask position with numpy : 0.00035381317138671875 nb_pixel_total : 4154 time to create 1 rle with old method : 0.004404544830322266 length of segment : 100 time for calcul the mask position with numpy : 0.0006620883941650391 nb_pixel_total : 12779 time to create 1 rle with old method : 0.014570474624633789 length of segment : 110 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 11198 time to create 1 rle with old method : 0.012779951095581055 length of segment : 118 time for calcul the mask position with numpy : 0.0008096694946289062 nb_pixel_total : 16037 time to create 1 rle with old method : 0.017322301864624023 length of segment : 135 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 25511 time to create 1 rle with old method : 0.026932239532470703 length of segment : 248 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 3578 time to create 1 rle with old method : 0.004007101058959961 length of segment : 75 time for calcul the mask position with numpy : 0.0005669593811035156 nb_pixel_total : 5981 time to create 1 rle with old method : 0.006723880767822266 length of segment : 179 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 10103 time to create 1 rle with old method : 0.010465383529663086 length of segment : 115 time for calcul the mask position with numpy : 0.0008661746978759766 nb_pixel_total : 21083 time to create 1 rle with old method : 0.022437095642089844 length of segment : 129 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0025658607482910156 length of segment : 36 time for calcul the mask position with numpy : 0.0005288124084472656 nb_pixel_total : 9054 time to create 1 rle with old method : 0.009900808334350586 length of segment : 124 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 5726 time to create 1 rle with old method : 0.00639796257019043 length of segment : 152 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 5906 time to create 1 rle with old method : 0.006643772125244141 length of segment : 78 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 4956 time to create 1 rle with old method : 0.005481243133544922 length of segment : 74 time for calcul the mask position with numpy : 0.0004253387451171875 nb_pixel_total : 15443 time to create 1 rle with old method : 0.017953157424926758 length of segment : 119 time for calcul the mask position with numpy : 0.0002815723419189453 nb_pixel_total : 3154 time to create 1 rle with old method : 0.003545522689819336 length of segment : 80 time for calcul the mask position with numpy : 0.0034627914428710938 nb_pixel_total : 73622 time to create 1 rle with old method : 0.07727718353271484 length of segment : 383 time for calcul the mask position with numpy : 0.00409388542175293 nb_pixel_total : 98997 time to create 1 rle with old method : 0.10510873794555664 length of segment : 388 time for calcul the mask position with numpy : 0.004066944122314453 nb_pixel_total : 90011 time to create 1 rle with old method : 0.09736013412475586 length of segment : 367 time for calcul the mask position with numpy : 0.00491786003112793 nb_pixel_total : 120751 time to create 1 rle with old method : 0.13425040245056152 length of segment : 429 time for calcul the mask position with numpy : 0.003926753997802734 nb_pixel_total : 86678 time to create 1 rle with old method : 0.09295511245727539 length of segment : 477 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0015575885772705078 length of segment : 42 time for calcul the mask position with numpy : 0.0005588531494140625 nb_pixel_total : 6325 time to create 1 rle with old method : 0.00700688362121582 length of segment : 141 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2859 time to create 1 rle with old method : 0.003225564956665039 length of segment : 69 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011055469512939453 length of segment : 53 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 6523 time to create 1 rle with old method : 0.007170200347900391 length of segment : 126 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 12590 time to create 1 rle with old method : 0.013576745986938477 length of segment : 138 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 9139 time to create 1 rle with old method : 0.009899139404296875 length of segment : 126 time for calcul the mask position with numpy : 0.00023818016052246094 nb_pixel_total : 4614 time to create 1 rle with old method : 0.005244255065917969 length of segment : 74 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 6772 time to create 1 rle with old method : 0.00733637809753418 length of segment : 112 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 7909 time to create 1 rle with old method : 0.008686542510986328 length of segment : 91 time for calcul the mask position with numpy : 0.0003764629364013672 nb_pixel_total : 4531 time to create 1 rle with old method : 0.0052225589752197266 length of segment : 93 time for calcul the mask position with numpy : 0.0013833045959472656 nb_pixel_total : 23284 time to create 1 rle with old method : 0.02403092384338379 length of segment : 407 time for calcul the mask position with numpy : 0.0009348392486572266 nb_pixel_total : 14255 time to create 1 rle with old method : 0.015023946762084961 length of segment : 179 time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 12843 time to create 1 rle with old method : 0.013814210891723633 length of segment : 143 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 6999 time to create 1 rle with old method : 0.007621049880981445 length of segment : 161 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 6569 time to create 1 rle with old method : 0.0071642398834228516 length of segment : 158 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 5714 time to create 1 rle with old method : 0.006380319595336914 length of segment : 81 time for calcul the mask position with numpy : 0.0003457069396972656 nb_pixel_total : 3989 time to create 1 rle with old method : 0.0045604705810546875 length of segment : 109 time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 49742 time to create 1 rle with old method : 0.051149845123291016 length of segment : 392 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 16636 time to create 1 rle with old method : 0.01877737045288086 length of segment : 116 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 4900 time to create 1 rle with old method : 0.0057179927825927734 length of segment : 118 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 6296 time to create 1 rle with old method : 0.00682520866394043 length of segment : 91 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 14465 time to create 1 rle with old method : 0.01490640640258789 length of segment : 155 time for calcul the mask position with numpy : 0.003320455551147461 nb_pixel_total : 84146 time to create 1 rle with old method : 0.09163427352905273 length of segment : 367 time for calcul the mask position with numpy : 0.003798246383666992 nb_pixel_total : 97843 time to create 1 rle with old method : 0.102691650390625 length of segment : 374 time for calcul the mask position with numpy : 0.0038034915924072266 nb_pixel_total : 126266 time to create 1 rle with old method : 0.13238191604614258 length of segment : 416 time for calcul the mask position with numpy : 0.0006468296051025391 nb_pixel_total : 10908 time to create 1 rle with old method : 0.011691570281982422 length of segment : 124 time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 16513 time to create 1 rle with old method : 0.017902374267578125 length of segment : 137 time for calcul the mask position with numpy : 0.003491640090942383 nb_pixel_total : 84833 time to create 1 rle with old method : 0.09045124053955078 length of segment : 419 time for calcul the mask position with numpy : 0.0008232593536376953 nb_pixel_total : 13880 time to create 1 rle with old method : 0.015658140182495117 length of segment : 124 time for calcul the mask position with numpy : 0.003228425979614258 nb_pixel_total : 84871 time to create 1 rle with old method : 0.09312963485717773 length of segment : 450 time for calcul the mask position with numpy : 0.0004856586456298828 nb_pixel_total : 10888 time to create 1 rle with old method : 0.011800289154052734 length of segment : 110 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 8259 time to create 1 rle with old method : 0.008642196655273438 length of segment : 125 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 6059 time to create 1 rle with old method : 0.006273508071899414 length of segment : 95 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 5557 time to create 1 rle with old method : 0.005949258804321289 length of segment : 147 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 4174 time to create 1 rle with old method : 0.004593610763549805 length of segment : 90 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 6316 time to create 1 rle with old method : 0.00645899772644043 length of segment : 144 time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 7097 time to create 1 rle with old method : 0.0076732635498046875 length of segment : 227 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 3746 time to create 1 rle with old method : 0.004161834716796875 length of segment : 92 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 832 time to create 1 rle with old method : 0.0010783672332763672 length of segment : 34 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 3631 time to create 1 rle with old method : 0.004027843475341797 length of segment : 109 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008442401885986328 length of segment : 30 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 6852 time to create 1 rle with old method : 0.00740504264831543 length of segment : 74 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 5954 time to create 1 rle with old method : 0.006437778472900391 length of segment : 91 time for calcul the mask position with numpy : 0.0005536079406738281 nb_pixel_total : 10799 time to create 1 rle with old method : 0.011462926864624023 length of segment : 93 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 14356 time to create 1 rle with old method : 0.015412569046020508 length of segment : 89 time for calcul the mask position with numpy : 0.00040721893310546875 nb_pixel_total : 7493 time to create 1 rle with old method : 0.008493900299072266 length of segment : 124 time for calcul the mask position with numpy : 0.003632068634033203 nb_pixel_total : 86549 time to create 1 rle with old method : 0.12229442596435547 length of segment : 382 time for calcul the mask position with numpy : 0.0036537647247314453 nb_pixel_total : 102056 time to create 1 rle with old method : 0.10859084129333496 length of segment : 421 time for calcul the mask position with numpy : 0.006109952926635742 nb_pixel_total : 155713 time to create 1 rle with new method : 0.008201837539672852 length of segment : 583 time for calcul the mask position with numpy : 0.003832101821899414 nb_pixel_total : 109378 time to create 1 rle with old method : 0.11862850189208984 length of segment : 610 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 6738 time to create 1 rle with old method : 0.007523298263549805 length of segment : 102 time for calcul the mask position with numpy : 0.0008223056793212891 nb_pixel_total : 14935 time to create 1 rle with old method : 0.020010948181152344 length of segment : 139 time for calcul the mask position with numpy : 0.0037348270416259766 nb_pixel_total : 99179 time to create 1 rle with old method : 0.10196948051452637 length of segment : 464 time for calcul the mask position with numpy : 0.0007832050323486328 nb_pixel_total : 10487 time to create 1 rle with old method : 0.01721334457397461 length of segment : 175 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 2591 time to create 1 rle with old method : 0.004610776901245117 length of segment : 60 time for calcul the mask position with numpy : 0.00015687942504882812 nb_pixel_total : 1457 time to create 1 rle with old method : 0.002561807632446289 length of segment : 38 time for calcul the mask position with numpy : 0.0004634857177734375 nb_pixel_total : 3660 time to create 1 rle with old method : 0.005746603012084961 length of segment : 109 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 7080 time to create 1 rle with old method : 0.007741212844848633 length of segment : 74 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004775524139404297 length of segment : 17 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 7767 time to create 1 rle with old method : 0.008359432220458984 length of segment : 187 time for calcul the mask position with numpy : 0.00039887428283691406 nb_pixel_total : 9588 time to create 1 rle with old method : 0.010120153427124023 length of segment : 85 time for calcul the mask position with numpy : 0.0012204647064208984 nb_pixel_total : 27358 time to create 1 rle with old method : 0.03007674217224121 length of segment : 284 time for calcul the mask position with numpy : 0.0007014274597167969 nb_pixel_total : 34796 time to create 1 rle with old method : 0.035634517669677734 length of segment : 336 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 7079 time to create 1 rle with old method : 0.007904529571533203 length of segment : 118 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 930 time to create 1 rle with old method : 0.0010995864868164062 length of segment : 44 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1149 time to create 1 rle with old method : 0.0012438297271728516 length of segment : 65 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 14608 time to create 1 rle with old method : 0.015527009963989258 length of segment : 157 time for calcul the mask position with numpy : 0.00028967857360839844 nb_pixel_total : 7344 time to create 1 rle with old method : 0.008118867874145508 length of segment : 147 time for calcul the mask position with numpy : 0.0034253597259521484 nb_pixel_total : 78636 time to create 1 rle with old method : 0.08696103096008301 length of segment : 514 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 5818 time to create 1 rle with old method : 0.006271839141845703 length of segment : 96 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 10766 time to create 1 rle with old method : 0.011430740356445312 length of segment : 137 time for calcul the mask position with numpy : 0.0006725788116455078 nb_pixel_total : 13732 time to create 1 rle with old method : 0.013634443283081055 length of segment : 192 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 8423 time to create 1 rle with old method : 0.00929570198059082 length of segment : 121 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 4819 time to create 1 rle with old method : 0.005254030227661133 length of segment : 61 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 4139 time to create 1 rle with old method : 0.004622936248779297 length of segment : 58 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 3378 time to create 1 rle with old method : 0.003646373748779297 length of segment : 97 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 4715 time to create 1 rle with old method : 0.0052967071533203125 length of segment : 56 time for calcul the mask position with numpy : 0.0003178119659423828 nb_pixel_total : 4209 time to create 1 rle with old method : 0.004750490188598633 length of segment : 104 time for calcul the mask position with numpy : 0.004427671432495117 nb_pixel_total : 103830 time to create 1 rle with old method : 0.11202836036682129 length of segment : 396 time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 12598 time to create 1 rle with old method : 0.013437509536743164 length of segment : 126 time for calcul the mask position with numpy : 0.00467228889465332 nb_pixel_total : 99812 time to create 1 rle with old method : 0.10216569900512695 length of segment : 556 time for calcul the mask position with numpy : 0.0072329044342041016 nb_pixel_total : 167876 time to create 1 rle with new method : 0.007663726806640625 length of segment : 616 time for calcul the mask position with numpy : 0.004504680633544922 nb_pixel_total : 91467 time to create 1 rle with old method : 0.09999418258666992 length of segment : 475 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 1401 time to create 1 rle with old method : 0.0016355514526367188 length of segment : 26 time for calcul the mask position with numpy : 0.0029561519622802734 nb_pixel_total : 109998 time to create 1 rle with old method : 0.11488819122314453 length of segment : 486 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 8813 time to create 1 rle with old method : 0.009738445281982422 length of segment : 147 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008579730987548828 length of segment : 188 time for calcul the mask position with numpy : 0.0005898475646972656 nb_pixel_total : 14665 time to create 1 rle with old method : 0.015666961669921875 length of segment : 169 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 8358 time to create 1 rle with old method : 0.00917959213256836 length of segment : 71 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 3405 time to create 1 rle with old method : 0.0035886764526367188 length of segment : 75 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 702 time to create 1 rle with old method : 0.0008270740509033203 length of segment : 27 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 5822 time to create 1 rle with old method : 0.006395816802978516 length of segment : 94 time for calcul the mask position with numpy : 0.000843048095703125 nb_pixel_total : 12019 time to create 1 rle with old method : 0.013061761856079102 length of segment : 143 time for calcul the mask position with numpy : 0.0010950565338134766 nb_pixel_total : 19546 time to create 1 rle with old method : 0.020473957061767578 length of segment : 171 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 1567 time to create 1 rle with old method : 0.0018541812896728516 length of segment : 43 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 4598 time to create 1 rle with old method : 0.005178928375244141 length of segment : 86 time for calcul the mask position with numpy : 0.0010845661163330078 nb_pixel_total : 18264 time to create 1 rle with old method : 0.020428180694580078 length of segment : 140 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 8714 time to create 1 rle with old method : 0.009659051895141602 length of segment : 115 time for calcul the mask position with numpy : 0.0006833076477050781 nb_pixel_total : 15154 time to create 1 rle with old method : 0.015981435775756836 length of segment : 151 time for calcul the mask position with numpy : 0.00012993812561035156 nb_pixel_total : 885 time to create 1 rle with old method : 0.0009734630584716797 length of segment : 69 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 10510 time to create 1 rle with old method : 0.011625289916992188 length of segment : 98 time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 19044 time to create 1 rle with old method : 0.019797325134277344 length of segment : 170 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 2687 time to create 1 rle with old method : 0.0028657913208007812 length of segment : 56 time for calcul the mask position with numpy : 0.0006480216979980469 nb_pixel_total : 14552 time to create 1 rle with old method : 0.015134572982788086 length of segment : 236 time for calcul the mask position with numpy : 0.0012793540954589844 nb_pixel_total : 27811 time to create 1 rle with old method : 0.030194520950317383 length of segment : 176 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 1670 time to create 1 rle with old method : 0.001825571060180664 length of segment : 60 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 4217 time to create 1 rle with old method : 0.004873037338256836 length of segment : 67 time spent for convertir_results : 14.92568826675415 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 319 chid ids of type : 3760 Number RLEs to save : 56266 save missing photos in datou_result : time spend for datou_step_exec : 49.55750870704651 time spend to save output : 3.3421719074249268 total time spend for step 1 : 52.899680614471436 step2:blur_detection Sat Feb 1 09:35:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738398868_4016637_1332915528_4d858db986769efdf41b11826e00e6ab.jpg resize: (1080, 1920) 1332915528 -1.4454098188784505 treat image : temp/1738398868_4016637_1332915522_32ebf91143580e2a47ff67523f0c4362.jpg resize: (1080, 1920) 1332915522 -0.17898999083589978 treat image : temp/1738398868_4016637_1332915516_c63234f12d3506e1f00736671e8b9ccd.jpg resize: (1080, 1920) 1332915516 -3.175180325945352 treat image : temp/1738398868_4016637_1332915512_8bde6149c950c0da2d817396d951ba2a.jpg resize: (1080, 1920) 1332915512 -5.5603379360054825 treat image : temp/1738398868_4016637_1332915489_b8dadb42f32c9875bf856b5d7be24347.jpg resize: (1080, 1920) 1332915489 0.1354607190216837 treat image : temp/1738398868_4016637_1332915445_c2138138084f1ca5cda50c14e76eaccd.jpg resize: (1080, 1920) 1332915445 -0.8289571563887347 treat image : temp/1738398868_4016637_1332915442_f7f2fb220fb4ecc3f0069807c149d6af.jpg resize: (1080, 1920) 1332915442 -6.490776681008337 treat image : temp/1738398868_4016637_1332915374_58bae848d35d5aa1546abadfb8456532.jpg resize: (1080, 1920) 1332915374 -2.202262361392654 treat image : temp/1738398868_4016637_1332915364_0ad2d4179bcd0a3981f7f3d4c94b6c96.jpg resize: (1080, 1920) 1332915364 -0.9558795851627728 treat image : temp/1738398868_4016637_1332915344_4edaaadb85df6578760fba45be917269.jpg resize: (1080, 1920) 1332915344 -3.260645737644576 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.012978553771972656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.012067794799804688 save missing photos in datou_result : time spend for datou_step_exec : 9.762613773345947 time spend to save output : 0.029975414276123047 total time spend for step 2 : 9.79258918762207 step3:brightness Sat Feb 1 09:35:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738398868_4016637_1332915528_4d858db986769efdf41b11826e00e6ab.jpg treat image : temp/1738398868_4016637_1332915522_32ebf91143580e2a47ff67523f0c4362.jpg treat image : temp/1738398868_4016637_1332915516_c63234f12d3506e1f00736671e8b9ccd.jpg treat image : temp/1738398868_4016637_1332915512_8bde6149c950c0da2d817396d951ba2a.jpg treat image : temp/1738398868_4016637_1332915489_b8dadb42f32c9875bf856b5d7be24347.jpg treat image : temp/1738398868_4016637_1332915445_c2138138084f1ca5cda50c14e76eaccd.jpg treat image : temp/1738398868_4016637_1332915442_f7f2fb220fb4ecc3f0069807c149d6af.jpg treat image : temp/1738398868_4016637_1332915374_58bae848d35d5aa1546abadfb8456532.jpg treat image : temp/1738398868_4016637_1332915364_0ad2d4179bcd0a3981f7f3d4c94b6c96.jpg treat image : temp/1738398868_4016637_1332915344_4edaaadb85df6578760fba45be917269.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.01246333122253418 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.012184619903564453 save missing photos in datou_result : time spend for datou_step_exec : 2.373180866241455 time spend to save output : 0.029227495193481445 total time spend for step 3 : 2.4024083614349365 step4:crop_condition Sat Feb 1 09:35:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 319 chid ids of type : 3760 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 4219792 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398938_4016637 we have uploaded 30 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.487539768218994 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 4219792 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398946_4016637 we have uploaded 17 photos in the portfolio 4219792 time of upload the photos Elapsed time : 4.186752796173096 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4219792 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398950_4016637 we have uploaded 8 photos in the portfolio 4219792 time of upload the photos Elapsed time : 1.8355658054351807 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 76 About to insert : list_path_to_insert length 76 new photo from crops ! About to upload 76 photos upload in portfolio : 4219792 init cache_photo without model_param we have 76 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398956_4016637 we have uploaded 76 photos in the portfolio 4219792 time of upload the photos Elapsed time : 18.785759925842285 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4219792 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398975_4016637 we have uploaded 9 photos in the portfolio 4219792 time of upload the photos Elapsed time : 2.2132773399353027 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 4219792 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398979_4016637 we have uploaded 19 photos in the portfolio 4219792 time of upload the photos Elapsed time : 4.808993577957153 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 4219792 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738398988_4016637 we have uploaded 52 photos in the portfolio 4219792 time of upload the photos Elapsed time : 13.17440676689148 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1332915528, 1332915522, 1332915516, 1332915512, 1332915489, 1332915445, 1332915442, 1332915374, 1332915364, 1332915344] Looping around the photos to save general results len do output : 211 /1333659389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333659905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333660481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915528', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915522', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915516', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915512', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915489', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915445', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915442', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915374', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915364', None, None, None, None, None, '2529531') ('4909', None, None, None, None, None, None, None, '2529531') ('4909', '20065069', '1332915344', None, None, None, None, None, '2529531') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 643 time used for this insertion : 0.039739131927490234 save_final save missing photos in datou_result : time spend for datou_step_exec : 65.72353768348694 time spend to save output : 0.04597806930541992 total time spend for step 4 : 65.76951575279236 step5:thcl Sat Feb 1 09:36:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.01016688346862793 time to convert the images to numpy array : 0.06377387046813965 time to import caffe and check if the image exist : 0.015067100524902344 time to convert the images to numpy array : 0.09101104736328125 time to import caffe and check if the image exist : 0.018561363220214844 time to convert the images to numpy array : 0.09296250343322754 time to import caffe and check if the image exist : 0.01677870750427246 time to convert the images to numpy array : 0.10286521911621094 time to import caffe and check if the image exist : 0.02331066131591797 time to convert the images to numpy array : 0.09639167785644531 time to import caffe and check if the image exist : 0.011502504348754883 time to convert the images to numpy array : 0.11099481582641602 time to import caffe and check if the image exist : 0.020414352416992188 time to convert the images to numpy array : 0.10422062873840332 time to import caffe and check if the image exist : 0.020912647247314453 time to convert the images to numpy array : 0.10106563568115234 time to import caffe and check if the image exist : 0.017869234085083008 time to convert the images to numpy array : 0.10995721817016602 time to import caffe and check if the image exist : 0.022876262664794922 time to convert the images to numpy array : 0.1082315444946289 total time to convert the images to numpy array : 0.4446566104888916 list photo_ids error: [] list photo_ids correct : [1333660469, 1333660470, 1333660471, 1333660472, 1333660473, 1333660474, 1333660475, 1333660476, 1333660477, 1333660478, 1333660479, 1333660480, 1333660481, 1333659437, 1333659438, 1333659439, 1333659443, 1333659444, 1333659445, 1333659446, 1333659447, 1333659448, 1333659449, 1333659450, 1333659682, 1333659684, 1333659686, 1333659688, 1333659690, 1333659692, 1333659694, 1333659696, 1333659698, 1333659700, 1333659702, 1333659748, 1333659750, 1333659752, 1333659754, 1333659756, 1333659758, 1333659760, 1333659762, 1333659764, 1333659766, 1333659768, 1333659770, 1333659772, 1333659774, 1333659776, 1333659778, 1333659780, 1333659782, 1333659784, 1333659786, 1333659788, 1333659790, 1333659412, 1333659413, 1333659414, 1333659415, 1333659416, 1333659417, 1333659418, 1333659419, 1333659423, 1333659424, 1333659425, 1333659426, 1333659427, 1333659428, 1333659429, 1333659430, 1333659431, 1333659432, 1333659433, 1333659434, 1333659435, 1333659436, 1333659891, 1333659893, 1333659895, 1333659897, 1333659899, 1333659901, 1333659903, 1333659905, 1333660022, 1333660024, 1333660026, 1333660028, 1333660030, 1333660032, 1333660034, 1333660036, 1333660038, 1333660040, 1333660042, 1333660044, 1333660046, 1333660048, 1333660434, 1333660436, 1333660438, 1333660440, 1333660442, 1333660444, 1333660446, 1333660448, 1333660450, 1333660452, 1333660454, 1333660456, 1333660458, 1333660460, 1333660461, 1333660462, 1333660463, 1333660464, 1333660465, 1333660466, 1333660467, 1333660468, 1333659704, 1333659706, 1333659708, 1333659710, 1333659712, 1333659714, 1333659716, 1333659718, 1333659720, 1333659722, 1333659724, 1333659726, 1333659728, 1333659730, 1333659732, 1333659734, 1333659736, 1333659738, 1333659740, 1333659742, 1333659744, 1333659746, 1333659792, 1333659794, 1333659796, 1333659798, 1333659800, 1333659802, 1333659804, 1333659806, 1333659808, 1333659810, 1333659812, 1333659814, 1333659816, 1333659818, 1333659820, 1333659822, 1333659824, 1333659826, 1333659828, 1333659830, 1333659832, 1333659889, 1333660050, 1333660052, 1333660054, 1333660056, 1333660058, 1333660399, 1333660402, 1333660404, 1333660406, 1333660408, 1333660410, 1333660412, 1333660414, 1333660416, 1333660418, 1333660420, 1333660422, 1333660424, 1333660426, 1333660428, 1333660430, 1333660432, 1333659389, 1333659390, 1333659391, 1333659392, 1333659393, 1333659394, 1333659395, 1333659396, 1333659397, 1333659398, 1333659399, 1333659401, 1333659402, 1333659403, 1333659404, 1333659405, 1333659406, 1333659407, 1333659408, 1333659409, 1333659410, 1333659411] number of photos to traite : 211 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5706 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory WARNING: Logging before InitGoogleLogging() is written to STDERR F0201 09:36:47.738782 4016637 math_functions.cu:153] Check failed: status == CUBLAS_STATUS_SUCCESS (13 vs. 0) CUBLAS_STATUS_EXECUTION_FAILED *** Check failure stack trace: *** Command terminated by signal 6 63.72user 30.05system 2:23.56elapsed 65%CPU (0avgtext+0avgdata 4137492maxresident)k 705560inputs+27952outputs (375major+4058085minor)pagefaults 0swaps