python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1155798 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2570013'] with mtr_portfolio_ids : ['20387391'] and first list_photo_ids : [] new path : /proc/1155798/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1344616413116455 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 10 06:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3358 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-10 06:20:32.847384: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-10 06:20:32.875154: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-10 06:20:32.877270: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3fd0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-10 06:20:32.877316: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-10 06:20:32.880987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-10 06:20:33.152523: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x13d97e70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-10 06:20:33.152591: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-10 06:20:33.153693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 06:20:33.154490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 06:20:33.159032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 06:20:33.161708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 06:20:33.163166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 06:20:33.166623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 06:20:33.168282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 06:20:33.174526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 06:20:33.175771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 06:20:33.175843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 06:20:33.176481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-10 06:20:33.176497: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-10 06:20:33.176508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-10 06:20:33.177541: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2906 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-10 06:20:33.514508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 06:20:33.514592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 06:20:33.514621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 06:20:33.514649: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 06:20:33.514673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 06:20:33.514696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 06:20:33.514722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 06:20:33.514741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 06:20:33.515810: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 06:20:33.517138: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-10 06:20:33.517195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-10 06:20:33.517215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 06:20:33.517232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-10 06:20:33.517253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-10 06:20:33.517270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-10 06:20:33.517291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-10 06:20:33.517311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 06:20:33.518414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-10 06:20:33.518454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-10 06:20:33.518466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-10 06:20:33.518475: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-10 06:20:33.519658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2906 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-10 06:20:41.618537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-10 06:20:41.830175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-10 06:20:43.204202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.204888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.11G (2261031168 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.204927: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.205581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.205598: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.216035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.216059: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.216679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.216700: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.224633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.224656: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.225286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.225309: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.266892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.266946: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.267567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.267588: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.274667: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.274689: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.275360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.275379: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-10 06:20:43.321187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.321835: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.324150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.324852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.380524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.381172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.383579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.384233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.420677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.421383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.423072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.423710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.430500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.431201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.434296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.435061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.442081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.442761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.444486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.445146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.480070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.480753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.481358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.481977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.487071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.487748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.510060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.511258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.512147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.512715: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.527938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.528514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.529080: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.529647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.535197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.535821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.541982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.542566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.556408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.557029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.561218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.561786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.562349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.562920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.563679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.564300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.576155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.576776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.577562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.578181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.578796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.579415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.597224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.597848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.636890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.636957: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-10 06:20:43.638206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.639369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.647385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.648304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.648933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.649551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.659320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.659948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.677484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.678281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.679084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.679858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.684976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.685570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.686133: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.686696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.687705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.700107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.700730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.710743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.711412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.712043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.712659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.713283: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-10 06:20:43.713899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.34G (2512257024 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.35625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0022192001342773438 length of segment : 45 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 26 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0013020038604736328 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.26250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.99297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002415180206298828 length of segment : 11 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004527568817138672 length of segment : 14 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 1496 time to create 1 rle with old method : 0.00225830078125 length of segment : 127 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.08281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004868507385253906 length of segment : 16 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00014066696166992188 length of segment : 9 time for calcul the mask position with numpy : 0.00038552284240722656 nb_pixel_total : 5551 time to create 1 rle with old method : 0.007032871246337891 length of segment : 298 time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 3477 time to create 1 rle with old method : 0.005856752395629883 length of segment : 281 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 15 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003688335418701172 length of segment : 23 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006685256958007812 length of segment : 27 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.92266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0005795955657958984 length of segment : 47 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 3826 time to create 1 rle with old method : 0.004974365234375 length of segment : 101 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 181.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 70.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 10814 time to create 1 rle with old method : 0.012763261795043945 length of segment : 220 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1677 time to create 1 rle with old method : 0.0020766258239746094 length of segment : 120 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00042939186096191406 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003199577331542969 length of segment : 31 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0003066062927246094 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 19 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 15 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0022161006927490234 length of segment : 70 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.000568389892578125 length of segment : 22 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007295608520507812 length of segment : 40 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1387 time to create 1 rle with old method : 0.002001047134399414 length of segment : 64 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.97734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.001413583755493164 length of segment : 36 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1588 time to create 1 rle with old method : 0.0020656585693359375 length of segment : 44 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0008020401000976562 length of segment : 33 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009605884552001953 length of segment : 33 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 19 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 884 time to create 1 rle with old method : 0.0012543201446533203 length of segment : 57 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0018153190612792969 length of segment : 58 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 25 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007832050323486328 length of segment : 22 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0014045238494873047 length of segment : 33 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0008804798126220703 length of segment : 21 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005159378051757812 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.71953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00025200843811035156 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00032067298889160156 length of segment : 12 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.000560760498046875 length of segment : 30 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 28 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009915828704833984 length of segment : 57 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0014102458953857422 length of segment : 36 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0013000965118408203 length of segment : 40 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005557537078857422 length of segment : 32 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005383491516113281 length of segment : 36 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006644725799560547 length of segment : 23 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00017952919006347656 length of segment : 12 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002608299255371094 length of segment : 15 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00041365623474121094 length of segment : 24 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1829 time to create 1 rle with old method : 0.0022945404052734375 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.60234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 45 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00040411949157714844 length of segment : 19 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0008544921875 length of segment : 26 time for calcul the mask position with numpy : 0.0001277923583984375 nb_pixel_total : 5142 time to create 1 rle with old method : 0.006063222885131836 length of segment : 86 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0008051395416259766 length of segment : 29 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0011200904846191406 length of segment : 40 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005669593811035156 length of segment : 25 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003077983856201172 length of segment : 11 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 28 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00045037269592285156 length of segment : 25 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00044798851013183594 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005154609680175781 length of segment : 33 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 4949 time to create 1 rle with old method : 0.005596637725830078 length of segment : 112 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2496 time to create 1 rle with old method : 0.003144502639770508 length of segment : 68 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005042552947998047 length of segment : 26 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 683 time to create 1 rle with old method : 0.0008680820465087891 length of segment : 36 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0014536380767822266 length of segment : 36 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 25 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020766258239746094 length of segment : 28 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2266 time to create 1 rle with old method : 0.0027513504028320312 length of segment : 62 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 961 time to create 1 rle with old method : 0.0012140274047851562 length of segment : 36 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 27 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 3192 time to create 1 rle with old method : 0.0036385059356689453 length of segment : 85 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00025725364685058594 length of segment : 11 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 4468 time to create 1 rle with old method : 0.005173683166503906 length of segment : 105 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0014884471893310547 length of segment : 31 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004401206970214844 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003628730773925781 length of segment : 33 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1283 time to create 1 rle with old method : 0.0015795230865478516 length of segment : 46 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 16 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0010657310485839844 length of segment : 39 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 2812 time to create 1 rle with old method : 0.003754138946533203 length of segment : 74 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005986690521240234 length of segment : 23 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0009255409240722656 length of segment : 35 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005197525024414062 length of segment : 28 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1190 time to create 1 rle with old method : 0.001443624496459961 length of segment : 38 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00017261505126953125 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004661083221435547 length of segment : 23 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.000370025634765625 length of segment : 21 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0018186569213867188 length of segment : 140 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00037479400634765625 length of segment : 34 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 14 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 6448 time to create 1 rle with old method : 0.00762486457824707 length of segment : 160 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.00118255615234375 length of segment : 28 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002682209014892578 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005602836608886719 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.89922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 2669 time to create 1 rle with old method : 0.006108999252319336 length of segment : 118 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1621 time to create 1 rle with old method : 0.0021064281463623047 length of segment : 67 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.00045490264892578125 length of segment : 37 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0012021064758300781 length of segment : 44 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004124641418457031 length of segment : 17 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1185 time to create 1 rle with old method : 0.001619577407836914 length of segment : 37 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 16 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1924 time to create 1 rle with old method : 0.0023620128631591797 length of segment : 61 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.0009944438934326172 length of segment : 28 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2074 time to create 1 rle with old method : 0.0034780502319335938 length of segment : 41 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 963 time to create 1 rle with old method : 0.001276254653930664 length of segment : 31 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0009121894836425781 length of segment : 44 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00030994415283203125 length of segment : 26 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00037860870361328125 length of segment : 19 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0015347003936767578 length of segment : 51 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.001468658447265625 length of segment : 51 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00044274330139160156 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003561973571777344 length of segment : 21 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 2847 time to create 1 rle with old method : 0.0033850669860839844 length of segment : 102 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 17 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007288455963134766 length of segment : 33 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1069 time to create 1 rle with old method : 0.0014154911041259766 length of segment : 30 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002918243408203125 length of segment : 15 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 13 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00029397010803222656 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.80547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004286766052246094 length of segment : 23 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2565 time to create 1 rle with old method : 0.0033910274505615234 length of segment : 68 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0020287036895751953 length of segment : 55 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004508495330810547 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 28 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 24 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00036215782165527344 length of segment : 19 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1505 time to create 1 rle with old method : 0.0019555091857910156 length of segment : 50 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00017642974853515625 length of segment : 17 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0018525123596191406 length of segment : 50 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 223.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 1823 time to create 1 rle with old method : 0.003444671630859375 length of segment : 95 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.41484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0009222030639648438 length of segment : 34 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 25 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0005395412445068359 length of segment : 21 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0005762577056884766 length of segment : 19 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0004897117614746094 length of segment : 19 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0009658336639404297 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006592273712158203 length of segment : 27 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005877017974853516 length of segment : 42 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007622241973876953 length of segment : 20 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0017735958099365234 length of segment : 55 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.001168966293334961 length of segment : 32 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0020008087158203125 length of segment : 35 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0011343955993652344 length of segment : 30 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0016450881958007812 length of segment : 46 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.000457763671875 length of segment : 19 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0007803440093994141 length of segment : 30 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.001363992691040039 length of segment : 35 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0010216236114501953 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004367828369140625 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00021028518676757812 length of segment : 15 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 32 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 34 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006339550018310547 length of segment : 33 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00031065940856933594 length of segment : 17 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002510547637939453 length of segment : 21 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1579 time to create 1 rle with old method : 0.001995563507080078 length of segment : 49 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 11 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0009076595306396484 length of segment : 32 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.0002067089080810547 length of segment : 14 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00038909912109375 length of segment : 24 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0018422603607177734 length of segment : 56 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0015177726745605469 length of segment : 37 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00024437904357910156 length of segment : 11 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004978179931640625 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007529258728027344 length of segment : 31 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008401870727539062 length of segment : 43 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00020885467529296875 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.25859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 733 time to create 1 rle with old method : 0.0014643669128417969 length of segment : 33 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0008792877197265625 length of segment : 25 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.001024007797241211 length of segment : 21 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0009186267852783203 length of segment : 30 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0010273456573486328 length of segment : 28 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0012066364288330078 length of segment : 30 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0008406639099121094 length of segment : 53 time for calcul the mask position with numpy : 0.00013256072998046875 nb_pixel_total : 2267 time to create 1 rle with old method : 0.0030517578125 length of segment : 86 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00019478797912597656 length of segment : 12 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0007040500640869141 length of segment : 29 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002675056457519531 length of segment : 12 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003287792205810547 length of segment : 16 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006563663482666016 length of segment : 68 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007736682891845703 length of segment : 23 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.00028204917907714844 length of segment : 15 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 1880 time to create 1 rle with old method : 0.0023238658905029297 length of segment : 111 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 640 time to create 1 rle with old method : 0.0008389949798583984 length of segment : 44 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.22734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0010733604431152344 length of segment : 26 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0010571479797363281 length of segment : 27 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0007562637329101562 length of segment : 26 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0009238719940185547 length of segment : 11 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0007231235504150391 length of segment : 28 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0015981197357177734 length of segment : 40 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0019183158874511719 length of segment : 36 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 2848 time to create 1 rle with old method : 0.005038738250732422 length of segment : 70 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 13 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0009593963623046875 length of segment : 23 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2453 time to create 1 rle with old method : 0.004208803176879883 length of segment : 91 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00042748451232910156 length of segment : 22 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004868507385253906 length of segment : 22 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006670951843261719 length of segment : 27 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0012326240539550781 length of segment : 30 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0015711784362792969 length of segment : 40 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 3144 time to create 1 rle with old method : 0.0036203861236572266 length of segment : 83 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1629 time to create 1 rle with old method : 0.001986980438232422 length of segment : 42 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001456737518310547 length of segment : 13 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 2051 time to create 1 rle with old method : 0.00225830078125 length of segment : 82 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00017595291137695312 length of segment : 12 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006070137023925781 length of segment : 26 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0016431808471679688 length of segment : 60 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 2595 time to create 1 rle with old method : 0.00304412841796875 length of segment : 84 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 33 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0016739368438720703 length of segment : 39 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 19 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1894 time to create 1 rle with old method : 0.0023834705352783203 length of segment : 52 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 2101 time to create 1 rle with old method : 0.002671957015991211 length of segment : 57 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1305 time to create 1 rle with old method : 0.0015244483947753906 length of segment : 58 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005385875701904297 length of segment : 22 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2402 time to create 1 rle with old method : 0.002888202667236328 length of segment : 68 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.00113677978515625 length of segment : 45 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1380 time to create 1 rle with old method : 0.0016317367553710938 length of segment : 74 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.000659942626953125 length of segment : 40 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 2558 time to create 1 rle with old method : 0.0031375885009765625 length of segment : 52 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2085 time to create 1 rle with old method : 0.0025930404663085938 length of segment : 53 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 3002 time to create 1 rle with old method : 0.003715038299560547 length of segment : 57 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 26 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1931 time to create 1 rle with old method : 0.0023193359375 length of segment : 43 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0015325546264648438 length of segment : 37 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0019519329071044922 length of segment : 46 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006377696990966797 length of segment : 19 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 2717 time to create 1 rle with old method : 0.0032596588134765625 length of segment : 77 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 13 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 25 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.001027822494506836 length of segment : 39 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.00043272972106933594 length of segment : 36 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 23 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.00047659873962402344 length of segment : 26 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0014069080352783203 length of segment : 22 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.001394510269165039 length of segment : 68 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0014469623565673828 length of segment : 56 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00018978118896484375 length of segment : 13 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 958 time to create 1 rle with old method : 0.0012090206146240234 length of segment : 47 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 3284 time to create 1 rle with old method : 0.0040814876556396484 length of segment : 79 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0004932880401611328 length of segment : 29 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0012454986572265625 length of segment : 22 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 64.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 30 time to create 1 rle with old method : 0.000171661376953125 length of segment : 10 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 3866 time to create 1 rle with old method : 0.004876613616943359 length of segment : 174 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003554821014404297 length of segment : 15 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1880 time to create 1 rle with old method : 0.0024459362030029297 length of segment : 30 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 51008 time to create 1 rle with old method : 0.05665874481201172 length of segment : 216 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0009577274322509766 length of segment : 23 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 2755 time to create 1 rle with old method : 0.003363370895385742 length of segment : 53 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2916 time to create 1 rle with old method : 0.0035507678985595703 length of segment : 60 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0019273757934570312 length of segment : 43 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0019478797912597656 length of segment : 38 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007822513580322266 length of segment : 22 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0011641979217529297 length of segment : 27 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.0007898807525634766 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005931854248046875 length of segment : 26 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1353 time to create 1 rle with old method : 0.0017180442810058594 length of segment : 41 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008685588836669922 length of segment : 19 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009770393371582031 length of segment : 25 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1736 time to create 1 rle with old method : 0.0022323131561279297 length of segment : 53 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.0011105537414550781 length of segment : 57 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00033354759216308594 length of segment : 13 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 14 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 22 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00021338462829589844 length of segment : 13 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005173683166503906 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005321502685546875 length of segment : 22 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0007848739624023438 length of segment : 14 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0011563301086425781 length of segment : 40 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005216598510742188 length of segment : 29 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003490447998046875 length of segment : 19 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006036758422851562 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005385875701904297 length of segment : 20 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0015840530395507812 length of segment : 30 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009295940399169922 length of segment : 33 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008854866027832031 length of segment : 31 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 11 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001494884490966797 length of segment : 8 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007908344268798828 length of segment : 19 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 18 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006117820739746094 length of segment : 33 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0015778541564941406 length of segment : 29 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006787776947021484 length of segment : 38 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0011162757873535156 length of segment : 61 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.0012128353118896484 length of segment : 36 time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 7891 time to create 1 rle with old method : 0.00962376594543457 length of segment : 88 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 14 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.00048232078552246094 length of segment : 23 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00025272369384765625 length of segment : 13 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004150867462158203 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005714893341064453 length of segment : 45 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007839202880859375 length of segment : 36 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1752 time to create 1 rle with old method : 0.002272367477416992 length of segment : 59 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007276535034179688 length of segment : 27 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0009434223175048828 length of segment : 15 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 46 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1814 time to create 1 rle with old method : 0.002335071563720703 length of segment : 78 time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 19846 time to create 1 rle with old method : 0.02371048927307129 length of segment : 196 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.0002052783966064453 length of segment : 20 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0009403228759765625 length of segment : 24 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006647109985351562 length of segment : 29 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0009796619415283203 length of segment : 28 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2355 time to create 1 rle with old method : 0.0030667781829833984 length of segment : 60 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 115.89669 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00020623207092285156 length of segment : 14 Detection mask done ! Trying to reset tf kernel 1156230 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1366 tf kernel not reseted sub process len(results) : 317 len(list_Values) 317 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 317 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2559 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 317 chid ids of type : 4228 Number RLEs to save : 12377 save missing photos in datou_result : time spend for datou_step_exec : 23.21177577972412 time spend to save output : 1.873420238494873 total time spend for step 1 : 25.085196018218994 step2:brightness Mon Feb 10 06:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739164829_1155798_1336377956_d8d86a65150aa6cc0d7f2b088a0a08a0.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.014444112777709961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.015275716781616211 save missing photos in datou_result : time spend for datou_step_exec : 0.8026587963104248 time spend to save output : 0.03485298156738281 total time spend for step 2 : 0.8375117778778076 step3:blur_detection Mon Feb 10 06:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739164829_1155798_1336377956_d8d86a65150aa6cc0d7f2b088a0a08a0.jpg resize: (1440, 2560) 1336377956 -8.246906461863201 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.011828422546386719 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.016223907470703125 save missing photos in datou_result : time spend for datou_step_exec : 1.7179527282714844 time spend to save output : 0.03249382972717285 total time spend for step 3 : 1.7504465579986572 step4:rle_unique_nms_with_priority Mon Feb 10 06:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 317 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 316 nb_hashtags : 7 time to prepare the origin masks : 1.9546444416046143 time for calcul the mask position with numpy : 0.2904675006866455 nb_pixel_total : 3358567 time to create 1 rle with new method : 0.16443085670471191 time for calcul the mask position with numpy : 0.015037059783935547 nb_pixel_total : 10814 time to create 1 rle with old method : 0.012941360473632812 time for calcul the mask position with numpy : 0.014955759048461914 nb_pixel_total : 1496 time to create 1 rle with old method : 0.0019085407257080078 time for calcul the mask position with numpy : 0.015164613723754883 nb_pixel_total : 5551 time to create 1 rle with old method : 0.006798744201660156 time for calcul the mask position with numpy : 0.014823675155639648 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0013966560363769531 time for calcul the mask position with numpy : 0.015275716781616211 nb_pixel_total : 174 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.015195608139038086 nb_pixel_total : 139 time to create 1 rle with old method : 0.00022077560424804688 time for calcul the mask position with numpy : 0.01518869400024414 nb_pixel_total : 141 time to create 1 rle with old method : 0.00018525123596191406 time for calcul the mask position with numpy : 0.015153169631958008 nb_pixel_total : 70 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.015306949615478516 nb_pixel_total : 328 time to create 1 rle with old method : 0.00045680999755859375 time for calcul the mask position with numpy : 0.014981985092163086 nb_pixel_total : 1677 time to create 1 rle with old method : 0.0020859241485595703 time for calcul the mask position with numpy : 0.015051603317260742 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.015085697174072266 nb_pixel_total : 21 time to create 1 rle with old method : 6.604194641113281e-05 time for calcul the mask position with numpy : 0.014992475509643555 nb_pixel_total : 3826 time to create 1 rle with old method : 0.004661083221435547 time for calcul the mask position with numpy : 0.01511526107788086 nb_pixel_total : 159 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.01495051383972168 nb_pixel_total : 1192 time to create 1 rle with old method : 0.001439809799194336 time for calcul the mask position with numpy : 0.014986753463745117 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006165504455566406 time for calcul the mask position with numpy : 0.0149078369140625 nb_pixel_total : 223 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.01492619514465332 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004146099090576172 time for calcul the mask position with numpy : 0.014888763427734375 nb_pixel_total : 701 time to create 1 rle with old method : 0.0008518695831298828 time for calcul the mask position with numpy : 0.014962196350097656 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003516674041748047 time for calcul the mask position with numpy : 0.014871358871459961 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.014886856079101562 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.014911651611328125 nb_pixel_total : 96 time to create 1 rle with old method : 0.00013256072998046875 time for calcul the mask position with numpy : 0.01485443115234375 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0012476444244384766 time for calcul the mask position with numpy : 0.0149688720703125 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.01500248908996582 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.017424821853637695 nb_pixel_total : 17 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.015655040740966797 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007152557373046875 time for calcul the mask position with numpy : 0.017540693283081055 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.015138626098632812 nb_pixel_total : 2074 time to create 1 rle with old method : 0.002541780471801758 time for calcul the mask position with numpy : 0.015337944030761719 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004954338073730469 time for calcul the mask position with numpy : 0.015175342559814453 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004584789276123047 time for calcul the mask position with numpy : 0.01685309410095215 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.01528024673461914 nb_pixel_total : 239 time to create 1 rle with old method : 0.00036263465881347656 time for calcul the mask position with numpy : 0.01760268211364746 nb_pixel_total : 31 time to create 1 rle with old method : 0.00011229515075683594 time for calcul the mask position with numpy : 0.019672870635986328 nb_pixel_total : 2266 time to create 1 rle with old method : 0.004180431365966797 time for calcul the mask position with numpy : 0.01970958709716797 nb_pixel_total : 727 time to create 1 rle with old method : 0.0013871192932128906 time for calcul the mask position with numpy : 0.019582033157348633 nb_pixel_total : 912 time to create 1 rle with old method : 0.001722574234008789 time for calcul the mask position with numpy : 0.01891779899597168 nb_pixel_total : 159 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.019793987274169922 nb_pixel_total : 918 time to create 1 rle with old method : 0.0017008781433105469 time for calcul the mask position with numpy : 0.016248464584350586 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005271434783935547 time for calcul the mask position with numpy : 0.015309572219848633 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.0153350830078125 nb_pixel_total : 1924 time to create 1 rle with old method : 0.002276897430419922 time for calcul the mask position with numpy : 0.01526951789855957 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.015146493911743164 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004127025604248047 time for calcul the mask position with numpy : 0.015156269073486328 nb_pixel_total : 3192 time to create 1 rle with old method : 0.0037353038787841797 time for calcul the mask position with numpy : 0.015123367309570312 nb_pixel_total : 199 time to create 1 rle with old method : 0.00026607513427734375 time for calcul the mask position with numpy : 0.015083551406860352 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003879070281982422 time for calcul the mask position with numpy : 0.015140771865844727 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.015131711959838867 nb_pixel_total : 289 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.015095949172973633 nb_pixel_total : 884 time to create 1 rle with old method : 0.0010721683502197266 time for calcul the mask position with numpy : 0.01508641242980957 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017380714416503906 time for calcul the mask position with numpy : 0.015131950378417969 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006613731384277344 time for calcul the mask position with numpy : 0.01515507698059082 nb_pixel_total : 668 time to create 1 rle with old method : 0.0008373260498046875 time for calcul the mask position with numpy : 0.015129804611206055 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.015131950378417969 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0018687248229980469 time for calcul the mask position with numpy : 0.015164375305175781 nb_pixel_total : 7 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.01536703109741211 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007398128509521484 time for calcul the mask position with numpy : 0.015430450439453125 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004315376281738281 time for calcul the mask position with numpy : 0.015196561813354492 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004093647003173828 time for calcul the mask position with numpy : 0.015432119369506836 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008375644683837891 time for calcul the mask position with numpy : 0.015535116195678711 nb_pixel_total : 222 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.015434503555297852 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002665519714355469 time for calcul the mask position with numpy : 0.015519142150878906 nb_pixel_total : 145 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.015321969985961914 nb_pixel_total : 2183 time to create 1 rle with old method : 0.002679586410522461 time for calcul the mask position with numpy : 0.015520572662353516 nb_pixel_total : 1206 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.015393972396850586 nb_pixel_total : 142 time to create 1 rle with old method : 0.000232696533203125 time for calcul the mask position with numpy : 0.015544891357421875 nb_pixel_total : 47 time to create 1 rle with old method : 0.00011134147644042969 time for calcul the mask position with numpy : 0.01541900634765625 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006198883056640625 time for calcul the mask position with numpy : 0.015053749084472656 nb_pixel_total : 231 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.014994144439697266 nb_pixel_total : 231 time to create 1 rle with old method : 0.00032806396484375 time for calcul the mask position with numpy : 0.015040159225463867 nb_pixel_total : 2669 time to create 1 rle with old method : 0.003272533416748047 time for calcul the mask position with numpy : 0.015053987503051758 nb_pixel_total : 4468 time to create 1 rle with old method : 0.005136966705322266 time for calcul the mask position with numpy : 0.015004158020019531 nb_pixel_total : 38 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.014972448348999023 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.014992952346801758 nb_pixel_total : 1621 time to create 1 rle with old method : 0.0019834041595458984 time for calcul the mask position with numpy : 0.014994144439697266 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005717277526855469 time for calcul the mask position with numpy : 0.01500558853149414 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.014926433563232422 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006551742553710938 time for calcul the mask position with numpy : 0.01495361328125 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004982948303222656 time for calcul the mask position with numpy : 0.016974687576293945 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007054805755615234 time for calcul the mask position with numpy : 0.014996767044067383 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0019807815551757812 time for calcul the mask position with numpy : 0.014981985092163086 nb_pixel_total : 299 time to create 1 rle with old method : 0.00039505958557128906 time for calcul the mask position with numpy : 0.014913558959960938 nb_pixel_total : 359 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.014868497848510742 nb_pixel_total : 296 time to create 1 rle with old method : 0.00036978721618652344 time for calcul the mask position with numpy : 0.014872550964355469 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0014088153839111328 time for calcul the mask position with numpy : 0.014866113662719727 nb_pixel_total : 37 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.015134811401367188 nb_pixel_total : 29 time to create 1 rle with old method : 7.43865966796875e-05 time for calcul the mask position with numpy : 0.014999628067016602 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0013651847839355469 time for calcul the mask position with numpy : 0.015223264694213867 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012946128845214844 time for calcul the mask position with numpy : 0.015155553817749023 nb_pixel_total : 1069 time to create 1 rle with old method : 0.0013153553009033203 time for calcul the mask position with numpy : 0.01498270034790039 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.015067100524902344 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.015031814575195312 nb_pixel_total : 5 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.014990806579589844 nb_pixel_total : 4949 time to create 1 rle with old method : 0.005997896194458008 time for calcul the mask position with numpy : 0.014883995056152344 nb_pixel_total : 257 time to create 1 rle with old method : 0.000324249267578125 time for calcul the mask position with numpy : 0.014854907989501953 nb_pixel_total : 5142 time to create 1 rle with old method : 0.005901336669921875 time for calcul the mask position with numpy : 0.014886617660522461 nb_pixel_total : 963 time to create 1 rle with old method : 0.001165628433227539 time for calcul the mask position with numpy : 0.014837026596069336 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.014980077743530273 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007042884826660156 time for calcul the mask position with numpy : 0.014922380447387695 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009050369262695312 time for calcul the mask position with numpy : 0.014859914779663086 nb_pixel_total : 2565 time to create 1 rle with old method : 0.0031096935272216797 time for calcul the mask position with numpy : 0.014859914779663086 nb_pixel_total : 243 time to create 1 rle with old method : 0.00034427642822265625 time for calcul the mask position with numpy : 0.014861106872558594 nb_pixel_total : 1829 time to create 1 rle with old method : 0.002262592315673828 time for calcul the mask position with numpy : 0.014864206314086914 nb_pixel_total : 1505 time to create 1 rle with old method : 0.0017514228820800781 time for calcul the mask position with numpy : 0.015120744705200195 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005099773406982422 time for calcul the mask position with numpy : 0.014889717102050781 nb_pixel_total : 61 time to create 1 rle with old method : 9.489059448242188e-05 time for calcul the mask position with numpy : 0.015004634857177734 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004949569702148438 time for calcul the mask position with numpy : 0.014963626861572266 nb_pixel_total : 6085 time to create 1 rle with old method : 0.007218122482299805 time for calcul the mask position with numpy : 0.01493978500366211 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010821819305419922 time for calcul the mask position with numpy : 0.015007734298706055 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005087852478027344 time for calcul the mask position with numpy : 0.015004396438598633 nb_pixel_total : 279 time to create 1 rle with old method : 0.00037860870361328125 time for calcul the mask position with numpy : 0.014973878860473633 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.015028715133666992 nb_pixel_total : 1823 time to create 1 rle with old method : 0.002192258834838867 time for calcul the mask position with numpy : 0.014982223510742188 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0012276172637939453 time for calcul the mask position with numpy : 0.014958381652832031 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004718303680419922 time for calcul the mask position with numpy : 0.014992952346801758 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005762577056884766 time for calcul the mask position with numpy : 0.014910459518432617 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.014909982681274414 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.01488184928894043 nb_pixel_total : 961 time to create 1 rle with old method : 0.0011646747589111328 time for calcul the mask position with numpy : 0.014843463897705078 nb_pixel_total : 2847 time to create 1 rle with old method : 0.0034558773040771484 time for calcul the mask position with numpy : 0.014885663986206055 nb_pixel_total : 239 time to create 1 rle with old method : 0.000301361083984375 time for calcul the mask position with numpy : 0.014866113662719727 nb_pixel_total : 1185 time to create 1 rle with old method : 0.0014650821685791016 time for calcul the mask position with numpy : 0.014858007431030273 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001392364501953125 time for calcul the mask position with numpy : 0.014911890029907227 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.014901399612426758 nb_pixel_total : 323 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.014826297760009766 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002562999725341797 time for calcul the mask position with numpy : 0.014894723892211914 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0016942024230957031 time for calcul the mask position with numpy : 0.01493525505065918 nb_pixel_total : 1588 time to create 1 rle with old method : 0.0019345283508300781 time for calcul the mask position with numpy : 0.014955997467041016 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0017948150634765625 time for calcul the mask position with numpy : 0.01503610610961914 nb_pixel_total : 173 time to create 1 rle with old method : 0.000232696533203125 time for calcul the mask position with numpy : 0.014971733093261719 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004906654357910156 time for calcul the mask position with numpy : 0.015014171600341797 nb_pixel_total : 152 time to create 1 rle with old method : 0.00024318695068359375 time for calcul the mask position with numpy : 0.014955520629882812 nb_pixel_total : 324 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.01485300064086914 nb_pixel_total : 159 time to create 1 rle with old method : 0.00019788742065429688 time for calcul the mask position with numpy : 0.014838933944702148 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0011966228485107422 time for calcul the mask position with numpy : 0.014890670776367188 nb_pixel_total : 901 time to create 1 rle with old method : 0.0010802745819091797 time for calcul the mask position with numpy : 0.014882564544677734 nb_pixel_total : 273 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.014869451522827148 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.014930486679077148 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003726482391357422 time for calcul the mask position with numpy : 0.014900445938110352 nb_pixel_total : 201 time to create 1 rle with old method : 0.00023984909057617188 time for calcul the mask position with numpy : 0.014939546585083008 nb_pixel_total : 30 time to create 1 rle with old method : 5.698204040527344e-05 time for calcul the mask position with numpy : 0.014832496643066406 nb_pixel_total : 105 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.014905929565429688 nb_pixel_total : 62 time to create 1 rle with old method : 9.918212890625e-05 time for calcul the mask position with numpy : 0.014937639236450195 nb_pixel_total : 160 time to create 1 rle with old method : 0.00019693374633789062 time for calcul the mask position with numpy : 0.014928102493286133 nb_pixel_total : 314 time to create 1 rle with old method : 0.00038623809814453125 time for calcul the mask position with numpy : 0.014928579330444336 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003371238708496094 time for calcul the mask position with numpy : 0.014934778213500977 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001461505889892578 time for calcul the mask position with numpy : 0.014972209930419922 nb_pixel_total : 388 time to create 1 rle with old method : 0.0004973411560058594 time for calcul the mask position with numpy : 0.014913797378540039 nb_pixel_total : 97 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.014871597290039062 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.014896869659423828 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004127025604248047 time for calcul the mask position with numpy : 0.014906644821166992 nb_pixel_total : 104 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.014859437942504883 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0017032623291015625 time for calcul the mask position with numpy : 0.01489567756652832 nb_pixel_total : 2402 time to create 1 rle with old method : 0.002879619598388672 time for calcul the mask position with numpy : 0.014898300170898438 nb_pixel_total : 51 time to create 1 rle with old method : 7.82012939453125e-05 time for calcul the mask position with numpy : 0.014882087707519531 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0014255046844482422 time for calcul the mask position with numpy : 0.01492929458618164 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006501674652099609 time for calcul the mask position with numpy : 0.014854669570922852 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.014899492263793945 nb_pixel_total : 95 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.014901161193847656 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006778240203857422 time for calcul the mask position with numpy : 0.014937400817871094 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003407001495361328 time for calcul the mask position with numpy : 0.014886856079101562 nb_pixel_total : 84 time to create 1 rle with old method : 0.000110626220703125 time for calcul the mask position with numpy : 0.014922857284545898 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003941059112548828 time for calcul the mask position with numpy : 0.014957904815673828 nb_pixel_total : 264 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003752708435058594 time for calcul the mask position with numpy : 0.014930248260498047 nb_pixel_total : 881 time to create 1 rle with old method : 0.0010373592376708984 time for calcul the mask position with numpy : 0.014907121658325195 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005447864532470703 time for calcul the mask position with numpy : 0.015017986297607422 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.014945507049560547 nb_pixel_total : 599 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.014902114868164062 nb_pixel_total : 135 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.014900684356689453 nb_pixel_total : 780 time to create 1 rle with old method : 0.0009202957153320312 time for calcul the mask position with numpy : 0.014909505844116211 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009768009185791016 time for calcul the mask position with numpy : 0.01491236686706543 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006439685821533203 time for calcul the mask position with numpy : 0.014837980270385742 nb_pixel_total : 1894 time to create 1 rle with old method : 0.0022830963134765625 time for calcul the mask position with numpy : 0.014827966690063477 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0013744831085205078 time for calcul the mask position with numpy : 0.014942407608032227 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0017330646514892578 time for calcul the mask position with numpy : 0.015157938003540039 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005960464477539062 time for calcul the mask position with numpy : 0.015057563781738281 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006780624389648438 time for calcul the mask position with numpy : 0.014975786209106445 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005781650543212891 time for calcul the mask position with numpy : 0.015032768249511719 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005009174346923828 time for calcul the mask position with numpy : 0.015055179595947266 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005269050598144531 time for calcul the mask position with numpy : 0.015203237533569336 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008378028869628906 time for calcul the mask position with numpy : 0.015226602554321289 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008432865142822266 time for calcul the mask position with numpy : 0.01524043083190918 nb_pixel_total : 1704 time to create 1 rle with old method : 0.0021028518676757812 time for calcul the mask position with numpy : 0.015253305435180664 nb_pixel_total : 24 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.014955759048461914 nb_pixel_total : 2716 time to create 1 rle with old method : 0.003285646438598633 time for calcul the mask position with numpy : 0.014954328536987305 nb_pixel_total : 217 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.014954805374145508 nb_pixel_total : 119 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.014955997467041016 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.015084266662597656 nb_pixel_total : 1409 time to create 1 rle with old method : 0.0017361640930175781 time for calcul the mask position with numpy : 0.015243053436279297 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012366771697998047 time for calcul the mask position with numpy : 0.015185356140136719 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006592273712158203 time for calcul the mask position with numpy : 0.015183448791503906 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006110668182373047 time for calcul the mask position with numpy : 0.015173196792602539 nb_pixel_total : 2453 time to create 1 rle with old method : 0.0029230117797851562 time for calcul the mask position with numpy : 0.015128612518310547 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004680156707763672 time for calcul the mask position with numpy : 0.015254735946655273 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.015189409255981445 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0012562274932861328 time for calcul the mask position with numpy : 0.015519857406616211 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006411075592041016 time for calcul the mask position with numpy : 0.015093564987182617 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0016446113586425781 time for calcul the mask position with numpy : 0.015176057815551758 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.015068292617797852 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005698204040527344 time for calcul the mask position with numpy : 0.016918420791625977 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0012912750244140625 time for calcul the mask position with numpy : 0.015053749084472656 nb_pixel_total : 2558 time to create 1 rle with old method : 0.0029535293579101562 time for calcul the mask position with numpy : 0.015004873275756836 nb_pixel_total : 347 time to create 1 rle with old method : 0.000446319580078125 time for calcul the mask position with numpy : 0.015105247497558594 nb_pixel_total : 3144 time to create 1 rle with old method : 0.003831624984741211 time for calcul the mask position with numpy : 0.016256093978881836 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004620552062988281 time for calcul the mask position with numpy : 0.01519775390625 nb_pixel_total : 2051 time to create 1 rle with old method : 0.0025353431701660156 time for calcul the mask position with numpy : 0.015372276306152344 nb_pixel_total : 2101 time to create 1 rle with old method : 0.0025725364685058594 time for calcul the mask position with numpy : 0.015295982360839844 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006299018859863281 time for calcul the mask position with numpy : 0.015254974365234375 nb_pixel_total : 178 time to create 1 rle with old method : 0.00024390220642089844 time for calcul the mask position with numpy : 0.015590906143188477 nb_pixel_total : 2085 time to create 1 rle with old method : 0.0025844573974609375 time for calcul the mask position with numpy : 0.015356302261352539 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006110668182373047 time for calcul the mask position with numpy : 0.015231609344482422 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.015068769454956055 nb_pixel_total : 1931 time to create 1 rle with old method : 0.00238037109375 time for calcul the mask position with numpy : 0.01494908332824707 nb_pixel_total : 1579 time to create 1 rle with old method : 0.001943826675415039 time for calcul the mask position with numpy : 0.014918088912963867 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.014938831329345703 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006935596466064453 time for calcul the mask position with numpy : 0.01492452621459961 nb_pixel_total : 3284 time to create 1 rle with old method : 0.003769397735595703 time for calcul the mask position with numpy : 0.014896869659423828 nb_pixel_total : 3002 time to create 1 rle with old method : 0.0034837722778320312 time for calcul the mask position with numpy : 0.01497030258178711 nb_pixel_total : 22 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.014934539794921875 nb_pixel_total : 89 time to create 1 rle with old method : 0.00012040138244628906 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.01499795913696289 nb_pixel_total : 1629 time to create 1 rle with old method : 0.0019845962524414062 time for calcul the mask position with numpy : 0.015167713165283203 nb_pixel_total : 640 time to create 1 rle with old method : 0.0008156299591064453 time for calcul the mask position with numpy : 0.015204668045043945 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005362033843994141 time for calcul the mask position with numpy : 0.015244245529174805 nb_pixel_total : 1380 time to create 1 rle with old method : 0.0017054080963134766 time for calcul the mask position with numpy : 0.01526784896850586 nb_pixel_total : 1880 time to create 1 rle with old method : 0.002714872360229492 time for calcul the mask position with numpy : 0.01518702507019043 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006783008575439453 time for calcul the mask position with numpy : 0.015024662017822266 nb_pixel_total : 733 time to create 1 rle with old method : 0.0008754730224609375 time for calcul the mask position with numpy : 0.014948368072509766 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.01497197151184082 nb_pixel_total : 1305 time to create 1 rle with old method : 0.0015881061553955078 time for calcul the mask position with numpy : 0.015027523040771484 nb_pixel_total : 956 time to create 1 rle with old method : 0.001138448715209961 time for calcul the mask position with numpy : 0.014935016632080078 nb_pixel_total : 32 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.01487112045288086 nb_pixel_total : 2848 time to create 1 rle with old method : 0.0033783912658691406 time for calcul the mask position with numpy : 0.014658689498901367 nb_pixel_total : 477 time to create 1 rle with old method : 0.00058746337890625 time for calcul the mask position with numpy : 0.014795541763305664 nb_pixel_total : 867 time to create 1 rle with old method : 0.0010826587677001953 time for calcul the mask position with numpy : 0.014880180358886719 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0013554096221923828 time for calcul the mask position with numpy : 0.014834165573120117 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.01483464241027832 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004999637603759766 time for calcul the mask position with numpy : 0.01490473747253418 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005221366882324219 time for calcul the mask position with numpy : 0.014972209930419922 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0012829303741455078 time for calcul the mask position with numpy : 0.014889717102050781 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0015172958374023438 time for calcul the mask position with numpy : 0.014896631240844727 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.014963388442993164 nb_pixel_total : 891 time to create 1 rle with old method : 0.0010883808135986328 time for calcul the mask position with numpy : 0.01486659049987793 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006656646728515625 time for calcul the mask position with numpy : 0.014896392822265625 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0013415813446044922 time for calcul the mask position with numpy : 0.014877080917358398 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.014896154403686523 nb_pixel_total : 675 time to create 1 rle with old method : 0.0008208751678466797 time for calcul the mask position with numpy : 0.01495051383972168 nb_pixel_total : 731 time to create 1 rle with old method : 0.0008432865142822266 time for calcul the mask position with numpy : 0.014969348907470703 nb_pixel_total : 559 time to create 1 rle with old method : 0.0006425380706787109 time for calcul the mask position with numpy : 0.014972448348999023 nb_pixel_total : 172 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.014997243881225586 nb_pixel_total : 5 time to create 1 rle with old method : 4.220008850097656e-05 time for calcul the mask position with numpy : 0.014925718307495117 nb_pixel_total : 986 time to create 1 rle with old method : 0.001239776611328125 time for calcul the mask position with numpy : 0.014917373657226562 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002124309539794922 time for calcul the mask position with numpy : 0.014934778213500977 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008912086486816406 time for calcul the mask position with numpy : 0.014877080917358398 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010194778442382812 time for calcul the mask position with numpy : 0.01488184928894043 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006041526794433594 time for calcul the mask position with numpy : 0.014863014221191406 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004038810729980469 time for calcul the mask position with numpy : 0.014981985092163086 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006518363952636719 time for calcul the mask position with numpy : 0.014894962310791016 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0018086433410644531 time for calcul the mask position with numpy : 0.014864444732666016 nb_pixel_total : 586 time to create 1 rle with old method : 0.00072479248046875 time for calcul the mask position with numpy : 0.01489114761352539 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007281303405761719 time for calcul the mask position with numpy : 0.014883756637573242 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003981590270996094 time for calcul the mask position with numpy : 0.014969825744628906 nb_pixel_total : 181 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.01514434814453125 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.015598535537719727 nb_pixel_total : 9 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.015008926391601562 nb_pixel_total : 858 time to create 1 rle with old method : 0.00131988525390625 time for calcul the mask position with numpy : 0.014998197555541992 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005152225494384766 time for calcul the mask position with numpy : 0.014985799789428711 nb_pixel_total : 7891 time to create 1 rle with old method : 0.009912729263305664 time for calcul the mask position with numpy : 0.0150299072265625 nb_pixel_total : 19334 time to create 1 rle with old method : 0.02280712127685547 time for calcul the mask position with numpy : 0.014984607696533203 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0018193721771240234 time for calcul the mask position with numpy : 0.014897584915161133 nb_pixel_total : 261 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.014899730682373047 nb_pixel_total : 2755 time to create 1 rle with old method : 0.003337383270263672 time for calcul the mask position with numpy : 0.015214920043945312 nb_pixel_total : 50356 time to create 1 rle with old method : 0.05713605880737305 time for calcul the mask position with numpy : 0.015038490295410156 nb_pixel_total : 821 time to create 1 rle with old method : 0.0010323524475097656 time for calcul the mask position with numpy : 0.01495504379272461 nb_pixel_total : 374 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.014942169189453125 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003402233123779297 time for calcul the mask position with numpy : 0.014964580535888672 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005733966827392578 time for calcul the mask position with numpy : 0.014985322952270508 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006892681121826172 time for calcul the mask position with numpy : 0.014990091323852539 nb_pixel_total : 603 time to create 1 rle with old method : 0.0007462501525878906 time for calcul the mask position with numpy : 0.014993429183959961 nb_pixel_total : 8 time to create 1 rle with old method : 3.6716461181640625e-05 time for calcul the mask position with numpy : 0.014893770217895508 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005400180816650391 time for calcul the mask position with numpy : 0.01491403579711914 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004963874816894531 time for calcul the mask position with numpy : 0.014931440353393555 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005142688751220703 time for calcul the mask position with numpy : 0.014935731887817383 nb_pixel_total : 1736 time to create 1 rle with old method : 0.0021200180053710938 time for calcul the mask position with numpy : 0.014953374862670898 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.014987468719482422 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003063678741455078 time for calcul the mask position with numpy : 0.015067577362060547 nb_pixel_total : 682 time to create 1 rle with old method : 0.0008370876312255859 time for calcul the mask position with numpy : 0.014990091323852539 nb_pixel_total : 30 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.015039443969726562 nb_pixel_total : 1353 time to create 1 rle with old method : 0.0016429424285888672 time for calcul the mask position with numpy : 0.01498866081237793 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008168220520019531 time for calcul the mask position with numpy : 0.01499032974243164 nb_pixel_total : 131 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.014915943145751953 nb_pixel_total : 1814 time to create 1 rle with old method : 0.0022306442260742188 time for calcul the mask position with numpy : 0.01498723030090332 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.014964818954467773 nb_pixel_total : 25 time to create 1 rle with old method : 8.440017700195312e-05 time for calcul the mask position with numpy : 0.014990568161010742 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0014841556549072266 time for calcul the mask position with numpy : 0.014960527420043945 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.014943599700927734 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006589889526367188 time for calcul the mask position with numpy : 0.014943361282348633 nb_pixel_total : 543 time to create 1 rle with old method : 0.0008349418640136719 time for calcul the mask position with numpy : 0.014971017837524414 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006821155548095703 time for calcul the mask position with numpy : 0.014889955520629883 nb_pixel_total : 4 time to create 1 rle with old method : 1.3589859008789062e-05 time for calcul the mask position with numpy : 0.014912128448486328 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011372566223144531 time for calcul the mask position with numpy : 0.014910697937011719 nb_pixel_total : 3866 time to create 1 rle with old method : 0.004622697830200195 time for calcul the mask position with numpy : 0.014920234680175781 nb_pixel_total : 1752 time to create 1 rle with old method : 0.002140522003173828 time for calcul the mask position with numpy : 0.014901399612426758 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002772808074951172 time for calcul the mask position with numpy : 0.014945507049560547 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010128021240234375 time for calcul the mask position with numpy : 0.01494598388671875 nb_pixel_total : 901 time to create 1 rle with old method : 0.0010976791381835938 time for calcul the mask position with numpy : 0.014879941940307617 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006139278411865234 time for calcul the mask position with numpy : 0.014854192733764648 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.014882802963256836 nb_pixel_total : 99 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.014872312545776367 nb_pixel_total : 1880 time to create 1 rle with old method : 0.0023632049560546875 time for calcul the mask position with numpy : 0.01501607894897461 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002658367156982422 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 34 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.015035152435302734 nb_pixel_total : 377 time to create 1 rle with old method : 0.00046133995056152344 time for calcul the mask position with numpy : 0.015009403228759766 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008091926574707031 create new chi : 5.66436243057251 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01375436782836914 batch 1 Loaded 317 chid ids of type : 4230 Number RLEs to save : 24023 TO DO : save crop sub photo not yet done ! save time : 2.338785409927368 map_output_result : {1336377956: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 1 /1336377956.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015877962112426758 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.294785976409912 time spend to save output : 0.016112804412841797 total time spend for step 4 : 10.310898780822754 step5:crop_condition Mon Feb 10 06:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 317 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 179 About to insert : list_path_to_insert length 179 new photo from crops ! About to upload 179 photos upload in portfolio : 4869462 init cache_photo without model_param we have 179 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739164871_1155798 we have uploaded 179 photos in the portfolio 4869462 time of upload the photos Elapsed time : 39.45172595977783 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4869462 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739164912_1155798 we have uploaded 35 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.825029611587524 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739164921_1155798 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.1846680641174316 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739164923_1155798 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.9821956157684326 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739164926_1155798 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5625782012939453 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 232 /1336398284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336398573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 697 time used for this insertion : 0.12466788291931152 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.33456349372864 time spend to save output : 0.1325225830078125 total time spend for step 5 : 59.46708607673645 step6:thcl Mon Feb 10 06:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.013050079345703125 time to convert the images to numpy array : 0.04126572608947754 time to import caffe and check if the image exist : 0.01537179946899414 time to convert the images to numpy array : 0.05162668228149414 time to import caffe and check if the image exist : 0.011725425720214844 time to convert the images to numpy array : 0.06205105781555176 time to import caffe and check if the image exist : 0.013774633407592773 time to convert the images to numpy array : 0.0706479549407959 time to import caffe and check if the image exist : 0.024024486541748047 time to convert the images to numpy array : 0.06796598434448242 time to import caffe and check if the image exist : 0.028266429901123047 time to convert the images to numpy array : 0.06927227973937988 time to import caffe and check if the image exist : 0.03364443778991699 time to convert the images to numpy array : 0.06418228149414062 time to import caffe and check if the image exist : 0.03769946098327637 time to convert the images to numpy array : 0.06202864646911621 time to import caffe and check if the image exist : 0.04110240936279297 time to convert the images to numpy array : 0.058622121810913086 time to import caffe and check if the image exist : 0.033571481704711914 time to convert the images to numpy array : 0.06669783592224121 total time to convert the images to numpy array : 0.4603447914123535 list photo_ids error: [] list photo_ids correct : [1336398557, 1336398558, 1336398559, 1336398560, 1336398561, 1336398562, 1336398563, 1336398564, 1336398565, 1336398566, 1336398567, 1336398568, 1336398569, 1336398570, 1336398571, 1336398573, 1336398309, 1336398310, 1336398311, 1336398312, 1336398313, 1336398314, 1336398315, 1336398316, 1336398317, 1336398319, 1336398321, 1336398322, 1336398323, 1336398324, 1336398325, 1336398326, 1336398327, 1336398328, 1336398329, 1336398330, 1336398331, 1336398332, 1336398333, 1336398334, 1336398284, 1336398286, 1336398287, 1336398288, 1336398289, 1336398290, 1336398291, 1336398292, 1336398293, 1336398294, 1336398295, 1336398296, 1336398297, 1336398298, 1336398299, 1336398300, 1336398301, 1336398302, 1336398303, 1336398304, 1336398305, 1336398306, 1336398307, 1336398308, 1336398360, 1336398361, 1336398362, 1336398363, 1336398364, 1336398365, 1336398366, 1336398367, 1336398368, 1336398370, 1336398371, 1336398372, 1336398375, 1336398376, 1336398377, 1336398378, 1336398379, 1336398380, 1336398381, 1336398382, 1336398383, 1336398384, 1336398385, 1336398386, 1336398411, 1336398412, 1336398414, 1336398415, 1336398416, 1336398417, 1336398418, 1336398419, 1336398420, 1336398421, 1336398422, 1336398423, 1336398424, 1336398425, 1336398426, 1336398427, 1336398429, 1336398430, 1336398431, 1336398432, 1336398433, 1336398434, 1336398435, 1336398436, 1336398462, 1336398463, 1336398464, 1336398465, 1336398466, 1336398467, 1336398468, 1336398469, 1336398470, 1336398471, 1336398472, 1336398514, 1336398516, 1336398517, 1336398518, 1336398519, 1336398520, 1336398521, 1336398522, 1336398523, 1336398524, 1336398525, 1336398526, 1336398527, 1336398528, 1336398530, 1336398531, 1336398532, 1336398533, 1336398534, 1336398535, 1336398536, 1336398537, 1336398538, 1336398539, 1336398540, 1336398541, 1336398542, 1336398543, 1336398544, 1336398545, 1336398546, 1336398547, 1336398548, 1336398549, 1336398550, 1336398555, 1336398556, 1336398387, 1336398388, 1336398389, 1336398390, 1336398391, 1336398392, 1336398393, 1336398394, 1336398395, 1336398396, 1336398397, 1336398398, 1336398399, 1336398400, 1336398401, 1336398402, 1336398403, 1336398404, 1336398405, 1336398406, 1336398407, 1336398408, 1336398409, 1336398410, 1336398437, 1336398438, 1336398439, 1336398440, 1336398441, 1336398442, 1336398443, 1336398444, 1336398445, 1336398446, 1336398447, 1336398448, 1336398449, 1336398450, 1336398451, 1336398452, 1336398453, 1336398454, 1336398456, 1336398457, 1336398458, 1336398459, 1336398460, 1336398461, 1336398335, 1336398336, 1336398337, 1336398338, 1336398339, 1336398340, 1336398341, 1336398342, 1336398343, 1336398344, 1336398345, 1336398346, 1336398347, 1336398348, 1336398349, 1336398351, 1336398352, 1336398353, 1336398354, 1336398355, 1336398356, 1336398357, 1336398358, 1336398359] number of photos to traite : 232 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3358 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3139 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1500499248504639 time used to do the prediction : 0.9263248443603516 save descriptor for thcl : 3237 time to traite the descriptors : 1.3402113914489746 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336398557 To insert : 1336398558 To insert : 1336398559 To insert : 1336398560 To insert : 1336398561 To insert : 1336398562 To insert : 1336398563 To insert : 1336398564 To insert : 1336398565 To insert : 1336398566 To insert : 1336398567 To insert : 1336398568 To insert : 1336398569 To insert : 1336398570 To insert : 1336398571 To insert : 1336398573 To insert : 1336398309 To insert : 1336398310 To insert : 1336398311 To insert : 1336398312 To insert : 1336398313 To insert : 1336398314 To insert : 1336398315 To insert : 1336398316 To insert : 1336398317 To insert : 1336398319 To insert : 1336398321 To insert : 1336398322 To insert : 1336398323 To insert : 1336398324 To insert : 1336398325 To insert : 1336398326 To insert : 1336398327 To insert : 1336398328 To insert : 1336398329 To insert : 1336398330 To insert : 1336398331 To insert : 1336398332 To insert : 1336398333 To insert : 1336398334 To insert : 1336398284 To insert : 1336398286 To insert : 1336398287 To insert : 1336398288 To insert : 1336398289 To insert : 1336398290 To insert : 1336398291 To insert : 1336398292 To insert : 1336398293 To insert : 1336398294 To insert : 1336398295 To insert : 1336398296 To insert : 1336398297 To insert : 1336398298 To insert : 1336398299 To insert : 1336398300 To insert : 1336398301 To insert : 1336398302 To insert : 1336398303 To insert : 1336398304 To insert : 1336398305 To insert : 1336398306 To insert : 1336398307 To insert : 1336398308 To insert : 1336398360 To insert : 1336398361 To insert : 1336398362 To insert : 1336398363 To insert : 1336398364 To insert : 1336398365 To insert : 1336398366 To insert : 1336398367 To insert : 1336398368 To insert : 1336398370 To insert : 1336398371 To insert : 1336398372 To insert : 1336398375 To insert : 1336398376 To insert : 1336398377 To insert : 1336398378 To insert : 1336398379 To insert : 1336398380 To insert : 1336398381 To insert : 1336398382 To insert : 1336398383 To insert : 1336398384 To insert : 1336398385 To insert : 1336398386 To insert : 1336398411 To insert : 1336398412 To insert : 1336398414 To insert : 1336398415 To insert : 1336398416 To insert : 1336398417 To insert : 1336398418 To insert : 1336398419 To insert : 1336398420 To insert : 1336398421 To insert : 1336398422 To insert : 1336398423 To insert : 1336398424 To insert : 1336398425 To insert : 1336398426 To insert : 1336398427 To insert : 1336398429 To insert : 1336398430 To insert : 1336398431 To insert : 1336398432 To insert : 1336398433 To insert : 1336398434 To insert : 1336398435 To insert : 1336398436 To insert : 1336398462 To insert : 1336398463 To insert : 1336398464 To insert : 1336398465 To insert : 1336398466 To insert : 1336398467 To insert : 1336398468 To insert : 1336398469 To insert : 1336398470 To insert : 1336398471 To insert : 1336398472 To insert : 1336398514 To insert : 1336398516 To insert : 1336398517 To insert : 1336398518 To insert : 1336398519 To insert : 1336398520 To insert : 1336398521 To insert : 1336398522 To insert : 1336398523 To insert : 1336398524 To insert : 1336398525 To insert : 1336398526 To insert : 1336398527 To insert : 1336398528 To insert : 1336398530 To insert : 1336398531 To insert : 1336398532 To insert : 1336398533 To insert : 1336398534 To insert : 1336398535 To insert : 1336398536 To insert : 1336398537 To insert : 1336398538 To insert : 1336398539 To insert : 1336398540 To insert : 1336398541 To insert : 1336398542 To insert : 1336398543 To insert : 1336398544 To insert : 1336398545 To insert : 1336398546 To insert : 1336398547 To insert : 1336398548 To insert : 1336398549 To insert : 1336398550 To insert : 1336398555 To insert : 1336398556 To insert : 1336398387 To insert : 1336398388 To insert : 1336398389 To insert : 1336398390 To insert : 1336398391 To insert : 1336398392 To insert : 1336398393 To insert : 1336398394 To insert : 1336398395 To insert : 1336398396 To insert : 1336398397 To insert : 1336398398 To insert : 1336398399 To insert : 1336398400 To insert : 1336398401 To insert : 1336398402 To insert : 1336398403 To insert : 1336398404 To insert : 1336398405 To insert : 1336398406 To insert : 1336398407 To insert : 1336398408 To insert : 1336398409 To insert : 1336398410 To insert : 1336398437 To insert : 1336398438 To insert : 1336398439 To insert : 1336398440 To insert : 1336398441 To insert : 1336398442 To insert : 1336398443 To insert : 1336398444 To insert : 1336398445 To insert : 1336398446 To insert : 1336398447 To insert : 1336398448 To insert : 1336398449 To insert : 1336398450 To insert : 1336398451 To insert : 1336398452 To insert : 1336398453 To insert : 1336398454 To insert : 1336398456 To insert : 1336398457 To insert : 1336398458 To insert : 1336398459 To insert : 1336398460 To insert : 1336398461 To insert : 1336398335 To insert : 1336398336 To insert : 1336398337 To insert : 1336398338 To insert : 1336398339 To insert : 1336398340 To insert : 1336398341 To insert : 1336398342 To insert : 1336398343 To insert : 1336398344 To insert : 1336398345 To insert : 1336398346 To insert : 1336398347 To insert : 1336398348 To insert : 1336398349 To insert : 1336398351 To insert : 1336398352 To insert : 1336398353 To insert : 1336398354 To insert : 1336398355 To insert : 1336398356 To insert : 1336398357 To insert : 1336398358 To insert : 1336398359 time to insert the descriptors : 39.2814826965332 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 339 time used for this insertion : 0.028072595596313477 save missing photos in datou_result : time spend for datou_step_exec : 47.28830671310425 time spend to save output : 0.07723283767700195 total time spend for step 6 : 47.36553955078125 step7:ventilate_hashtags_in_portfolio Mon Feb 10 06:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20387391 get user id for portfolio 20387391 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20387391 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','autre','carton','PET_clair','Film_plastique','PET_fonce','Papier','metal','refus','environnement','Tetrapak','pet_fonce','flou','Carton','PEHD','pehd','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20387391 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','autre','carton','PET_clair','Film_plastique','PET_fonce','Papier','metal','refus','environnement','Tetrapak','pet_fonce','flou','Carton','PEHD','pehd','mal_croppe')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20387391 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','autre','carton','PET_clair','Film_plastique','PET_fonce','Papier','metal','refus','environnement','Tetrapak','pet_fonce','flou','Carton','PEHD','pehd','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20387391 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','autre','carton','PET_clair','Film_plastique','PET_fonce','Papier','metal','refus','environnement','Tetrapak','pet_fonce','flou','Carton','PEHD','pehd','mal_croppe')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20388522,20388525,20388520,20388532,20388523,20388530,20388526,20388527,20388528,20388529,20388531,20388534,20388535?tags=pet_clair,papier,autre,carton,film_plastique,pet_fonce,metal,refus,environnement,tetrapak,flou,pehd,mal_croppe&datou_id_consolidate=4235&port_consolidate=20387391 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 1 /20387391. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.013105154037475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.5507094860076904 time spend to save output : 0.013343334197998047 total time spend for step 7 : 2.5640528202056885 step8:final Mon Feb 10 06:22:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1336377956: ('0.8051881515876406',)} new output for save of step final : {1336377956: ('0.8051881515876406',)} [1336377956] Looping around the photos to save general results len do output : 1 /1336377956.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012260675430297852 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11151504516601562 time spend to save output : 0.012432575225830078 total time spend for step 8 : 0.1239476203918457 step9:velours_tree Mon Feb 10 06:22:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20388522,20388525,20388520,20388532,20388523,20388530,20388526,20388527,20388528,20388529,20388531,20388534,20388535 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388522 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388525 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388520 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388532 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388523 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388530 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388526 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388527 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388528 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388529 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388531 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388534 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20388535 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 232 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 5 1 2 2 2 2 2 5 2 2 1 4 0 2 1 2 5 0 4 2 0 1 1 1 2 0 4 1 1 2 2 1 1 2 0 1 1 3 1 5 2 1 1 1 2 0 2 4 1 3 2 1 2 1 5 5 1 0 2 5 1 1 2 0 2 5 1 2 5 4 1 2 2 1 1 0 2 2 3 1 1 1 4 1 4 1 1 1 5 1 1 2 4 2 2 2 4 1 2 2 2 0 2 0 1 1 2 0 2 1 3 1 3 1 4 2 2 2 1 2 2 1 2 0 4 2 2 0 1 5 2 2 0 4 1 2 5 3 4 2 1 2 2 1 4 4 2 1 4 0 5 2 4 5 1 5 2 4 1 4 4 4 4 0 4 2 4 4 5 5 4 2 1 2 4 2 3 4 4 1 2 1 1 1 1 3 1 1 1 4 4 2 1 2 0 1 3 2 1 1 0 0 3 3 1 4 2 2 2 4 1 2 3 4 1 0 3 5 0 0 0 1 3 1 4 1 1 2 2 5 2] Elapsed time: 0.03712868690490723 graph_id used : 77579 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20388522,20388525,20388520,20388532,20388523,20388530,20388526,20388527,20388528,20388529,20388531,20388534,20388535?tags=pet_clair,papier,autre,carton,film_plastique,pet_fonce,metal,refus,environnement,tetrapak,flou,pehd,mal_croppe&datou_id_consolidate=4235&port_consolidate=20387391&tree_id=77579 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 1 /20387391Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.014765739440917969 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.50383734703064 time spend to save output : 0.015350580215454102 total time spend for step 9 : 14.519187927246094 step10:send_mail_cod Mon Feb 10 06:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf 20388504 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203885041739164991 20388507 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203885071739164991 20388502 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203885021739164992 20388514 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203885141739164993 20388505 imagette203885051739164994 20388512 imagette203885121739164994 20388508 imagette203885081739164994 20388509 imagette203885091739164994 20388511 imagette203885111739164994 20388513 imagette203885131739164994 20388516 change filename to text .imagette203885161739164994 20388517 imagette203885171739164994 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20387391 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20388522,20388525,20388520,20388532,20388523,20388530,20388526,20388527,20388528,20388529,20388531,20388534,20388535?tags=pet_clair,papier,autre,carton,film_plastique,pet_fonce,metal,refus,environnement,tetrapak,flou,pehd,mal_croppe&datou_id_consolidate=4235&port_consolidate=20387391&tree_id=77579 your option no_mail is active, we will not send the real mail to your client args[1336377956] : ((1336377956, -8.246906461863201, 492609224), (1336377956, 0.1437303119469936, 2107752395), '0.8051881515876406') apple ((1336377956, -8.246906461863201, 492609224), (1336377956, 0.1437303119469936, 2107752395), '0.8051881515876406') We are sending mail with results at cod@fotonower.com refus_total : 0.8051881515876406 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20387391 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20387391','results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf','pdf','','0.13','0.8051881515876406') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.01276540756225586 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5631308555603027 time spend to save output : 0.012925386428833008 total time spend for step 10 : 3.5760562419891357 step11:split_time_score Mon Feb 10 06:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10022025 20387391 Nombre de photos uploadées : 1 / 23040 (0%) 10022025 20387391 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 10022025 20387391 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.000133514404296875 elapsed_time : insert_dashboard_record_day_entry 0.024827957153320312 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.7814399928735274 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20383611_10-02-2025_02_17_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20383611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20383611 AND mptpi.`type`=4230 To do Qualite : 0.8036010637393226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20383613_10-02-2025_02_07_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20383613 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20383613 AND mptpi.`type`=4230 To do Qualite : 0.804626056290372 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20384191_10-02-2025_03_18_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20384191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20384191 AND mptpi.`type`=4230 To do Qualite : 0.8079934345839659 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20384940_10-02-2025_04_05_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20384940 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20384940 AND mptpi.`type`=4230 To do Qualite : 0.830719226488402 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20385587_10-02-2025_05_11_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20385587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20385587 AND mptpi.`type`=4230 To do Qualite : 0.8051881515876406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20387391_10-02-2025_06_23_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20387391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20387391 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1336377956] Looping around the photos to save general results len do output : 1 /20387391Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2570013') ('4234', '20387391', '1336377956', None, None, None, None, None, '2570013') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.01524662971496582 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5514240264892578 time spend to save output : 0.015454769134521484 total time spend for step 11 : 0.5668787956237793 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 37.56user 24.02system 2:50.70elapsed 36%CPU (0avgtext+0avgdata 2354240maxresident)k 827448inputs+14664outputs (1287major+3616240minor)pagefaults 0swaps