python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1689942 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2608854'] with mtr_portfolio_ids : ['20754923'] and first list_photo_ids : [] new path : /proc/1689942/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.18327617645263672 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sun Feb 23 02:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-23 02:20:32.211894: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-23 02:20:32.243233: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-23 02:20:32.244915: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3be4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-23 02:20:32.244967: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-23 02:20:32.247673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-23 02:20:32.488071: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2d8351d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-23 02:20:32.488136: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-23 02:20:32.489689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-23 02:20:32.490146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-23 02:20:32.493175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-23 02:20:32.495853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-23 02:20:32.496258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-23 02:20:32.499188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-23 02:20:32.500566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-23 02:20:32.506248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-23 02:20:32.507795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-23 02:20:32.507896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-23 02:20:32.508705: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-23 02:20:32.508722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-23 02:20:32.508732: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-23 02:20:32.510083: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-23 02:20:32.764003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-23 02:20:32.764122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-23 02:20:32.764145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-23 02:20:32.764166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-23 02:20:32.764185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-23 02:20:32.764205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-23 02:20:32.764223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-23 02:20:32.764243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-23 02:20:32.765921: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-23 02:20:32.767355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-23 02:20:32.767394: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-23 02:20:32.767413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-23 02:20:32.767430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-23 02:20:32.767448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-23 02:20:32.767465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-23 02:20:32.767482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-23 02:20:32.767499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-23 02:20:32.768815: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-23 02:20:32.768847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-23 02:20:32.768856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-23 02:20:32.768863: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-23 02:20:32.770063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-23 02:20:39.256533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-23 02:20:39.400979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.83672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 0.000164031982421875 nb_pixel_total : 2902 time to create 1 rle with old method : 0.0052640438079833984 length of segment : 94 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 1682 time to create 1 rle with old method : 0.002882242202758789 length of segment : 48 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0007033348083496094 length of segment : 35 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0003597736358642578 length of segment : 14 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.000453948974609375 length of segment : 28 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0007872581481933594 length of segment : 22 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 30 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003991127014160156 length of segment : 16 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1478 time to create 1 rle with old method : 0.0024864673614501953 length of segment : 61 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0018575191497802734 length of segment : 44 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2740 time to create 1 rle with old method : 0.003483295440673828 length of segment : 57 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005266666412353516 length of segment : 25 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008981227874755859 length of segment : 42 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010542869567871094 length of segment : 36 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2863 time to create 1 rle with old method : 0.0033931732177734375 length of segment : 56 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1288 time to create 1 rle with old method : 0.0015716552734375 length of segment : 69 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1775 time to create 1 rle with old method : 0.0023393630981445312 length of segment : 69 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.80156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0013663768768310547 length of segment : 27 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 757 time to create 1 rle with old method : 0.0010766983032226562 length of segment : 30 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.0010499954223632812 length of segment : 36 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0013518333435058594 length of segment : 41 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00048470497131347656 length of segment : 26 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003991127014160156 length of segment : 17 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0011637210845947266 length of segment : 26 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 7828 time to create 1 rle with old method : 0.010317087173461914 length of segment : 85 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0003037452697753906 length of segment : 26 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 395 time to create 1 rle with old method : 0.0005946159362792969 length of segment : 22 time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 20544 time to create 1 rle with old method : 0.024019956588745117 length of segment : 186 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0009100437164306641 length of segment : 35 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0018389225006103516 length of segment : 129 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1483 time to create 1 rle with old method : 0.0019068717956542969 length of segment : 51 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005328655242919922 length of segment : 20 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1687 time to create 1 rle with old method : 0.0022459030151367188 length of segment : 71 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00035190582275390625 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.28594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0022187232971191406 length of segment : 47 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 13 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.0004277229309082031 length of segment : 22 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.001163482666015625 length of segment : 36 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0012128353118896484 length of segment : 38 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0030634403228759766 length of segment : 73 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0005042552947998047 length of segment : 41 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00044798851013183594 length of segment : 29 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0013270378112792969 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0003440380096435547 length of segment : 13 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0019850730895996094 length of segment : 41 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0008962154388427734 length of segment : 28 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0005152225494384766 length of segment : 26 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2096 time to create 1 rle with old method : 0.003248453140258789 length of segment : 84 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2138 time to create 1 rle with old method : 0.0033111572265625 length of segment : 50 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2125 time to create 1 rle with old method : 0.003097057342529297 length of segment : 85 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0005114078521728516 length of segment : 16 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00029349327087402344 length of segment : 18 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.001344442367553711 length of segment : 23 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0005271434783935547 length of segment : 16 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0008990764617919922 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.13750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0007908344268798828 length of segment : 28 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0011293888092041016 length of segment : 31 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005159378051757812 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 81.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -42.70000 max: 150.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.00102996826171875 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.81719 max: 149.23281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.00067138671875 length of segment : 24 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014662742614746094 length of segment : 9 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 18 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 13 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002167224884033203 length of segment : 15 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 247.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 120.01406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005390644073486328 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.43828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0012118816375732422 length of segment : 35 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.0015118122100830078 length of segment : 41 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0006196498870849609 length of segment : 26 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0006134510040283203 length of segment : 23 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0016324520111083984 length of segment : 51 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008637905120849609 length of segment : 67 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0009386539459228516 length of segment : 33 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 26 time to create 1 rle with old method : 0.00019311904907226562 length of segment : 2 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 1152 time to create 1 rle with old method : 0.002553224563598633 length of segment : 51 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.0013480186462402344 length of segment : 64 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.75859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 25 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0005326271057128906 length of segment : 22 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.000812530517578125 length of segment : 26 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0015540122985839844 length of segment : 64 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0013239383697509766 length of segment : 52 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 11314 time to create 1 rle with old method : 0.014528512954711914 length of segment : 162 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001499652862548828 length of segment : 12 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 842 time to create 1 rle with old method : 0.0013976097106933594 length of segment : 52 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0004127025604248047 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0008342266082763672 length of segment : 36 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00035858154296875 length of segment : 14 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 11 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 18 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004496574401855469 length of segment : 24 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0007288455963134766 length of segment : 38 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004048347473144531 length of segment : 21 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.001035928726196289 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 38 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006716251373291016 length of segment : 40 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00039196014404296875 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005574226379394531 length of segment : 33 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005667209625244141 length of segment : 22 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0004608631134033203 length of segment : 21 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0008001327514648438 length of segment : 27 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 3032 time to create 1 rle with old method : 0.003941059112548828 length of segment : 64 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002808570861816406 length of segment : 16 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.000335693359375 length of segment : 13 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00028443336486816406 length of segment : 25 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00016927719116210938 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.34844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004932880401611328 length of segment : 32 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1523 time to create 1 rle with old method : 0.002215862274169922 length of segment : 41 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0013661384582519531 length of segment : 28 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0009257793426513672 length of segment : 38 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 32 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004973411560058594 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0010726451873779297 length of segment : 44 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00029754638671875 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00044345855712890625 length of segment : 19 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0010347366333007812 length of segment : 28 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0009608268737792969 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -80.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.00066375732421875 length of segment : 25 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 2506 time to create 1 rle with old method : 0.0033919811248779297 length of segment : 61 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 15 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0005114078521728516 length of segment : 33 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00039076805114746094 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.04766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 18 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1538 time to create 1 rle with old method : 0.002115964889526367 length of segment : 43 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 796 time to create 1 rle with old method : 0.0010771751403808594 length of segment : 29 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0007250308990478516 length of segment : 30 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003631114959716797 length of segment : 21 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1314 time to create 1 rle with old method : 0.001676797866821289 length of segment : 34 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0010828971862792969 length of segment : 35 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 16 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 20 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.0011072158813476562 length of segment : 41 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0011682510375976562 length of segment : 27 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1748 time to create 1 rle with old method : 0.0023279190063476562 length of segment : 86 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001659393310546875 length of segment : 11 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 28 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009679794311523438 length of segment : 32 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.000982522964477539 length of segment : 58 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002357959747314453 length of segment : 16 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1849 time to create 1 rle with old method : 0.002382516860961914 length of segment : 47 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0011899471282958984 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.00042748451232910156 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.75859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 990 time to create 1 rle with old method : 0.0011630058288574219 length of segment : 43 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005249977111816406 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 23 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 46 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002560615539550781 length of segment : 17 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 861 time to create 1 rle with old method : 0.0011601448059082031 length of segment : 40 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.00045490264892578125 length of segment : 38 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003528594970703125 length of segment : 18 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 2505 time to create 1 rle with old method : 0.0032465457916259766 length of segment : 67 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00027298927307128906 length of segment : 20 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0020339488983154297 length of segment : 41 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007777214050292969 length of segment : 38 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006117820739746094 length of segment : 26 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00037026405334472656 length of segment : 20 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.000240325927734375 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.30938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 32 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0013492107391357422 length of segment : 50 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005037784576416016 length of segment : 24 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004832744598388672 length of segment : 22 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1492 time to create 1 rle with old method : 0.0019292831420898438 length of segment : 47 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005075931549072266 length of segment : 21 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00014019012451171875 length of segment : 14 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 926 time to create 1 rle with old method : 0.0011286735534667969 length of segment : 67 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007863044738769531 length of segment : 43 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003638267517089844 length of segment : 20 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006191730499267578 length of segment : 29 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 8 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007236003875732422 length of segment : 32 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 39 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003559589385986328 length of segment : 14 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 72 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00026798248291015625 length of segment : 15 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005018711090087891 length of segment : 21 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1683 time to create 1 rle with old method : 0.0022182464599609375 length of segment : 60 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1830 time to create 1 rle with old method : 0.002337217330932617 length of segment : 53 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 16 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 52 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 29 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 22 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00037550926208496094 length of segment : 16 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1913 time to create 1 rle with old method : 0.002382516860961914 length of segment : 70 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003380775451660156 length of segment : 18 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 27 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 784 time to create 1 rle with old method : 0.0010662078857421875 length of segment : 26 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 715 time to create 1 rle with old method : 0.0009112358093261719 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.53203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007572174072265625 length of segment : 29 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003962516784667969 length of segment : 28 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0008854866027832031 length of segment : 26 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003495216369628906 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0006392002105712891 length of segment : 24 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0011246204376220703 length of segment : 38 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00029397010803222656 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.45781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0008649826049804688 length of segment : 29 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.00060272216796875 length of segment : 21 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 29 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0007617473602294922 length of segment : 22 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0005645751953125 length of segment : 15 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.001188516616821289 length of segment : 24 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006926059722900391 length of segment : 22 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 36 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008599758148193359 length of segment : 40 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0008630752563476562 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.42656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 683 time to create 1 rle with old method : 0.0009183883666992188 length of segment : 61 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 846 time to create 1 rle with old method : 0.0012135505676269531 length of segment : 51 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0013108253479003906 length of segment : 69 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006422996520996094 length of segment : 32 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005562305450439453 length of segment : 30 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005731582641601562 length of segment : 31 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005514621734619141 length of segment : 55 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 16 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0011043548583984375 length of segment : 26 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0007245540618896484 length of segment : 31 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0012602806091308594 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 18 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0008018016815185547 length of segment : 34 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 20 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1862 time to create 1 rle with old method : 0.0028574466705322266 length of segment : 107 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0007305145263671875 length of segment : 27 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001804828643798828 length of segment : 13 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008068084716796875 length of segment : 43 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005428791046142578 length of segment : 27 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 42 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006191730499267578 length of segment : 30 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007753372192382812 length of segment : 25 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006585121154785156 length of segment : 47 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 2808 time to create 1 rle with old method : 0.003662586212158203 length of segment : 96 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007975101470947266 length of segment : 47 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0013797283172607422 length of segment : 74 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 33 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0007741451263427734 length of segment : 27 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010347366333007812 length of segment : 9 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005230903625488281 length of segment : 32 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 16 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 38 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 24 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005946159362792969 length of segment : 31 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 27 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 56 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.0012128353118896484 length of segment : 30 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00034427642822265625 length of segment : 24 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 27146 time to create 1 rle with old method : 0.031830549240112305 length of segment : 129 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 12 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0011665821075439453 length of segment : 43 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0019006729125976562 length of segment : 63 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007863044738769531 length of segment : 38 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 20 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 16 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00010824203491210938 length of segment : 9 time for calcul the mask position with numpy : 0.0003848075866699219 nb_pixel_total : 28153 time to create 1 rle with old method : 0.033440589904785156 length of segment : 131 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0019061565399169922 length of segment : 30 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 15 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 22 time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 35924 time to create 1 rle with old method : 0.04311847686767578 length of segment : 149 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 8331 time to create 1 rle with old method : 0.010707616806030273 length of segment : 76 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 25 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2248 time to create 1 rle with old method : 0.002844572067260742 length of segment : 66 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 3139 time to create 1 rle with old method : 0.004045248031616211 length of segment : 77 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00041937828063964844 length of segment : 11 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00028777122497558594 length of segment : 19 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002961158752441406 length of segment : 20 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 2086 time to create 1 rle with old method : 0.0028057098388671875 length of segment : 61 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.0008311271667480469 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002682209014892578 length of segment : 15 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006892681121826172 length of segment : 20 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003001689910888672 length of segment : 14 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1128 time to create 1 rle with old method : 0.001619577407836914 length of segment : 39 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 19 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1566 time to create 1 rle with old method : 0.0021576881408691406 length of segment : 32 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007452964782714844 length of segment : 22 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007266998291015625 length of segment : 26 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0013053417205810547 length of segment : 40 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0016627311706542969 length of segment : 39 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008482933044433594 length of segment : 27 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.000652313232421875 length of segment : 20 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 22 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1865 time to create 1 rle with old method : 0.002348184585571289 length of segment : 43 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0009672641754150391 length of segment : 38 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0011615753173828125 length of segment : 52 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 10 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0011382102966308594 length of segment : 44 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0008041858673095703 length of segment : 27 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00037217140197753906 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008413791656494141 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.000118255615234375 length of segment : 10 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002968311309814453 length of segment : 17 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006663799285888672 length of segment : 22 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 13148 time to create 1 rle with old method : 0.01700735092163086 length of segment : 63 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 17 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 16 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 15 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1647 time to create 1 rle with old method : 0.002198457717895508 length of segment : 59 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0010447502136230469 length of segment : 84 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005719661712646484 length of segment : 23 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0023849010467529297 length of segment : 34 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006473064422607422 length of segment : 24 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 8486 time to create 1 rle with old method : 0.013907194137573242 length of segment : 91 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 8919 time to create 1 rle with old method : 0.010674715042114258 length of segment : 95 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 8933 time to create 1 rle with old method : 0.010413885116577148 length of segment : 96 Processing 1 images image shape: (240, 160, 3) min: 5.00000 max: 241.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.35388 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Detection mask done ! Trying to reset tf kernel 1690255 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4505 tf kernel not reseted sub process len(results) : 308 len(list_Values) 308 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 308 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9696 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 308 chid ids of type : 4228 Number RLEs to save : 10937 save missing photos in datou_result : time spend for datou_step_exec : 21.037319660186768 time spend to save output : 1.7704627513885498 total time spend for step 1 : 22.807782411575317 step2:brightness Sun Feb 23 02:20:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740273629_1689942_1339169781_7f647e5dabcfd684ce95750c81329fc2.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.011352777481079102 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.01143336296081543 save missing photos in datou_result : time spend for datou_step_exec : 0.4592711925506592 time spend to save output : 0.0268402099609375 total time spend for step 2 : 0.4861114025115967 step3:blur_detection Sun Feb 23 02:20:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740273629_1689942_1339169781_7f647e5dabcfd684ce95750c81329fc2.jpg resize: (1440, 2560) 1339169781 -8.501682013671791 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.012864828109741211 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.012159109115600586 save missing photos in datou_result : time spend for datou_step_exec : 1.6074888706207275 time spend to save output : 0.0305631160736084 total time spend for step 3 : 1.638051986694336 step4:rle_unique_nms_with_priority Sun Feb 23 02:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 308 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 305 nb_hashtags : 7 time to prepare the origin masks : 1.9351756572723389 time for calcul the mask position with numpy : 0.11731672286987305 nb_pixel_total : 3383369 time to create 1 rle with new method : 0.17693686485290527 time for calcul the mask position with numpy : 0.015027761459350586 nb_pixel_total : 145 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.01498270034790039 nb_pixel_total : 2740 time to create 1 rle with old method : 0.0032355785369873047 time for calcul the mask position with numpy : 0.014964103698730469 nb_pixel_total : 238 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.01653313636779785 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005238056182861328 time for calcul the mask position with numpy : 0.015201091766357422 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004215240478515625 time for calcul the mask position with numpy : 0.015130043029785156 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009777545928955078 time for calcul the mask position with numpy : 0.015416145324707031 nb_pixel_total : 1483 time to create 1 rle with old method : 0.0017294883728027344 time for calcul the mask position with numpy : 0.01491093635559082 nb_pixel_total : 200 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.014914512634277344 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007483959197998047 time for calcul the mask position with numpy : 0.014989376068115234 nb_pixel_total : 115 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.014956235885620117 nb_pixel_total : 7828 time to create 1 rle with old method : 0.009027242660522461 time for calcul the mask position with numpy : 0.015575885772705078 nb_pixel_total : 536 time to create 1 rle with old method : 0.0007123947143554688 time for calcul the mask position with numpy : 0.015123844146728516 nb_pixel_total : 2902 time to create 1 rle with old method : 0.0033483505249023438 time for calcul the mask position with numpy : 0.014991283416748047 nb_pixel_total : 1288 time to create 1 rle with old method : 0.0014903545379638672 time for calcul the mask position with numpy : 0.014883041381835938 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.014971733093261719 nb_pixel_total : 16 time to create 1 rle with old method : 5.793571472167969e-05 time for calcul the mask position with numpy : 0.015876054763793945 nb_pixel_total : 292 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.01719832420349121 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.014963388442993164 nb_pixel_total : 19010 time to create 1 rle with old method : 0.021184921264648438 time for calcul the mask position with numpy : 0.014966964721679688 nb_pixel_total : 297 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.01491236686706543 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0011475086212158203 time for calcul the mask position with numpy : 0.014930963516235352 nb_pixel_total : 1849 time to create 1 rle with old method : 0.002161264419555664 time for calcul the mask position with numpy : 0.016020774841308594 nb_pixel_total : 755 time to create 1 rle with old method : 0.0008990764617919922 time for calcul the mask position with numpy : 0.01553797721862793 nb_pixel_total : 86 time to create 1 rle with old method : 0.00014853477478027344 time for calcul the mask position with numpy : 0.015053987503051758 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017244815826416016 time for calcul the mask position with numpy : 0.016883134841918945 nb_pixel_total : 174 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.015538215637207031 nb_pixel_total : 1687 time to create 1 rle with old method : 0.001943826675415039 time for calcul the mask position with numpy : 0.01473689079284668 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002682209014892578 time for calcul the mask position with numpy : 0.014475107192993164 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009157657623291016 time for calcul the mask position with numpy : 0.01486515998840332 nb_pixel_total : 28 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.015011787414550781 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007224082946777344 time for calcul the mask position with numpy : 0.01572561264038086 nb_pixel_total : 733 time to create 1 rle with old method : 0.0008862018585205078 time for calcul the mask position with numpy : 0.015037775039672852 nb_pixel_total : 1682 time to create 1 rle with old method : 0.0019028186798095703 time for calcul the mask position with numpy : 0.01512002944946289 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006308555603027344 time for calcul the mask position with numpy : 0.015093088150024414 nb_pixel_total : 1921 time to create 1 rle with old method : 0.002213001251220703 time for calcul the mask position with numpy : 0.014866113662719727 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.014907121658325195 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0016238689422607422 time for calcul the mask position with numpy : 0.014929533004760742 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.014943361282348633 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.01491999626159668 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003898143768310547 time for calcul the mask position with numpy : 0.014875650405883789 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.014955997467041016 nb_pixel_total : 172 time to create 1 rle with old method : 0.00021028518676757812 time for calcul the mask position with numpy : 0.014934301376342773 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.01495361328125 nb_pixel_total : 278 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.015076637268066406 nb_pixel_total : 667 time to create 1 rle with old method : 0.0007884502410888672 time for calcul the mask position with numpy : 0.015108108520507812 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011420249938964844 time for calcul the mask position with numpy : 0.015303611755371094 nb_pixel_total : 155 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.01513361930847168 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007865428924560547 time for calcul the mask position with numpy : 0.015132665634155273 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003895759582519531 time for calcul the mask position with numpy : 0.015123367309570312 nb_pixel_total : 665 time to create 1 rle with old method : 0.0009200572967529297 time for calcul the mask position with numpy : 0.015124082565307617 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006105899810791016 time for calcul the mask position with numpy : 0.015064239501953125 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003573894500732422 time for calcul the mask position with numpy : 0.015012264251708984 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003490447998046875 time for calcul the mask position with numpy : 0.014912843704223633 nb_pixel_total : 425 time to create 1 rle with old method : 0.00048542022705078125 time for calcul the mask position with numpy : 0.014897346496582031 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008397102355957031 time for calcul the mask position with numpy : 0.014889717102050781 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004696846008300781 time for calcul the mask position with numpy : 0.014967203140258789 nb_pixel_total : 757 time to create 1 rle with old method : 0.0008776187896728516 time for calcul the mask position with numpy : 0.014970541000366211 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.014975786209106445 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.015038013458251953 nb_pixel_total : 2138 time to create 1 rle with old method : 0.00243377685546875 time for calcul the mask position with numpy : 0.015001058578491211 nb_pixel_total : 1478 time to create 1 rle with old method : 0.001682281494140625 time for calcul the mask position with numpy : 0.015058517456054688 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0015101432800292969 time for calcul the mask position with numpy : 0.015168905258178711 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0011639595031738281 time for calcul the mask position with numpy : 0.014904499053955078 nb_pixel_total : 226 time to create 1 rle with old method : 0.00029730796813964844 time for calcul the mask position with numpy : 0.014925241470336914 nb_pixel_total : 12 time to create 1 rle with old method : 3.814697265625e-05 time for calcul the mask position with numpy : 0.014874935150146484 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.01533055305480957 nb_pixel_total : 26 time to create 1 rle with old method : 5.817413330078125e-05 time for calcul the mask position with numpy : 0.015222787857055664 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006039142608642578 time for calcul the mask position with numpy : 0.017528057098388672 nb_pixel_total : 1167 time to create 1 rle with old method : 0.0014007091522216797 time for calcul the mask position with numpy : 0.014906167984008789 nb_pixel_total : 30 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.014947175979614258 nb_pixel_total : 192 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.014860391616821289 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008356571197509766 time for calcul the mask position with numpy : 0.014923572540283203 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005936622619628906 time for calcul the mask position with numpy : 0.015081167221069336 nb_pixel_total : 11083 time to create 1 rle with old method : 0.013853788375854492 time for calcul the mask position with numpy : 0.015107154846191406 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.014911413192749023 nb_pixel_total : 735 time to create 1 rle with old method : 0.000865936279296875 time for calcul the mask position with numpy : 0.01490020751953125 nb_pixel_total : 796 time to create 1 rle with old method : 0.0009548664093017578 time for calcul the mask position with numpy : 0.01497340202331543 nb_pixel_total : 87 time to create 1 rle with old method : 0.00011610984802246094 time for calcul the mask position with numpy : 0.014967679977416992 nb_pixel_total : 194 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.014892578125 nb_pixel_total : 841 time to create 1 rle with old method : 0.0009760856628417969 time for calcul the mask position with numpy : 0.014864683151245117 nb_pixel_total : 248 time to create 1 rle with old method : 0.00030350685119628906 time for calcul the mask position with numpy : 0.01496744155883789 nb_pixel_total : 133 time to create 1 rle with old method : 0.00016164779663085938 time for calcul the mask position with numpy : 0.014898300170898438 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004947185516357422 time for calcul the mask position with numpy : 0.014904022216796875 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009717941284179688 time for calcul the mask position with numpy : 0.014879226684570312 nb_pixel_total : 591 time to create 1 rle with old method : 0.0006861686706542969 time for calcul the mask position with numpy : 0.014948368072509766 nb_pixel_total : 15 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.014919519424438477 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.014992237091064453 nb_pixel_total : 63 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.015039205551147461 nb_pixel_total : 248 time to create 1 rle with old method : 0.00029349327087402344 time for calcul the mask position with numpy : 0.014932394027709961 nb_pixel_total : 896 time to create 1 rle with old method : 0.0010943412780761719 time for calcul the mask position with numpy : 0.01494598388671875 nb_pixel_total : 761 time to create 1 rle with old method : 0.0008981227874755859 time for calcul the mask position with numpy : 0.01487112045288086 nb_pixel_total : 1748 time to create 1 rle with old method : 0.0020363330841064453 time for calcul the mask position with numpy : 0.014969110488891602 nb_pixel_total : 28 time to create 1 rle with old method : 6.246566772460938e-05 time for calcul the mask position with numpy : 0.015518426895141602 nb_pixel_total : 307 time to create 1 rle with old method : 0.00041961669921875 time for calcul the mask position with numpy : 0.015344619750976562 nb_pixel_total : 761 time to create 1 rle with old method : 0.0009102821350097656 time for calcul the mask position with numpy : 0.015013456344604492 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015044212341308594 time for calcul the mask position with numpy : 0.01487278938293457 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.014935731887817383 nb_pixel_total : 176 time to create 1 rle with old method : 0.00026535987854003906 time for calcul the mask position with numpy : 0.014919519424438477 nb_pixel_total : 185 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.015062570571899414 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003733634948730469 time for calcul the mask position with numpy : 0.015065193176269531 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005581378936767578 time for calcul the mask position with numpy : 0.015048742294311523 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0017921924591064453 time for calcul the mask position with numpy : 0.015193700790405273 nb_pixel_total : 557 time to create 1 rle with old method : 0.0006747245788574219 time for calcul the mask position with numpy : 0.014990568161010742 nb_pixel_total : 168 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.014881610870361328 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.014925479888916016 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004315376281738281 time for calcul the mask position with numpy : 0.014941930770874023 nb_pixel_total : 418 time to create 1 rle with old method : 0.00047969818115234375 time for calcul the mask position with numpy : 0.014981746673583984 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003216266632080078 time for calcul the mask position with numpy : 0.01493978500366211 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003063678741455078 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003769397735595703 time for calcul the mask position with numpy : 0.014916419982910156 nb_pixel_total : 1314 time to create 1 rle with old method : 0.001554727554321289 time for calcul the mask position with numpy : 0.014985084533691406 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003573894500732422 time for calcul the mask position with numpy : 0.014907360076904297 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003330707550048828 time for calcul the mask position with numpy : 0.014912605285644531 nb_pixel_total : 670 time to create 1 rle with old method : 0.0007715225219726562 time for calcul the mask position with numpy : 0.014881610870361328 nb_pixel_total : 916 time to create 1 rle with old method : 0.0010883808135986328 time for calcul the mask position with numpy : 0.014838457107543945 nb_pixel_total : 1538 time to create 1 rle with old method : 0.0017583370208740234 time for calcul the mask position with numpy : 0.014913082122802734 nb_pixel_total : 67 time to create 1 rle with old method : 8.988380432128906e-05 time for calcul the mask position with numpy : 0.01489567756652832 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0013096332550048828 time for calcul the mask position with numpy : 0.01491403579711914 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008151531219482422 time for calcul the mask position with numpy : 0.014930009841918945 nb_pixel_total : 868 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.014947891235351562 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001385211944580078 time for calcul the mask position with numpy : 0.014932870864868164 nb_pixel_total : 152 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.014966011047363281 nb_pixel_total : 2506 time to create 1 rle with old method : 0.0029871463775634766 time for calcul the mask position with numpy : 0.015244007110595703 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003662109375 time for calcul the mask position with numpy : 0.015335798263549805 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0020933151245117188 time for calcul the mask position with numpy : 0.014832735061645508 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003790855407714844 time for calcul the mask position with numpy : 0.014953851699829102 nb_pixel_total : 871 time to create 1 rle with old method : 0.001004934310913086 time for calcul the mask position with numpy : 0.014897823333740234 nb_pixel_total : 503 time to create 1 rle with old method : 0.0005855560302734375 time for calcul the mask position with numpy : 0.01489114761352539 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002548694610595703 time for calcul the mask position with numpy : 0.015025854110717773 nb_pixel_total : 419 time to create 1 rle with old method : 0.0004942417144775391 time for calcul the mask position with numpy : 0.015069961547851562 nb_pixel_total : 399 time to create 1 rle with old method : 0.00047969818115234375 time for calcul the mask position with numpy : 0.01493978500366211 nb_pixel_total : 590 time to create 1 rle with old method : 0.0006797313690185547 time for calcul the mask position with numpy : 0.014871597290039062 nb_pixel_total : 856 time to create 1 rle with old method : 0.0009737014770507812 time for calcul the mask position with numpy : 0.014847993850708008 nb_pixel_total : 3032 time to create 1 rle with old method : 0.0033693313598632812 time for calcul the mask position with numpy : 0.014972925186157227 nb_pixel_total : 310 time to create 1 rle with old method : 0.00037980079650878906 time for calcul the mask position with numpy : 0.014880180358886719 nb_pixel_total : 393 time to create 1 rle with old method : 0.00045371055603027344 time for calcul the mask position with numpy : 0.014938116073608398 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007011890411376953 time for calcul the mask position with numpy : 0.014922857284545898 nb_pixel_total : 278 time to create 1 rle with old method : 0.00033545494079589844 time for calcul the mask position with numpy : 0.014924049377441406 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003070831298828125 time for calcul the mask position with numpy : 0.01491546630859375 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005075931549072266 time for calcul the mask position with numpy : 0.014925241470336914 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.01505136489868164 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006842613220214844 time for calcul the mask position with numpy : 0.015217065811157227 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002472400665283203 time for calcul the mask position with numpy : 0.015097618103027344 nb_pixel_total : 404 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.014493703842163086 nb_pixel_total : 171 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.014336347579956055 nb_pixel_total : 204 time to create 1 rle with old method : 0.000240325927734375 time for calcul the mask position with numpy : 0.014919042587280273 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006906986236572266 time for calcul the mask position with numpy : 0.014838695526123047 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.014886617660522461 nb_pixel_total : 1675 time to create 1 rle with old method : 0.0019872188568115234 time for calcul the mask position with numpy : 0.01636815071105957 nb_pixel_total : 2335 time to create 1 rle with old method : 0.002777576446533203 time for calcul the mask position with numpy : 0.014968633651733398 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005598068237304688 time for calcul the mask position with numpy : 0.015169620513916016 nb_pixel_total : 106 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.01708698272705078 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004291534423828125 time for calcul the mask position with numpy : 0.01489567756652832 nb_pixel_total : 846 time to create 1 rle with old method : 0.0009565353393554688 time for calcul the mask position with numpy : 0.014506340026855469 nb_pixel_total : 386 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.014700889587402344 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004928112030029297 time for calcul the mask position with numpy : 0.014841794967651367 nb_pixel_total : 1664 time to create 1 rle with old method : 0.001947164535522461 time for calcul the mask position with numpy : 0.016173362731933594 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001842975616455078 time for calcul the mask position with numpy : 0.01612401008605957 nb_pixel_total : 205 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.014954090118408203 nb_pixel_total : 68 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.014922618865966797 nb_pixel_total : 242 time to create 1 rle with old method : 0.00030517578125 time for calcul the mask position with numpy : 0.014922380447387695 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007624626159667969 time for calcul the mask position with numpy : 0.014911413192749023 nb_pixel_total : 53 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.014891862869262695 nb_pixel_total : 366 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.014946222305297852 nb_pixel_total : 1913 time to create 1 rle with old method : 0.0021631717681884766 time for calcul the mask position with numpy : 0.014923334121704102 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0012438297271728516 time for calcul the mask position with numpy : 0.014940977096557617 nb_pixel_total : 196 time to create 1 rle with old method : 0.00023937225341796875 time for calcul the mask position with numpy : 0.014955997467041016 nb_pixel_total : 173 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.01519918441772461 nb_pixel_total : 190 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.015455484390258789 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006020069122314453 time for calcul the mask position with numpy : 0.015024900436401367 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007605552673339844 time for calcul the mask position with numpy : 0.014899253845214844 nb_pixel_total : 926 time to create 1 rle with old method : 0.0010578632354736328 time for calcul the mask position with numpy : 0.014946222305297852 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.015022039413452148 nb_pixel_total : 861 time to create 1 rle with old method : 0.0010862350463867188 time for calcul the mask position with numpy : 0.015431404113769531 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.015147924423217773 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.014934539794921875 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.014959335327148438 nb_pixel_total : 103 time to create 1 rle with old method : 0.00013017654418945312 time for calcul the mask position with numpy : 0.014913797378540039 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003120899200439453 time for calcul the mask position with numpy : 0.015039682388305664 nb_pixel_total : 249 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.014946460723876953 nb_pixel_total : 684 time to create 1 rle with old method : 0.0008368492126464844 time for calcul the mask position with numpy : 0.015354156494140625 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.01506185531616211 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005259513854980469 time for calcul the mask position with numpy : 0.014439105987548828 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.014534950256347656 nb_pixel_total : 254 time to create 1 rle with old method : 0.00031065940856933594 time for calcul the mask position with numpy : 0.01497793197631836 nb_pixel_total : 23 time to create 1 rle with old method : 5.269050598144531e-05 time for calcul the mask position with numpy : 0.015042543411254883 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007171630859375 time for calcul the mask position with numpy : 0.015032052993774414 nb_pixel_total : 544 time to create 1 rle with old method : 0.0008821487426757812 time for calcul the mask position with numpy : 0.015010356903076172 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.014921426773071289 nb_pixel_total : 586 time to create 1 rle with old method : 0.0006825923919677734 time for calcul the mask position with numpy : 0.014957666397094727 nb_pixel_total : 155 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.014943838119506836 nb_pixel_total : 313 time to create 1 rle with old method : 0.0003757476806640625 time for calcul the mask position with numpy : 0.014894247055053711 nb_pixel_total : 419 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 166 time to create 1 rle with old method : 0.00019931793212890625 time for calcul the mask position with numpy : 0.014912128448486328 nb_pixel_total : 145 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.014931917190551758 nb_pixel_total : 784 time to create 1 rle with old method : 0.000904083251953125 time for calcul the mask position with numpy : 0.014970779418945312 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004153251647949219 time for calcul the mask position with numpy : 0.014962911605834961 nb_pixel_total : 65 time to create 1 rle with old method : 9.34600830078125e-05 time for calcul the mask position with numpy : 0.015300273895263672 nb_pixel_total : 990 time to create 1 rle with old method : 0.0011942386627197266 time for calcul the mask position with numpy : 0.015343427658081055 nb_pixel_total : 244 time to create 1 rle with old method : 0.00032973289489746094 time for calcul the mask position with numpy : 0.015036344528198242 nb_pixel_total : 994 time to create 1 rle with old method : 0.0011165142059326172 time for calcul the mask position with numpy : 0.014876842498779297 nb_pixel_total : 317 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.01487112045288086 nb_pixel_total : 1862 time to create 1 rle with old method : 0.0021495819091796875 time for calcul the mask position with numpy : 0.014844417572021484 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007638931274414062 time for calcul the mask position with numpy : 0.014887332916259766 nb_pixel_total : 1492 time to create 1 rle with old method : 0.001798868179321289 time for calcul the mask position with numpy : 0.01500558853149414 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0012524127960205078 time for calcul the mask position with numpy : 0.015062570571899414 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007073879241943359 time for calcul the mask position with numpy : 0.01489877700805664 nb_pixel_total : 308 time to create 1 rle with old method : 0.00036644935607910156 time for calcul the mask position with numpy : 0.014911174774169922 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005598068237304688 time for calcul the mask position with numpy : 0.014973878860473633 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005457401275634766 time for calcul the mask position with numpy : 0.014912605285644531 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005552768707275391 time for calcul the mask position with numpy : 0.014922857284545898 nb_pixel_total : 400 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.01491236686706543 nb_pixel_total : 2505 time to create 1 rle with old method : 0.0028984546661376953 time for calcul the mask position with numpy : 0.014983892440795898 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.014917612075805664 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005419254302978516 time for calcul the mask position with numpy : 0.014920711517333984 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.014934778213500977 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007193088531494141 time for calcul the mask position with numpy : 0.015194892883300781 nb_pixel_total : 261 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.015355587005615234 nb_pixel_total : 242 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.015045881271362305 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005710124969482422 time for calcul the mask position with numpy : 0.014894485473632812 nb_pixel_total : 345 time to create 1 rle with old method : 0.00041961669921875 time for calcul the mask position with numpy : 0.014879226684570312 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006911754608154297 time for calcul the mask position with numpy : 0.014894723892211914 nb_pixel_total : 854 time to create 1 rle with old method : 0.0010318756103515625 time for calcul the mask position with numpy : 0.015289068222045898 nb_pixel_total : 683 time to create 1 rle with old method : 0.0008258819580078125 time for calcul the mask position with numpy : 0.015166521072387695 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007307529449462891 time for calcul the mask position with numpy : 0.014962196350097656 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006151199340820312 time for calcul the mask position with numpy : 0.014915943145751953 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003631114959716797 time for calcul the mask position with numpy : 0.014861822128295898 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.014954805374145508 nb_pixel_total : 236 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.015027284622192383 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.014924287796020508 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007288455963134766 time for calcul the mask position with numpy : 0.014924287796020508 nb_pixel_total : 161 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.01491236686706543 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005600452423095703 time for calcul the mask position with numpy : 0.014904260635375977 nb_pixel_total : 1830 time to create 1 rle with old method : 0.002089977264404297 time for calcul the mask position with numpy : 0.014970779418945312 nb_pixel_total : 178 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.014929533004760742 nb_pixel_total : 122 time to create 1 rle with old method : 0.00015735626220703125 time for calcul the mask position with numpy : 0.014947175979614258 nb_pixel_total : 398 time to create 1 rle with old method : 0.00046324729919433594 time for calcul the mask position with numpy : 0.01506805419921875 nb_pixel_total : 356 time to create 1 rle with old method : 0.00042939186096191406 time for calcul the mask position with numpy : 0.01495814323425293 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004620552062988281 time for calcul the mask position with numpy : 0.015022516250610352 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006864070892333984 time for calcul the mask position with numpy : 0.015360116958618164 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.015221834182739258 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005779266357421875 time for calcul the mask position with numpy : 0.014972686767578125 nb_pixel_total : 841 time to create 1 rle with old method : 0.0009920597076416016 time for calcul the mask position with numpy : 0.014894962310791016 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002639293670654297 time for calcul the mask position with numpy : 0.01493382453918457 nb_pixel_total : 715 time to create 1 rle with old method : 0.0008313655853271484 time for calcul the mask position with numpy : 0.014946699142456055 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004208087921142578 time for calcul the mask position with numpy : 0.015082120895385742 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.014954566955566406 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002715587615966797 time for calcul the mask position with numpy : 0.014945030212402344 nb_pixel_total : 167 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.015053272247314453 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004515647888183594 time for calcul the mask position with numpy : 0.014978408813476562 nb_pixel_total : 13 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.014916658401489258 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009477138519287109 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0020952224731445312 time for calcul the mask position with numpy : 0.01497197151184082 nb_pixel_total : 598 time to create 1 rle with old method : 0.0006861686706542969 time for calcul the mask position with numpy : 0.015018939971923828 nb_pixel_total : 27146 time to create 1 rle with old method : 0.030791759490966797 time for calcul the mask position with numpy : 0.01692056655883789 nb_pixel_total : 2195 time to create 1 rle with old method : 0.004075765609741211 time for calcul the mask position with numpy : 0.019014596939086914 nb_pixel_total : 525 time to create 1 rle with old method : 0.0009958744049072266 time for calcul the mask position with numpy : 0.019871950149536133 nb_pixel_total : 35741 time to create 1 rle with old method : 0.06746602058410645 time for calcul the mask position with numpy : 0.019204139709472656 nb_pixel_total : 1647 time to create 1 rle with old method : 0.0019481182098388672 time for calcul the mask position with numpy : 0.015272378921508789 nb_pixel_total : 57 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.01549983024597168 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.015228986740112305 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.017657041549682617 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003209114074707031 time for calcul the mask position with numpy : 0.015941143035888672 nb_pixel_total : 16 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.015432357788085938 nb_pixel_total : 603 time to create 1 rle with old method : 0.000743865966796875 time for calcul the mask position with numpy : 0.015033721923828125 nb_pixel_total : 813 time to create 1 rle with old method : 0.0009393692016601562 time for calcul the mask position with numpy : 0.01504063606262207 nb_pixel_total : 955 time to create 1 rle with old method : 0.0011181831359863281 time for calcul the mask position with numpy : 0.014956474304199219 nb_pixel_total : 3139 time to create 1 rle with old method : 0.0036203861236572266 time for calcul the mask position with numpy : 0.014857769012451172 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004444122314453125 time for calcul the mask position with numpy : 0.014924049377441406 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004515647888183594 time for calcul the mask position with numpy : 0.01567983627319336 nb_pixel_total : 16 time to create 1 rle with old method : 3.266334533691406e-05 time for calcul the mask position with numpy : 0.014894247055053711 nb_pixel_total : 436 time to create 1 rle with old method : 0.0005199909210205078 time for calcul the mask position with numpy : 0.014895200729370117 nb_pixel_total : 238 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.014927387237548828 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006706714630126953 time for calcul the mask position with numpy : 0.014989852905273438 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0014564990997314453 time for calcul the mask position with numpy : 0.01497793197631836 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.014928102493286133 nb_pixel_total : 122 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.015055418014526367 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.014958858489990234 nb_pixel_total : 2248 time to create 1 rle with old method : 0.002590656280517578 time for calcul the mask position with numpy : 0.014955282211303711 nb_pixel_total : 255 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.014920949935913086 nb_pixel_total : 192 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.015143871307373047 nb_pixel_total : 880 time to create 1 rle with old method : 0.0011153221130371094 time for calcul the mask position with numpy : 0.015201807022094727 nb_pixel_total : 681 time to create 1 rle with old method : 0.0008883476257324219 time for calcul the mask position with numpy : 0.015584707260131836 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006351470947265625 time for calcul the mask position with numpy : 0.015156269073486328 nb_pixel_total : 2 time to create 1 rle with old method : 2.4557113647460938e-05 time for calcul the mask position with numpy : 0.016524076461791992 nb_pixel_total : 247 time to create 1 rle with old method : 0.00030231475830078125 time for calcul the mask position with numpy : 0.014909744262695312 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002827644348144531 time for calcul the mask position with numpy : 0.014873266220092773 nb_pixel_total : 3 time to create 1 rle with old method : 2.288818359375e-05 time for calcul the mask position with numpy : 0.014924764633178711 nb_pixel_total : 181 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.014959573745727539 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.01493215560913086 nb_pixel_total : 1865 time to create 1 rle with old method : 0.0020897388458251953 time for calcul the mask position with numpy : 0.015027999877929688 nb_pixel_total : 1566 time to create 1 rle with old method : 0.001810312271118164 time for calcul the mask position with numpy : 0.015079498291015625 nb_pixel_total : 174 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.015094757080078125 nb_pixel_total : 1128 time to create 1 rle with old method : 0.0013203620910644531 time for calcul the mask position with numpy : 0.014981508255004883 nb_pixel_total : 374 time to create 1 rle with old method : 0.000457763671875 time for calcul the mask position with numpy : 0.01868581771850586 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005917549133300781 time for calcul the mask position with numpy : 0.015034914016723633 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0013115406036376953 time for calcul the mask position with numpy : 0.015234231948852539 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001742839813232422 time for calcul the mask position with numpy : 0.014418363571166992 nb_pixel_total : 38 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.01423335075378418 nb_pixel_total : 1461 time to create 1 rle with old method : 0.0016357898712158203 time for calcul the mask position with numpy : 0.014407634735107422 nb_pixel_total : 194 time to create 1 rle with old method : 0.0003352165222167969 time for calcul the mask position with numpy : 0.015218257904052734 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007803440093994141 time for calcul the mask position with numpy : 0.015269041061401367 nb_pixel_total : 8486 time to create 1 rle with old method : 0.009810686111450195 time for calcul the mask position with numpy : 0.015085220336914062 nb_pixel_total : 13148 time to create 1 rle with old method : 0.01435542106628418 time for calcul the mask position with numpy : 0.01481008529663086 nb_pixel_total : 8331 time to create 1 rle with old method : 0.009205102920532227 create new chi : 5.314026594161987 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.011577129364013672 batch 1 Loaded 306 chid ids of type : 4230 Number RLEs to save : 21650 TO DO : save crop sub photo not yet done ! save time : 1.5423610210418701 map_output_result : {1339169781: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 1 /1339169781.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01270294189453125 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.046104192733765 time spend to save output : 0.013013362884521484 total time spend for step 4 : 9.059117555618286 step5:crop_condition Sun Feb 23 02:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 306 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 173 About to insert : list_path_to_insert length 173 new photo from crops ! About to upload 173 photos upload in portfolio : 4869462 init cache_photo without model_param we have 173 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273667_1689942 we have uploaded 173 photos in the portfolio 4869462 time of upload the photos Elapsed time : 53.2940092086792 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 4869462 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273721_1689942 we have uploaded 31 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.065820217132568 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273730_1689942 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8015122413635254 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273731_1689942 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2633488178253174 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273733_1689942 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2145123481750488 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740273734_1689942 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6238303184509277 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 213 /1339194918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339194999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339195130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 640 time used for this insertion : 0.33687782287597656 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.46392917633057 time spend to save output : 0.34449052810668945 total time spend for step 5 : 71.80841970443726 step6:thcl Sun Feb 23 02:22:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.00796055793762207 time to convert the images to numpy array : 0.03606557846069336 time to import caffe and check if the image exist : 0.015839815139770508 time to convert the images to numpy array : 0.05262279510498047 time to import caffe and check if the image exist : 0.014766454696655273 time to convert the images to numpy array : 0.06299352645874023 time to import caffe and check if the image exist : 0.019303321838378906 time to convert the images to numpy array : 0.06302976608276367 time to import caffe and check if the image exist : 0.017772912979125977 time to convert the images to numpy array : 0.06748199462890625 time to import caffe and check if the image exist : 0.020105838775634766 time to convert the images to numpy array : 0.0652167797088623 time to import caffe and check if the image exist : 0.020647287368774414 time to convert the images to numpy array : 0.06608319282531738 time to import caffe and check if the image exist : 0.028015613555908203 time to convert the images to numpy array : 0.06005740165710449 time to import caffe and check if the image exist : 0.028941869735717773 time to convert the images to numpy array : 0.060460805892944336 time to import caffe and check if the image exist : 0.01853466033935547 time to convert the images to numpy array : 0.07381296157836914 total time to convert the images to numpy array : 0.3180108070373535 list photo_ids error: [] list photo_ids correct : [1339195116, 1339195117, 1339195118, 1339195119, 1339195120, 1339195121, 1339195122, 1339195123, 1339195124, 1339195125, 1339195126, 1339195127, 1339195128, 1339195129, 1339195130, 1339195050, 1339195051, 1339195052, 1339195053, 1339195054, 1339195055, 1339195056, 1339195057, 1339195058, 1339195059, 1339195060, 1339195061, 1339195062, 1339195063, 1339195064, 1339195065, 1339195066, 1339195067, 1339195068, 1339195069, 1339195070, 1339195071, 1339195028, 1339195029, 1339195030, 1339195031, 1339195032, 1339195033, 1339195034, 1339195035, 1339195036, 1339195037, 1339195038, 1339195039, 1339195040, 1339195041, 1339195042, 1339195043, 1339195044, 1339195045, 1339195046, 1339195047, 1339195048, 1339195049, 1339195072, 1339195073, 1339195074, 1339195075, 1339195076, 1339195077, 1339195078, 1339195079, 1339195080, 1339195081, 1339195082, 1339195083, 1339195084, 1339195085, 1339195086, 1339195087, 1339195088, 1339195089, 1339195090, 1339195091, 1339195092, 1339195093, 1339194918, 1339194919, 1339194920, 1339194921, 1339194922, 1339194923, 1339194924, 1339194925, 1339194926, 1339194927, 1339194928, 1339194929, 1339194930, 1339194931, 1339194932, 1339194933, 1339194934, 1339194935, 1339194936, 1339194937, 1339194938, 1339194939, 1339194984, 1339194985, 1339194986, 1339194987, 1339194988, 1339194989, 1339194990, 1339194991, 1339194992, 1339194993, 1339194994, 1339194995, 1339194996, 1339194997, 1339194998, 1339194999, 1339195000, 1339195001, 1339195002, 1339195003, 1339195004, 1339195005, 1339195006, 1339195007, 1339195008, 1339195009, 1339195010, 1339195011, 1339195012, 1339195013, 1339195014, 1339195015, 1339195016, 1339195017, 1339195018, 1339195019, 1339195020, 1339195021, 1339195022, 1339195023, 1339195024, 1339195025, 1339195026, 1339195027, 1339195094, 1339195095, 1339195096, 1339195097, 1339195098, 1339195099, 1339195100, 1339195101, 1339195102, 1339195103, 1339195104, 1339195105, 1339195106, 1339195107, 1339195108, 1339195109, 1339195110, 1339195111, 1339195112, 1339195113, 1339195114, 1339195115, 1339194962, 1339194963, 1339194964, 1339194965, 1339194966, 1339194967, 1339194968, 1339194969, 1339194970, 1339194971, 1339194972, 1339194973, 1339194974, 1339194975, 1339194976, 1339194977, 1339194978, 1339194979, 1339194980, 1339194981, 1339194982, 1339194983, 1339194940, 1339194941, 1339194942, 1339194943, 1339194944, 1339194945, 1339194946, 1339194947, 1339194948, 1339194949, 1339194950, 1339194951, 1339194952, 1339194953, 1339194954, 1339194955, 1339194956, 1339194957, 1339194958, 1339194959, 1339194960, 1339194961] number of photos to traite : 213 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10374 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.954322338104248 time used to do the prediction : 0.7979168891906738 save descriptor for thcl : 3237 time to traite the descriptors : 1.23488450050354 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1339195116 To insert : 1339195117 To insert : 1339195118 To insert : 1339195119 To insert : 1339195120 To insert : 1339195121 To insert : 1339195122 To insert : 1339195123 To insert : 1339195124 To insert : 1339195125 To insert : 1339195126 To insert : 1339195127 To insert : 1339195128 To insert : 1339195129 To insert : 1339195130 To insert : 1339195050 To insert : 1339195051 To insert : 1339195052 To insert : 1339195053 To insert : 1339195054 To insert : 1339195055 To insert : 1339195056 To insert : 1339195057 To insert : 1339195058 To insert : 1339195059 To insert : 1339195060 To insert : 1339195061 To insert : 1339195062 To insert : 1339195063 To insert : 1339195064 To insert : 1339195065 To insert : 1339195066 To insert : 1339195067 To insert : 1339195068 To insert : 1339195069 To insert : 1339195070 To insert : 1339195071 To insert : 1339195028 To insert : 1339195029 To insert : 1339195030 To insert : 1339195031 To insert : 1339195032 To insert : 1339195033 To insert : 1339195034 To insert : 1339195035 To insert : 1339195036 To insert : 1339195037 To insert : 1339195038 To insert : 1339195039 To insert : 1339195040 To insert : 1339195041 To insert : 1339195042 To insert : 1339195043 To insert : 1339195044 To insert : 1339195045 To insert : 1339195046 To insert : 1339195047 To insert : 1339195048 To insert : 1339195049 To insert : 1339195072 To insert : 1339195073 To insert : 1339195074 To insert : 1339195075 To insert : 1339195076 To insert : 1339195077 To insert : 1339195078 To insert : 1339195079 To insert : 1339195080 To insert : 1339195081 To insert : 1339195082 To insert : 1339195083 To insert : 1339195084 To insert : 1339195085 To insert : 1339195086 To insert : 1339195087 To insert : 1339195088 To insert : 1339195089 To insert : 1339195090 To insert : 1339195091 To insert : 1339195092 To insert : 1339195093 To insert : 1339194918 To insert : 1339194919 To insert : 1339194920 To insert : 1339194921 To insert : 1339194922 To insert : 1339194923 To insert : 1339194924 To insert : 1339194925 To insert : 1339194926 To insert : 1339194927 To insert : 1339194928 To insert : 1339194929 To insert : 1339194930 To insert : 1339194931 To insert : 1339194932 To insert : 1339194933 To insert : 1339194934 To insert : 1339194935 To insert : 1339194936 To insert : 1339194937 To insert : 1339194938 To insert : 1339194939 To insert : 1339194984 To insert : 1339194985 To insert : 1339194986 To insert : 1339194987 To insert : 1339194988 To insert : 1339194989 To insert : 1339194990 To insert : 1339194991 To insert : 1339194992 To insert : 1339194993 To insert : 1339194994 To insert : 1339194995 To insert : 1339194996 To insert : 1339194997 To insert : 1339194998 To insert : 1339194999 To insert : 1339195000 To insert : 1339195001 To insert : 1339195002 To insert : 1339195003 To insert : 1339195004 To insert : 1339195005 To insert : 1339195006 To insert : 1339195007 To insert : 1339195008 To insert : 1339195009 To insert : 1339195010 To insert : 1339195011 To insert : 1339195012 To insert : 1339195013 To insert : 1339195014 To insert : 1339195015 To insert : 1339195016 To insert : 1339195017 To insert : 1339195018 To insert : 1339195019 To insert : 1339195020 To insert : 1339195021 To insert : 1339195022 To insert : 1339195023 To insert : 1339195024 To insert : 1339195025 To insert : 1339195026 To insert : 1339195027 To insert : 1339195094 To insert : 1339195095 To insert : 1339195096 To insert : 1339195097 To insert : 1339195098 To insert : 1339195099 To insert : 1339195100 To insert : 1339195101 To insert : 1339195102 To insert : 1339195103 To insert : 1339195104 To insert : 1339195105 To insert : 1339195106 To insert : 1339195107 To insert : 1339195108 To insert : 1339195109 To insert : 1339195110 To insert : 1339195111 To insert : 1339195112 To insert : 1339195113 To insert : 1339195114 To insert : 1339195115 To insert : 1339194962 To insert : 1339194963 To insert : 1339194964 To insert : 1339194965 To insert : 1339194966 To insert : 1339194967 To insert : 1339194968 To insert : 1339194969 To insert : 1339194970 To insert : 1339194971 To insert : 1339194972 To insert : 1339194973 To insert : 1339194974 To insert : 1339194975 To insert : 1339194976 To insert : 1339194977 To insert : 1339194978 To insert : 1339194979 To insert : 1339194980 To insert : 1339194981 To insert : 1339194982 To insert : 1339194983 To insert : 1339194940 To insert : 1339194941 To insert : 1339194942 To insert : 1339194943 To insert : 1339194944 To insert : 1339194945 To insert : 1339194946 To insert : 1339194947 To insert : 1339194948 To insert : 1339194949 To insert : 1339194950 To insert : 1339194951 To insert : 1339194952 To insert : 1339194953 To insert : 1339194954 To insert : 1339194955 To insert : 1339194956 To insert : 1339194957 To insert : 1339194958 To insert : 1339194959 To insert : 1339194960 To insert : 1339194961 time to insert the descriptors : 54.07838582992554 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 316 time used for this insertion : 0.028928518295288086 save missing photos in datou_result : time spend for datou_step_exec : 61.76758646965027 time spend to save output : 0.8935706615447998 total time spend for step 6 : 62.66115713119507 step7:ventilate_hashtags_in_portfolio Sun Feb 23 02:23:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20754923 get user id for portfolio 20754923 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20754923 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_clair','environnement','Papier','flou','PET_fonce','refus','Carton','papier','mal_croppe','PET_clair','Tetrapak','metal','Film_plastique','PEHD','carton','pet_fonce','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20754923 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_clair','environnement','Papier','flou','PET_fonce','refus','Carton','papier','mal_croppe','PET_clair','Tetrapak','metal','Film_plastique','PEHD','carton','pet_fonce','pehd')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20754923 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_clair','environnement','Papier','flou','PET_fonce','refus','Carton','papier','mal_croppe','PET_clair','Tetrapak','metal','Film_plastique','PEHD','carton','pet_fonce','pehd')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20754923 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_clair','environnement','Papier','flou','PET_fonce','refus','Carton','papier','mal_croppe','PET_clair','Tetrapak','metal','Film_plastique','PEHD','carton','pet_fonce','pehd')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20755385,20755395,20755387,20755393,20755389,20755401,20755391,20755400,20755394,20755396,20755397,20755398,20755402?tags=autre,pet_clair,environnement,papier,flou,pet_fonce,refus,carton,mal_croppe,tetrapak,metal,film_plastique,pehd&datou_id_consolidate=4235&port_consolidate=20754923 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 1 /20754923. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012725830078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.873520612716675 time spend to save output : 0.013727426528930664 total time spend for step 7 : 2.8872480392456055 step8:final Sun Feb 23 02:23:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339169781: ('0.7918666401413643',)} new output for save of step final : {1339169781: ('0.7918666401413643',)} [1339169781] Looping around the photos to save general results len do output : 1 /1339169781.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.050185203552246094 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11995863914489746 time spend to save output : 0.05106353759765625 total time spend for step 8 : 0.1710221767425537 step9:velours_tree Sun Feb 23 02:23:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20755385,20755395,20755387,20755393,20755389,20755401,20755391,20755400,20755394,20755396,20755397,20755398,20755402 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755385 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755395 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755387 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755393 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755389 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755401 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755391 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755400 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755394 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755396 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755397 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755398 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20755402 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 213 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 1 0 3 0 0 0 0 3 0 0 0 5 0 2 1 0 0 5 0 0 0 2 3 2 0 5 1 5 1 1 0 1 0 3 0 1 2 1 2 0 0 4 5 2 2 0 0 1 0 0 0 0 4 0 5 2 0 3 2 5 2 0 0 1 0 3 5 4 0 0 5 2 0 0 0 0 2 4 3 0 2 0 5 0 2 0 0 0 0 2 0 0 0 0 0 1 0 0 0 0 0 1 0 2 0 0 1 0 0 0 5 2 1 0 0 0 2 0 0 0 5 2 5 1 2 5 0 0 5 0 0 5 0 2 0 0 0 0 0 2 4 0 0 0 1 0 3 0 0 4 0 2 0 0 0 0 2 0 1 0 3 5 2 2 5 1 5 1 2 0 0 0 0 3 0 0 0 0 0 4 2 5 5 0 1 5 5 2 4 1 5 1 1 0 4 0 0 5 5 0 0 3 5 0 0 4 2 0 5 3 0 0] Elapsed time: 0.1772778034210205 graph_id used : 79884 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20755385,20755395,20755387,20755393,20755389,20755401,20755391,20755400,20755394,20755396,20755397,20755398,20755402?tags=autre,pet_clair,environnement,papier,flou,pet_fonce,refus,carton,mal_croppe,tetrapak,metal,film_plastique,pehd&datou_id_consolidate=4235&port_consolidate=20754923&tree_id=79884 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 1 /20754923Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012031793594360352 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.5715491771698 time spend to save output : 0.014714479446411133 total time spend for step 9 : 15.586263656616211 step10:send_mail_cod Sun Feb 23 02:23:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf 20755367 change filename to text .change filename to text .imagette207553671740273816 20755377 change filename to text .change filename to text .change filename to text .change filename to text .imagette207553771740273816 20755375 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207553751740273816 20755371 imagette207553711740273818 20755383 change filename to text .imagette207553831740273818 20755373 imagette207553731740273818 20755382 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207553821740273818 20755376 imagette207553761740273819 20755378 imagette207553781740273819 20755379 change filename to text .change filename to text .imagette207553791740273819 20755380 imagette207553801740273819 20755384 imagette207553841740273819 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20754923 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20755385,20755395,20755387,20755393,20755389,20755401,20755391,20755400,20755394,20755396,20755397,20755398,20755402?tags=autre,pet_clair,environnement,papier,flou,pet_fonce,refus,carton,mal_croppe,tetrapak,metal,film_plastique,pehd&datou_id_consolidate=4235&port_consolidate=20754923&tree_id=79884 your option no_mail is active, we will not send the real mail to your client args[1339169781] : ((1339169781, -8.501682013671791, 492609224), (1339169781, 0.26455182283425777, 2107752395), '0.7918666401413643') We are sending mail with results at cod@fotonower.com refus_total : 0.7918666401413643 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20754923 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20754923','results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf','pdf','','0.12','0.7918666401413643') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.025288105010986328 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.979140996932983 time spend to save output : 0.025750160217285156 total time spend for step 10 : 5.0048911571502686 step11:split_time_score Sun Feb 23 02:23:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23022025 20754923 Nombre de photos uploadées : 1 / 23040 (0%) 23022025 20754923 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 23022025 20754923 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.00017333030700683594 elapsed_time : insert_dashboard_record_day_entry 0.03181004524230957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20754922 order by id desc limit 1 Qualite : 0.7918666401413643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20754923_23-02-2025_02_23_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20754923 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20754923 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339169781] Looping around the photos to save general results len do output : 1 /20754923Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2608854') ('4234', '20754923', '1339169781', None, None, None, None, None, '2608854') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012600421905517578 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.048213243484497 time spend to save output : 0.012817144393920898 total time spend for step 11 : 1.061030387878418 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 35.86user 22.65system 3:17.72elapsed 29%CPU (0avgtext+0avgdata 2501204maxresident)k 572704inputs+14176outputs (16227major+3326518minor)pagefaults 0swaps