python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3505163 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2579398'] with mtr_portfolio_ids : ['20476691'] and first list_photo_ids : [] new path : /proc/3505163/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.6108095645904541 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Feb 12 13:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10772 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-12 13:20:31.962747: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-12 13:20:31.987148: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-12 13:20:31.988992: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9f80000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-12 13:20:31.989036: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-12 13:20:31.992598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-12 13:20:32.228180: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x33e136c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-12 13:20:32.228226: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-12 13:20:32.229495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 13:20:32.229861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 13:20:32.232831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 13:20:32.235767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 13:20:32.236143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 13:20:32.238659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 13:20:32.239939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 13:20:32.245008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 13:20:32.246785: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 13:20:32.246856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 13:20:32.247810: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 13:20:32.247832: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 13:20:32.247841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 13:20:32.249223: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9983 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-12 13:20:32.517813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 13:20:32.517921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 13:20:32.517950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 13:20:32.517974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 13:20:32.517998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 13:20:32.518021: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 13:20:32.518044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 13:20:32.518068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 13:20:32.519830: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 13:20:32.521406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 13:20:32.521509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 13:20:32.521540: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 13:20:32.521568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 13:20:32.521594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 13:20:32.521621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 13:20:32.521647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 13:20:32.521673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 13:20:32.523318: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 13:20:32.523359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 13:20:32.523369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 13:20:32.523378: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 13:20:32.524843: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9983 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-12 13:20:39.104491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 13:20:39.291146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.71563 max: 147.54922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.01090240478515625 length of segment : 34 time for calcul the mask position with numpy : 0.0005176067352294922 nb_pixel_total : 18798 time to create 1 rle with old method : 0.05013728141784668 length of segment : 199 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 34 time to create 1 rle with old method : 0.0001518726348876953 length of segment : 4 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0004820823669433594 length of segment : 34 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0003104209899902344 length of segment : 28 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0003571510314941406 length of segment : 32 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 801 time to create 1 rle with old method : 0.0018787384033203125 length of segment : 31 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0003883838653564453 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.45391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00014495849609375 nb_pixel_total : 1850 time to create 1 rle with old method : 0.00426793098449707 length of segment : 50 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 1901 time to create 1 rle with old method : 0.0028247833251953125 length of segment : 43 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0012423992156982422 length of segment : 17 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00018095970153808594 length of segment : 10 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 17 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0006291866302490234 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0011744499206542969 length of segment : 28 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 7100 time to create 1 rle with old method : 0.013784170150756836 length of segment : 99 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 731 time to create 1 rle with old method : 0.002211332321166992 length of segment : 41 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0004067420959472656 length of segment : 13 length of segment : 0 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0011491775512695312 length of segment : 22 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0005638599395751953 length of segment : 48 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.000560760498046875 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.15703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 16 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0015246868133544922 length of segment : 60 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.000728607177734375 length of segment : 42 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 11839 time to create 1 rle with old method : 0.015489578247070312 length of segment : 89 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007796287536621094 length of segment : 26 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.000713348388671875 length of segment : 23 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007407665252685547 length of segment : 23 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0003216266632080078 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0011870861053466797 length of segment : 19 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0009424686431884766 length of segment : 18 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0025739669799804688 length of segment : 167 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 219.00000 molded_images shape: (1, 640, 640, 3) min: -90.59063 max: 90.24453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.21172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0028090476989746094 length of segment : 32 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 2714 time to create 1 rle with old method : 0.004909515380859375 length of segment : 49 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0009002685546875 length of segment : 17 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.00154876708984375 length of segment : 31 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 17 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0008721351623535156 length of segment : 25 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.001043558120727539 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.00047469139099121094 length of segment : 22 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004863739013671875 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.63359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012056827545166016 length of segment : 48 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0009572505950927734 length of segment : 16 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0012068748474121094 length of segment : 39 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0010042190551757812 length of segment : 16 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005950927734375 length of segment : 49 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 2709 time to create 1 rle with old method : 0.00344085693359375 length of segment : 93 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 10 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 748 time to create 1 rle with old method : 0.000990152359008789 length of segment : 34 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.02422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0017080307006835938 length of segment : 97 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 2301 time to create 1 rle with old method : 0.0045871734619140625 length of segment : 144 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1249 time to create 1 rle with old method : 0.0015532970428466797 length of segment : 43 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 42 time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 7288 time to create 1 rle with old method : 0.009061813354492188 length of segment : 308 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.0011413097381591797 length of segment : 39 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0011243820190429688 length of segment : 26 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.0012438297271728516 length of segment : 29 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0010066032409667969 length of segment : 35 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009431838989257812 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0018513202667236328 length of segment : 95 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1224 time to create 1 rle with old method : 0.0016474723815917969 length of segment : 63 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.000431060791015625 length of segment : 31 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 2998 time to create 1 rle with old method : 0.0037593841552734375 length of segment : 267 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00024056434631347656 length of segment : 12 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0007574558258056641 length of segment : 49 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 3550 time to create 1 rle with old method : 0.004525423049926758 length of segment : 195 time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 3515 time to create 1 rle with old method : 0.0043795108795166016 length of segment : 183 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 3854 time to create 1 rle with old method : 0.004777669906616211 length of segment : 211 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 67.20547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0019843578338623047 nb_pixel_total : 106893 time to create 1 rle with old method : 0.13950300216674805 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006592273712158203 length of segment : 33 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0011506080627441406 length of segment : 61 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 3624 time to create 1 rle with old method : 0.004586696624755859 length of segment : 63 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 2650 time to create 1 rle with old method : 0.0035414695739746094 length of segment : 68 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 14 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005602836608886719 length of segment : 30 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007326602935791016 length of segment : 29 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.00077056884765625 length of segment : 30 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 3735 time to create 1 rle with old method : 0.004499673843383789 length of segment : 89 time for calcul the mask position with numpy : 0.000274658203125 nb_pixel_total : 16060 time to create 1 rle with old method : 0.018073558807373047 length of segment : 209 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0009443759918212891 length of segment : 33 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.000469207763671875 length of segment : 20 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006358623504638672 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 9 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006060600280761719 length of segment : 26 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1675 time to create 1 rle with old method : 0.002112865447998047 length of segment : 65 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009186267852783203 length of segment : 86 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005385875701904297 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.15469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 23 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014519691467285156 length of segment : 9 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 10 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.000232696533203125 length of segment : 11 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00048279762268066406 length of segment : 19 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003418922424316406 length of segment : 15 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00016808509826660156 length of segment : 13 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004563331604003906 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020837783813476562 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 924 time to create 1 rle with old method : 0.0012347698211669922 length of segment : 41 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005819797515869141 length of segment : 22 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0013592243194580078 length of segment : 54 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004525184631347656 length of segment : 27 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.00035691261291503906 length of segment : 26 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1104 time to create 1 rle with old method : 0.001451730728149414 length of segment : 62 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.0012249946594238281 length of segment : 42 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0005054473876953125 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.68828 max: 149.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0012121200561523438 length of segment : 34 time for calcul the mask position with numpy : 0.000339508056640625 nb_pixel_total : 22379 time to create 1 rle with old method : 0.02706003189086914 length of segment : 185 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 5 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00022482872009277344 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.18828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 2084 time to create 1 rle with old method : 0.002573251724243164 length of segment : 43 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 10 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1738 time to create 1 rle with old method : 0.0022945404052734375 length of segment : 37 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0009377002716064453 length of segment : 48 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.00103759765625 length of segment : 32 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 1570 time to create 1 rle with old method : 0.0025780200958251953 length of segment : 37 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0013098716735839844 length of segment : 46 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007610321044921875 length of segment : 56 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007147789001464844 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.31328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 6952 time to create 1 rle with old method : 0.00810861587524414 length of segment : 96 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005948543548583984 length of segment : 28 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0008103847503662109 length of segment : 33 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0012538433074951172 length of segment : 32 time for calcul the mask position with numpy : 0.0001201629638671875 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0018525123596191406 length of segment : 110 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003674030303955078 length of segment : 17 time for calcul the mask position with numpy : 0.00017571449279785156 nb_pixel_total : 11801 time to create 1 rle with old method : 0.014202117919921875 length of segment : 91 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0016703605651855469 length of segment : 68 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003631114959716797 length of segment : 21 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0013017654418945312 length of segment : 54 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0008838176727294922 length of segment : 23 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0009434223175048828 length of segment : 26 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003681182861328125 length of segment : 16 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 378 time to create 1 rle with old method : 0.0008518695831298828 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1232 time to create 1 rle with old method : 0.001378774642944336 length of segment : 125 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 951 time to create 1 rle with old method : 0.001178741455078125 length of segment : 96 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0007169246673583984 length of segment : 17 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007369518280029297 length of segment : 20 time for calcul the mask position with numpy : 0.0005602836608886719 nb_pixel_total : 51320 time to create 1 rle with old method : 0.05841970443725586 length of segment : 373 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -83.12578 max: 91.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002143383026123047 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0017838478088378906 length of segment : 28 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 2460 time to create 1 rle with old method : 0.0032126903533935547 length of segment : 48 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 22 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 17 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00011515617370605469 length of segment : 8 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 14495 time to create 1 rle with old method : 0.016821861267089844 length of segment : 151 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009815692901611328 length of segment : 27 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010275840759277344 length of segment : 11 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00012969970703125 length of segment : 9 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0009560585021972656 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.79375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00041556358337402344 length of segment : 16 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 2583 time to create 1 rle with old method : 0.0036263465881347656 length of segment : 129 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.001154184341430664 length of segment : 45 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0008716583251953125 length of segment : 14 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2571 time to create 1 rle with old method : 0.0031371116638183594 length of segment : 68 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0009627342224121094 length of segment : 17 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.000705718994140625 length of segment : 33 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0004134178161621094 length of segment : 10 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006361007690429688 length of segment : 39 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0009350776672363281 length of segment : 34 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0008857250213623047 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0013458728790283203 length of segment : 94 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.001743316650390625 length of segment : 44 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 832 time to create 1 rle with old method : 0.00127410888671875 length of segment : 33 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0010027885437011719 length of segment : 36 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.001094818115234375 length of segment : 35 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0009872913360595703 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004417896270751953 length of segment : 42 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0036711692810058594 length of segment : 102 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0022020339965820312 length of segment : 91 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 3516 time to create 1 rle with old method : 0.004384279251098633 length of segment : 179 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0013895034790039062 length of segment : 46 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 12 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 77.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009450912475585938 nb_pixel_total : 106522 time to create 1 rle with old method : 0.12263655662536621 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 3553 time to create 1 rle with old method : 0.004536867141723633 length of segment : 63 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007059574127197266 length of segment : 33 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 787 time to create 1 rle with old method : 0.0011706352233886719 length of segment : 47 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 2549 time to create 1 rle with old method : 0.003480195999145508 length of segment : 111 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0022635459899902344 length of segment : 72 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005466938018798828 length of segment : 31 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1303 time to create 1 rle with old method : 0.0019118785858154297 length of segment : 74 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.0010216236114501953 length of segment : 32 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 4409 time to create 1 rle with old method : 0.006364583969116211 length of segment : 103 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0009243488311767578 length of segment : 25 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0006017684936523438 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 9 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002887248992919922 length of segment : 10 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0009233951568603516 length of segment : 23 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0005762577056884766 length of segment : 15 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 14 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00022363662719726562 length of segment : 16 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0006115436553955078 length of segment : 20 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002949237823486328 length of segment : 14 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.0002510547637939453 length of segment : 11 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 15 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00014495849609375 length of segment : 9 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.001249074935913086 length of segment : 40 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 21 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 24 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004992485046386719 length of segment : 27 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00036597251892089844 length of segment : 20 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0011830329895019531 length of segment : 39 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0005097389221191406 length of segment : 68 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.68828 max: 148.23281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0011684894561767578 length of segment : 35 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00018787384033203125 length of segment : 32 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 17765 time to create 1 rle with old method : 0.022861242294311523 length of segment : 204 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00014209747314453125 length of segment : 3 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00015974044799804688 length of segment : 25 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.000255584716796875 length of segment : 31 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.49688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 2068 time to create 1 rle with old method : 0.003122568130493164 length of segment : 43 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0008230209350585938 length of segment : 38 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00019693374633789062 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 45 time to create 1 rle with old method : 9.107589721679688e-05 length of segment : 7 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005974769592285156 length of segment : 35 time for calcul the mask position with numpy : 0.0001246929168701172 nb_pixel_total : 2219 time to create 1 rle with old method : 0.0029878616333007812 length of segment : 38 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 32 time to create 1 rle with old method : 7.867813110351562e-05 length of segment : 6 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0009107589721679688 length of segment : 33 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.77422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00019407272338867188 nb_pixel_total : 6883 time to create 1 rle with old method : 0.009641885757446289 length of segment : 97 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00029349327087402344 length of segment : 12 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006165504455566406 length of segment : 28 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 37 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.000993967056274414 length of segment : 28 length of segment : 0 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0006461143493652344 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.37188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0004353523254394531 length of segment : 17 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 10892 time to create 1 rle with old method : 0.012833833694458008 length of segment : 107 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011539459228515625 length of segment : 67 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006895065307617188 length of segment : 49 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003082752227783203 length of segment : 20 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0007050037384033203 length of segment : 24 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0007333755493164062 length of segment : 26 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006847381591796875 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.61953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006852149963378906 length of segment : 17 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007486343383789062 length of segment : 19 time for calcul the mask position with numpy : 0.0006952285766601562 nb_pixel_total : 57339 time to create 1 rle with old method : 0.06984114646911621 length of segment : 370 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -87.27031 max: 90.24453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.31328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0018515586853027344 length of segment : 29 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2457 time to create 1 rle with old method : 0.003210306167602539 length of segment : 49 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005328655242919922 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 23 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 15100 time to create 1 rle with old method : 0.017240047454833984 length of segment : 180 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 8214 time to create 1 rle with old method : 0.009874820709228516 length of segment : 134 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0011148452758789062 length of segment : 33 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.000225067138671875 length of segment : 15 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0012195110321044922 length of segment : 28 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007715225219726562 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.08672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 3633 time to create 1 rle with old method : 0.004820823669433594 length of segment : 170 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0010149478912353516 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005750656127929688 length of segment : 31 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.0012006759643554688 length of segment : 47 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 16 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 675 time to create 1 rle with old method : 0.0010921955108642578 length of segment : 18 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00036144256591796875 length of segment : 37 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 10 time for calcul the mask position with numpy : 0.00015926361083984375 nb_pixel_total : 6236 time to create 1 rle with old method : 0.007741689682006836 length of segment : 164 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 14 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 706 time to create 1 rle with old method : 0.0008480548858642578 length of segment : 33 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 716 time to create 1 rle with old method : 0.0009608268737792969 length of segment : 34 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.87188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 1256 time to create 1 rle with old method : 0.0016896724700927734 length of segment : 74 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0016429424285888672 length of segment : 43 time for calcul the mask position with numpy : 0.00012445449829101562 nb_pixel_total : 2166 time to create 1 rle with old method : 0.0028455257415771484 length of segment : 141 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0011854171752929688 length of segment : 30 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 28 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 889 time to create 1 rle with old method : 0.0011506080627441406 length of segment : 39 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 12032 time to create 1 rle with old method : 0.015218257904052734 length of segment : 341 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.001043558120727539 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0013515949249267578 length of segment : 43 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0007612705230712891 length of segment : 27 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0018970966339111328 length of segment : 85 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00030541419982910156 length of segment : 37 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 3528 time to create 1 rle with old method : 0.004423856735229492 length of segment : 188 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006594657897949219 length of segment : 41 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0017969608306884766 length of segment : 64 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 3701 time to create 1 rle with old method : 0.007040977478027344 length of segment : 200 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.91641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009496212005615234 nb_pixel_total : 105718 time to create 1 rle with old method : 0.14174222946166992 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.23672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005807876586914062 length of segment : 33 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 3523 time to create 1 rle with old method : 0.00432133674621582 length of segment : 62 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007598400115966797 length of segment : 32 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 2513 time to create 1 rle with old method : 0.0035364627838134766 length of segment : 67 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 44 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006539821624755859 length of segment : 26 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007867813110351562 length of segment : 31 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010800361633300781 length of segment : 65 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005395412445068359 length of segment : 22 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005621910095214844 length of segment : 32 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 3404 time to create 1 rle with old method : 0.004361391067504883 length of segment : 128 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009806156158447266 length of segment : 31 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0006420612335205078 length of segment : 33 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006349086761474609 length of segment : 22 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001628398895263672 length of segment : 9 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0003120899200439453 length of segment : 12 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00023436546325683594 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00021696090698242188 length of segment : 12 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001957416534423828 length of segment : 15 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0006618499755859375 length of segment : 19 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00020813941955566406 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.20156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0008211135864257812 length of segment : 21 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.001819610595703125 length of segment : 41 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0018665790557861328 length of segment : 57 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0008046627044677734 length of segment : 24 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0006155967712402344 length of segment : 30 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015354156494140625 length of segment : 10 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.0012083053588867188 length of segment : 44 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 56 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.73906 max: 147.54922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 855 time to create 1 rle with old method : 0.0016338825225830078 length of segment : 37 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00018477439880371094 length of segment : 27 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 13796 time to create 1 rle with old method : 0.023627042770385742 length of segment : 205 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00019121170043945312 length of segment : 22 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 21 time to create 1 rle with old method : 0.0001354217529296875 length of segment : 5 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 31 time to create 1 rle with old method : 0.00012183189392089844 length of segment : 3 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.001512765884399414 length of segment : 32 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 2037 time to create 1 rle with old method : 0.003717184066772461 length of segment : 48 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 795 time to create 1 rle with old method : 0.0015790462493896484 length of segment : 49 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 2044 time to create 1 rle with old method : 0.0036916732788085938 length of segment : 38 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002484321594238281 length of segment : 11 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1719 time to create 1 rle with old method : 0.002999544143676758 length of segment : 71 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.90703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 6627 time to create 1 rle with old method : 0.007958412170410156 length of segment : 95 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007154941558837891 length of segment : 31 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008528232574462891 length of segment : 33 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 1343 time to create 1 rle with old method : 0.0020284652709960938 length of segment : 48 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 11 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0018663406372070312 length of segment : 34 length of segment : 0 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007450580596923828 length of segment : 22 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.00055694580078125 length of segment : 28 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009770393371582031 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.51641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00037026405334472656 length of segment : 17 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007731914520263672 length of segment : 48 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 11765 time to create 1 rle with old method : 0.013758420944213867 length of segment : 91 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0007417201995849609 length of segment : 25 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009109973907470703 length of segment : 56 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.47891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0013382434844970703 length of segment : 127 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007269382476806641 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0007381439208984375 length of segment : 18 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0012013912200927734 length of segment : 87 time for calcul the mask position with numpy : 0.0006427764892578125 nb_pixel_total : 59487 time to create 1 rle with old method : 0.06887555122375488 length of segment : 301 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -84.54766 max: 89.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.57500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0018944740295410156 length of segment : 32 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.000598907470703125 length of segment : 24 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2514 time to create 1 rle with old method : 0.003336668014526367 length of segment : 47 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005640983581542969 length of segment : 19 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.000286102294921875 length of segment : 17 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.001321554183959961 length of segment : 32 time for calcul the mask position with numpy : 0.0002758502960205078 nb_pixel_total : 16558 time to create 1 rle with old method : 0.019535541534423828 length of segment : 184 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009489059448242188 length of segment : 38 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 21 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006902217864990234 length of segment : 29 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 5700 time to create 1 rle with old method : 0.006898164749145508 length of segment : 86 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.0001232624053955078 length of segment : 14 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009891986846923828 length of segment : 28 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1569 time to create 1 rle with old method : 0.002034902572631836 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0014827251434326172 length of segment : 49 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 611 time to create 1 rle with old method : 0.0009851455688476562 length of segment : 16 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0023534297943115234 length of segment : 52 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00036334991455078125 length of segment : 37 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0004394054412841797 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0010116100311279297 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007634162902832031 length of segment : 34 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0006260871887207031 length of segment : 38 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 688 time to create 1 rle with old method : 0.0010709762573242188 length of segment : 32 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003478527069091797 length of segment : 9 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0009479522705078125 length of segment : 31 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0009510517120361328 length of segment : 30 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0022993087768554688 length of segment : 90 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1595 time to create 1 rle with old method : 0.0020465850830078125 length of segment : 114 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 914 time to create 1 rle with old method : 0.0015156269073486328 length of segment : 88 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1276 time to create 1 rle with old method : 0.0016155242919921875 length of segment : 42 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1446 time to create 1 rle with old method : 0.0018694400787353516 length of segment : 142 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 41 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0011708736419677734 length of segment : 29 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0010645389556884766 length of segment : 37 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003037452697753906 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0016665458679199219 length of segment : 46 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 3359 time to create 1 rle with old method : 0.006675004959106445 length of segment : 182 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 69.20547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010666847229003906 nb_pixel_total : 106704 time to create 1 rle with old method : 0.1221165657043457 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.86172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 35 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 3695 time to create 1 rle with old method : 0.004589557647705078 length of segment : 63 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0014472007751464844 length of segment : 57 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.000713348388671875 length of segment : 30 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002088308334350586 length of segment : 72 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 2134 time to create 1 rle with old method : 0.0028727054595947266 length of segment : 79 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006580352783203125 length of segment : 33 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 14 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3775 time to create 1 rle with old method : 0.004720926284790039 length of segment : 110 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0008165836334228516 length of segment : 35 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00047016143798828125 length of segment : 19 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0021500587463378906 length of segment : 60 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004820823669433594 length of segment : 21 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 24 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007767677307128906 length of segment : 29 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 2424 time to create 1 rle with old method : 0.003165721893310547 length of segment : 68 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 9 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002961158752441406 length of segment : 11 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 22 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001957416534423828 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002014636993408203 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00041937828063964844 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020074844360351562 length of segment : 13 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.96719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0005698204040527344 length of segment : 22 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 907 time to create 1 rle with old method : 0.001180410385131836 length of segment : 41 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 33 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.00048732757568359375 length of segment : 21 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 10 time to create 1 rle with old method : 3.647804260253906e-05 length of segment : 5 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014209747314453125 length of segment : 23 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Detection mask done ! Trying to reset tf kernel 3505753 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5483 tf kernel not reseted sub process len(results) : 409 len(list_Values) 409 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 409 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10772 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 409 chid ids of type : 4228 Number RLEs to save : 20488 save missing photos in datou_result : time spend for datou_step_exec : 27.969422101974487 time spend to save output : 1.51090669631958 total time spend for step 1 : 29.480328798294067 step2:brightness Wed Feb 12 13:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739362828_3505163_1337091193_a152772647d8e33959414153866a6312.jpg treat image : temp/1739362828_3505163_1337091189_0ad934284872d454fb04008094ad0af1.jpg treat image : temp/1739362828_3505163_1337091092_b74b9be9bbd824056038ea09d7f258a6.jpg treat image : temp/1739362828_3505163_1337091024_2d9e49b4a4f6ecb1842beb7afdb00a87.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.012516260147094727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.011255741119384766 save missing photos in datou_result : time spend for datou_step_exec : 0.9169223308563232 time spend to save output : 0.027991294860839844 total time spend for step 2 : 0.9449136257171631 step3:blur_detection Wed Feb 12 13:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739362828_3505163_1337091193_a152772647d8e33959414153866a6312.jpg resize: (1080, 1920) 1337091193 -7.759898867685712 treat image : temp/1739362828_3505163_1337091189_0ad934284872d454fb04008094ad0af1.jpg resize: (1080, 1920) 1337091189 -7.772766960336253 treat image : temp/1739362828_3505163_1337091092_b74b9be9bbd824056038ea09d7f258a6.jpg resize: (1080, 1920) 1337091092 -7.769749278832485 treat image : temp/1739362828_3505163_1337091024_2d9e49b4a4f6ecb1842beb7afdb00a87.jpg resize: (1080, 1920) 1337091024 -7.773260842275313 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.012577056884765625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01115727424621582 save missing photos in datou_result : time spend for datou_step_exec : 3.2041385173797607 time spend to save output : 0.028577804565429688 total time spend for step 3 : 3.2327163219451904 step4:rle_unique_nms_with_priority Wed Feb 12 13:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 409 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 105 nb_hashtags : 7 time to prepare the origin masks : 1.0356261730194092 time for calcul the mask position with numpy : 0.023469209671020508 nb_pixel_total : 1843723 time to create 1 rle with new method : 0.049453020095825195 time for calcul the mask position with numpy : 0.008537054061889648 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.00830388069152832 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0016396045684814453 time for calcul the mask position with numpy : 0.00828242301940918 nb_pixel_total : 1901 time to create 1 rle with old method : 0.0022830963134765625 time for calcul the mask position with numpy : 0.008270502090454102 nb_pixel_total : 139 time to create 1 rle with old method : 0.00017976760864257812 time for calcul the mask position with numpy : 0.008364677429199219 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.00819087028503418 nb_pixel_total : 14 time to create 1 rle with old method : 2.765655517578125e-05 time for calcul the mask position with numpy : 0.008109331130981445 nb_pixel_total : 506 time to create 1 rle with old method : 0.0005965232849121094 time for calcul the mask position with numpy : 0.00845193862915039 nb_pixel_total : 838 time to create 1 rle with old method : 0.0010356903076171875 time for calcul the mask position with numpy : 0.008317708969116211 nb_pixel_total : 59 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.008380413055419922 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.0083160400390625 nb_pixel_total : 111 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.008188962936401367 nb_pixel_total : 260 time to create 1 rle with old method : 0.00032591819763183594 time for calcul the mask position with numpy : 0.007814407348632812 nb_pixel_total : 60 time to create 1 rle with old method : 7.653236389160156e-05 time for calcul the mask position with numpy : 0.00826716423034668 nb_pixel_total : 45 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.008151531219482422 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.008570671081542969 nb_pixel_total : 14 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.010028839111328125 nb_pixel_total : 34 time to create 1 rle with old method : 8.0108642578125e-05 time for calcul the mask position with numpy : 0.01030874252319336 nb_pixel_total : 1850 time to create 1 rle with old method : 0.00312042236328125 time for calcul the mask position with numpy : 0.011748313903808594 nb_pixel_total : 18798 time to create 1 rle with old method : 0.030186891555786133 time for calcul the mask position with numpy : 0.013314962387084961 nb_pixel_total : 782 time to create 1 rle with old method : 0.0010023117065429688 time for calcul the mask position with numpy : 0.011210441589355469 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003845691680908203 time for calcul the mask position with numpy : 0.009325504302978516 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004832744598388672 time for calcul the mask position with numpy : 0.008249521255493164 nb_pixel_total : 731 time to create 1 rle with old method : 0.0008931159973144531 time for calcul the mask position with numpy : 0.008054018020629883 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005776882171630859 time for calcul the mask position with numpy : 0.008098840713500977 nb_pixel_total : 183 time to create 1 rle with old method : 0.00025200843811035156 time for calcul the mask position with numpy : 0.008203268051147461 nb_pixel_total : 383 time to create 1 rle with old method : 0.00047779083251953125 time for calcul the mask position with numpy : 0.008276700973510742 nb_pixel_total : 7100 time to create 1 rle with old method : 0.008397579193115234 time for calcul the mask position with numpy : 0.008283376693725586 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005800724029541016 time for calcul the mask position with numpy : 0.008327007293701172 nb_pixel_total : 16 time to create 1 rle with old method : 5.650520324707031e-05 time for calcul the mask position with numpy : 0.0084686279296875 nb_pixel_total : 11839 time to create 1 rle with old method : 0.013406991958618164 time for calcul the mask position with numpy : 0.008134126663208008 nb_pixel_total : 17 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.008302688598632812 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006229877471923828 time for calcul the mask position with numpy : 0.008576154708862305 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.008174419403076172 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007076263427734375 time for calcul the mask position with numpy : 0.00822901725769043 nb_pixel_total : 378 time to create 1 rle with old method : 0.00047969818115234375 time for calcul the mask position with numpy : 0.008237361907958984 nb_pixel_total : 1820 time to create 1 rle with old method : 0.002126932144165039 time for calcul the mask position with numpy : 0.008332014083862305 nb_pixel_total : 902 time to create 1 rle with old method : 0.0010576248168945312 time for calcul the mask position with numpy : 0.008015632629394531 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005381107330322266 time for calcul the mask position with numpy : 0.008274555206298828 nb_pixel_total : 304 time to create 1 rle with old method : 0.00038743019104003906 time for calcul the mask position with numpy : 0.008324623107910156 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0014429092407226562 time for calcul the mask position with numpy : 0.007985830307006836 nb_pixel_total : 748 time to create 1 rle with old method : 0.0008361339569091797 time for calcul the mask position with numpy : 0.00932931900024414 nb_pixel_total : 894 time to create 1 rle with old method : 0.0013277530670166016 time for calcul the mask position with numpy : 0.009433507919311523 nb_pixel_total : 2 time to create 1 rle with old method : 2.86102294921875e-05 time for calcul the mask position with numpy : 0.008000373840332031 nb_pixel_total : 7288 time to create 1 rle with old method : 0.008664131164550781 time for calcul the mask position with numpy : 0.008308172225952148 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007989406585693359 time for calcul the mask position with numpy : 0.007913351058959961 nb_pixel_total : 1249 time to create 1 rle with old method : 0.0013995170593261719 time for calcul the mask position with numpy : 0.008284807205200195 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002117156982421875 time for calcul the mask position with numpy : 0.00803995132446289 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009531974792480469 time for calcul the mask position with numpy : 0.007977724075317383 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009050369262695312 time for calcul the mask position with numpy : 0.008301258087158203 nb_pixel_total : 254 time to create 1 rle with old method : 0.000331878662109375 time for calcul the mask position with numpy : 0.008215188980102539 nb_pixel_total : 353 time to create 1 rle with old method : 0.0004737377166748047 time for calcul the mask position with numpy : 0.008021116256713867 nb_pixel_total : 3550 time to create 1 rle with old method : 0.004052162170410156 time for calcul the mask position with numpy : 0.008172035217285156 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004200935363769531 time for calcul the mask position with numpy : 0.008132219314575195 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0014264583587646484 time for calcul the mask position with numpy : 0.007895231246948242 nb_pixel_total : 333 time to create 1 rle with old method : 0.0003733634948730469 time for calcul the mask position with numpy : 0.008142709732055664 nb_pixel_total : 2301 time to create 1 rle with old method : 0.0025177001953125 time for calcul the mask position with numpy : 0.008279561996459961 nb_pixel_total : 930 time to create 1 rle with old method : 0.001087188720703125 time for calcul the mask position with numpy : 0.008143186569213867 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010271072387695312 time for calcul the mask position with numpy : 0.008131980895996094 nb_pixel_total : 2998 time to create 1 rle with old method : 0.003569364547729492 time for calcul the mask position with numpy : 0.007923126220703125 nb_pixel_total : 341 time to create 1 rle with old method : 0.0003974437713623047 time for calcul the mask position with numpy : 0.00800776481628418 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0016200542449951172 time for calcul the mask position with numpy : 0.008613824844360352 nb_pixel_total : 327 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.008177042007446289 nb_pixel_total : 112 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.00809788703918457 nb_pixel_total : 134 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.00818014144897461 nb_pixel_total : 2714 time to create 1 rle with old method : 0.0033042430877685547 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 586 time to create 1 rle with old method : 0.0006966590881347656 time for calcul the mask position with numpy : 0.008533477783203125 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0018055438995361328 time for calcul the mask position with numpy : 0.008442401885986328 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005619525909423828 time for calcul the mask position with numpy : 0.008455514907836914 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.009512901306152344 nb_pixel_total : 106893 time to create 1 rle with old method : 0.12076473236083984 time for calcul the mask position with numpy : 0.00825357437133789 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.008970499038696289 nb_pixel_total : 3624 time to create 1 rle with old method : 0.004296541213989258 time for calcul the mask position with numpy : 0.009075641632080078 nb_pixel_total : 1542 time to create 1 rle with old method : 0.0025756359100341797 time for calcul the mask position with numpy : 0.009694814682006836 nb_pixel_total : 113 time to create 1 rle with old method : 0.00020551681518554688 time for calcul the mask position with numpy : 0.009684324264526367 nb_pixel_total : 124 time to create 1 rle with old method : 0.00022101402282714844 time for calcul the mask position with numpy : 0.00964212417602539 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002186298370361328 time for calcul the mask position with numpy : 0.009639501571655273 nb_pixel_total : 432 time to create 1 rle with old method : 0.0007112026214599609 time for calcul the mask position with numpy : 0.00963449478149414 nb_pixel_total : 924 time to create 1 rle with old method : 0.0014851093292236328 time for calcul the mask position with numpy : 0.009682893753051758 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.009639501571655273 nb_pixel_total : 26 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.00909733772277832 nb_pixel_total : 12129 time to create 1 rle with old method : 0.013978958129882812 time for calcul the mask position with numpy : 0.008126258850097656 nb_pixel_total : 557 time to create 1 rle with old method : 0.0006153583526611328 time for calcul the mask position with numpy : 0.00838017463684082 nb_pixel_total : 3437 time to create 1 rle with old method : 0.003970623016357422 time for calcul the mask position with numpy : 0.008503437042236328 nb_pixel_total : 165 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.008189201354980469 nb_pixel_total : 175 time to create 1 rle with old method : 0.00019741058349609375 time for calcul the mask position with numpy : 0.009176492691040039 nb_pixel_total : 736 time to create 1 rle with old method : 0.0009710788726806641 time for calcul the mask position with numpy : 0.00946807861328125 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006282329559326172 time for calcul the mask position with numpy : 0.008195877075195312 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006365776062011719 time for calcul the mask position with numpy : 0.008986473083496094 nb_pixel_total : 318 time to create 1 rle with old method : 0.0005278587341308594 time for calcul the mask position with numpy : 0.009115219116210938 nb_pixel_total : 214 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.00822758674621582 nb_pixel_total : 2645 time to create 1 rle with old method : 0.003077983856201172 time for calcul the mask position with numpy : 0.009830474853515625 nb_pixel_total : 100 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.008396625518798828 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004413127899169922 time for calcul the mask position with numpy : 0.008396148681640625 nb_pixel_total : 73 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.008320093154907227 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005412101745605469 time for calcul the mask position with numpy : 0.008301258087158203 nb_pixel_total : 409 time to create 1 rle with old method : 0.00045037269592285156 time for calcul the mask position with numpy : 0.008443593978881836 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.00841975212097168 nb_pixel_total : 239 time to create 1 rle with old method : 0.00028896331787109375 time for calcul the mask position with numpy : 0.008317708969116211 nb_pixel_total : 321 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.008202552795410156 nb_pixel_total : 1007 time to create 1 rle with old method : 0.0012059211730957031 time for calcul the mask position with numpy : 0.008358001708984375 nb_pixel_total : 247 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.008182525634765625 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005171298980712891 time for calcul the mask position with numpy : 0.008336782455444336 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005338191986083984 time for calcul the mask position with numpy : 0.008247613906860352 nb_pixel_total : 318 time to create 1 rle with old method : 0.00039267539978027344 time for calcul the mask position with numpy : 0.008056879043579102 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003688335418701172 create new chi : 1.261221170425415 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006957292556762695 batch 1 Loaded 106 chid ids of type : 4230 Number RLEs to save : 10758 TO DO : save crop sub photo not yet done ! save time : 0.7091066837310791 nb_obj : 96 nb_hashtags : 7 time to prepare the origin masks : 1.9742164611816406 time for calcul the mask position with numpy : 0.03662729263305664 nb_pixel_total : 1797037 time to create 1 rle with new method : 0.06030845642089844 time for calcul the mask position with numpy : 0.0107574462890625 nb_pixel_total : 135 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0014770030975341797 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 1232 time to create 1 rle with old method : 0.0014519691467285156 time for calcul the mask position with numpy : 0.006101846694946289 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006015300750732422 time for calcul the mask position with numpy : 0.006280660629272461 nb_pixel_total : 1570 time to create 1 rle with old method : 0.001840829849243164 time for calcul the mask position with numpy : 0.00654292106628418 nb_pixel_total : 399 time to create 1 rle with old method : 0.000507354736328125 time for calcul the mask position with numpy : 0.0063169002532958984 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.006837606430053711 nb_pixel_total : 51320 time to create 1 rle with old method : 0.058133840560913086 time for calcul the mask position with numpy : 0.006023406982421875 nb_pixel_total : 874 time to create 1 rle with old method : 0.001081228256225586 time for calcul the mask position with numpy : 0.005713701248168945 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007073879241943359 time for calcul the mask position with numpy : 0.006043672561645508 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.006108999252319336 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008404254913330078 time for calcul the mask position with numpy : 0.005880117416381836 nb_pixel_total : 53 time to create 1 rle with old method : 9.822845458984375e-05 time for calcul the mask position with numpy : 0.005869865417480469 nb_pixel_total : 2084 time to create 1 rle with old method : 0.0025701522827148438 time for calcul the mask position with numpy : 0.006368875503540039 nb_pixel_total : 22379 time to create 1 rle with old method : 0.025026559829711914 time for calcul the mask position with numpy : 0.006390571594238281 nb_pixel_total : 846 time to create 1 rle with old method : 0.0010333061218261719 time for calcul the mask position with numpy : 0.005911827087402344 nb_pixel_total : 181 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.005826711654663086 nb_pixel_total : 1738 time to create 1 rle with old method : 0.0019512176513671875 time for calcul the mask position with numpy : 0.005832672119140625 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007131099700927734 time for calcul the mask position with numpy : 0.006192207336425781 nb_pixel_total : 248 time to create 1 rle with old method : 0.00048160552978515625 time for calcul the mask position with numpy : 0.006255388259887695 nb_pixel_total : 951 time to create 1 rle with old method : 0.0011744499206542969 time for calcul the mask position with numpy : 0.006185770034790039 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009031295776367188 time for calcul the mask position with numpy : 0.006185770034790039 nb_pixel_total : 1009 time to create 1 rle with old method : 0.001252889633178711 time for calcul the mask position with numpy : 0.00601649284362793 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009708404541015625 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 23 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.008655786514282227 nb_pixel_total : 400 time to create 1 rle with old method : 0.0009524822235107422 time for calcul the mask position with numpy : 0.009671688079833984 nb_pixel_total : 21 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.005996227264404297 nb_pixel_total : 6952 time to create 1 rle with old method : 0.007736921310424805 time for calcul the mask position with numpy : 0.006314277648925781 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005924701690673828 time for calcul the mask position with numpy : 0.005982398986816406 nb_pixel_total : 11801 time to create 1 rle with old method : 0.013728857040405273 time for calcul the mask position with numpy : 0.006720304489135742 nb_pixel_total : 41 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.005961179733276367 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006096363067626953 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.00643157958984375 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007739067077636719 time for calcul the mask position with numpy : 0.006140947341918945 nb_pixel_total : 2583 time to create 1 rle with old method : 0.0031397342681884766 time for calcul the mask position with numpy : 0.006026506423950195 nb_pixel_total : 2571 time to create 1 rle with old method : 0.0031888484954833984 time for calcul the mask position with numpy : 0.006008148193359375 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.006110429763793945 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011615753173828125 time for calcul the mask position with numpy : 0.006398677825927734 nb_pixel_total : 702 time to create 1 rle with old method : 0.0008616447448730469 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 1 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.005792379379272461 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005698204040527344 time for calcul the mask position with numpy : 0.006046295166015625 nb_pixel_total : 770 time to create 1 rle with old method : 0.0009214878082275391 time for calcul the mask position with numpy : 0.00647735595703125 nb_pixel_total : 68 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.005822420120239258 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006070137023925781 time for calcul the mask position with numpy : 0.006010770797729492 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0014622211456298828 time for calcul the mask position with numpy : 0.006011247634887695 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002002716064453125 time for calcul the mask position with numpy : 0.006042003631591797 nb_pixel_total : 832 time to create 1 rle with old method : 0.0010707378387451172 time for calcul the mask position with numpy : 0.006146669387817383 nb_pixel_total : 223 time to create 1 rle with old method : 0.00029778480529785156 time for calcul the mask position with numpy : 0.006190299987792969 nb_pixel_total : 727 time to create 1 rle with old method : 0.0007805824279785156 time for calcul the mask position with numpy : 0.005890607833862305 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001690387725830078 time for calcul the mask position with numpy : 0.00619196891784668 nb_pixel_total : 3516 time to create 1 rle with old method : 0.004019737243652344 time for calcul the mask position with numpy : 0.0062334537506103516 nb_pixel_total : 338 time to create 1 rle with old method : 0.00042700767517089844 time for calcul the mask position with numpy : 0.008880376815795898 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007481575012207031 time for calcul the mask position with numpy : 0.0060465335845947266 nb_pixel_total : 954 time to create 1 rle with old method : 0.0011124610900878906 time for calcul the mask position with numpy : 0.00579524040222168 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.005732059478759766 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003516674041748047 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.006320476531982422 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0018322467803955078 time for calcul the mask position with numpy : 0.0058329105377197266 nb_pixel_total : 288 time to create 1 rle with old method : 0.00035452842712402344 time for calcul the mask position with numpy : 0.005780220031738281 nb_pixel_total : 44 time to create 1 rle with old method : 7.43865966796875e-05 time for calcul the mask position with numpy : 0.006183147430419922 nb_pixel_total : 60 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.006215810775756836 nb_pixel_total : 6 time to create 1 rle with old method : 3.123283386230469e-05 time for calcul the mask position with numpy : 0.005949497222900391 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001456737518310547 time for calcul the mask position with numpy : 0.00578761100769043 nb_pixel_total : 2460 time to create 1 rle with old method : 0.002780437469482422 time for calcul the mask position with numpy : 0.005941867828369141 nb_pixel_total : 13231 time to create 1 rle with old method : 0.014643192291259766 time for calcul the mask position with numpy : 0.006083965301513672 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0015342235565185547 time for calcul the mask position with numpy : 0.006956338882446289 nb_pixel_total : 106522 time to create 1 rle with old method : 0.11263823509216309 time for calcul the mask position with numpy : 0.006002187728881836 nb_pixel_total : 84 time to create 1 rle with old method : 0.00011110305786132812 time for calcul the mask position with numpy : 0.005911827087402344 nb_pixel_total : 3553 time to create 1 rle with old method : 0.004096269607543945 time for calcul the mask position with numpy : 0.006172657012939453 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0018780231475830078 time for calcul the mask position with numpy : 0.005755901336669922 nb_pixel_total : 212 time to create 1 rle with old method : 0.00027942657470703125 time for calcul the mask position with numpy : 0.005976438522338867 nb_pixel_total : 787 time to create 1 rle with old method : 0.0009655952453613281 time for calcul the mask position with numpy : 0.00641179084777832 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.005773067474365234 nb_pixel_total : 139 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.005861997604370117 nb_pixel_total : 119 time to create 1 rle with old method : 0.00016069412231445312 time for calcul the mask position with numpy : 0.005845069885253906 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011081695556640625 time for calcul the mask position with numpy : 0.006070375442504883 nb_pixel_total : 23 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.0061719417572021484 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.005742311477661133 nb_pixel_total : 4409 time to create 1 rle with old method : 0.0048024654388427734 time for calcul the mask position with numpy : 0.005938291549682617 nb_pixel_total : 168 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.005863189697265625 nb_pixel_total : 929 time to create 1 rle with old method : 0.001149892807006836 time for calcul the mask position with numpy : 0.005982160568237305 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005526542663574219 time for calcul the mask position with numpy : 0.005692243576049805 nb_pixel_total : 2549 time to create 1 rle with old method : 0.003080606460571289 time for calcul the mask position with numpy : 0.0067272186279296875 nb_pixel_total : 379 time to create 1 rle with old method : 0.0006666183471679688 time for calcul the mask position with numpy : 0.006599903106689453 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.0064432621002197266 nb_pixel_total : 353 time to create 1 rle with old method : 0.0006091594696044922 time for calcul the mask position with numpy : 0.006560325622558594 nb_pixel_total : 723 time to create 1 rle with old method : 0.0012536048889160156 time for calcul the mask position with numpy : 0.006524085998535156 nb_pixel_total : 388 time to create 1 rle with old method : 0.000675201416015625 time for calcul the mask position with numpy : 0.006762266159057617 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005521774291992188 time for calcul the mask position with numpy : 0.006524085998535156 nb_pixel_total : 347 time to create 1 rle with old method : 0.0006053447723388672 time for calcul the mask position with numpy : 0.006502866744995117 nb_pixel_total : 108 time to create 1 rle with old method : 0.00020074844360351562 time for calcul the mask position with numpy : 0.006571054458618164 nb_pixel_total : 52 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.006947994232177734 nb_pixel_total : 406 time to create 1 rle with old method : 0.0006875991821289062 time for calcul the mask position with numpy : 0.0066356658935546875 nb_pixel_total : 246 time to create 1 rle with old method : 0.0004343986511230469 time for calcul the mask position with numpy : 0.00687098503112793 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005788803100585938 time for calcul the mask position with numpy : 0.01073312759399414 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004909038543701172 create new chi : 1.0212574005126953 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014002323150634766 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 9969 TO DO : save crop sub photo not yet done ! save time : 0.5782279968261719 nb_obj : 102 nb_hashtags : 7 time to prepare the origin masks : 1.3425629138946533 time for calcul the mask position with numpy : 0.01830124855041504 nb_pixel_total : 1779305 time to create 1 rle with new method : 0.04262995719909668 time for calcul the mask position with numpy : 0.006275177001953125 nb_pixel_total : 207 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.005907297134399414 nb_pixel_total : 143 time to create 1 rle with old method : 0.00019407272338867188 time for calcul the mask position with numpy : 0.009282350540161133 nb_pixel_total : 423 time to create 1 rle with old method : 0.0004961490631103516 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 2219 time to create 1 rle with old method : 0.002492189407348633 time for calcul the mask position with numpy : 0.00969839096069336 nb_pixel_total : 513 time to create 1 rle with old method : 0.0005767345428466797 time for calcul the mask position with numpy : 0.00971078872680664 nb_pixel_total : 57339 time to create 1 rle with old method : 0.06198525428771973 time for calcul the mask position with numpy : 0.010043621063232422 nb_pixel_total : 129 time to create 1 rle with old method : 0.00016260147094726562 time for calcul the mask position with numpy : 0.009584903717041016 nb_pixel_total : 134 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.009476423263549805 nb_pixel_total : 86 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.00914907455444336 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009431838989257812 time for calcul the mask position with numpy : 0.00925898551940918 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001068115234375 time for calcul the mask position with numpy : 0.005983114242553711 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006425380706787109 time for calcul the mask position with numpy : 0.0058557987213134766 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.005625009536743164 nb_pixel_total : 32 time to create 1 rle with old method : 5.412101745605469e-05 time for calcul the mask position with numpy : 0.005715370178222656 nb_pixel_total : 124 time to create 1 rle with old method : 0.00015783309936523438 time for calcul the mask position with numpy : 0.0055921077728271484 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003039836883544922 time for calcul the mask position with numpy : 0.005777835845947266 nb_pixel_total : 55 time to create 1 rle with old method : 8.034706115722656e-05 time for calcul the mask position with numpy : 0.0058476924896240234 nb_pixel_total : 45 time to create 1 rle with old method : 7.677078247070312e-05 time for calcul the mask position with numpy : 0.0060465335845947266 nb_pixel_total : 2068 time to create 1 rle with old method : 0.002471923828125 time for calcul the mask position with numpy : 0.00649714469909668 nb_pixel_total : 17765 time to create 1 rle with old method : 0.02008676528930664 time for calcul the mask position with numpy : 0.006288290023803711 nb_pixel_total : 796 time to create 1 rle with old method : 0.0009541511535644531 time for calcul the mask position with numpy : 0.006187915802001953 nb_pixel_total : 198 time to create 1 rle with old method : 0.00030422210693359375 time for calcul the mask position with numpy : 0.011801958084106445 nb_pixel_total : 648 time to create 1 rle with old method : 0.0007867813110351562 time for calcul the mask position with numpy : 0.010315656661987305 nb_pixel_total : 247 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.010202884674072266 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006511211395263672 time for calcul the mask position with numpy : 0.010057926177978516 nb_pixel_total : 113 time to create 1 rle with old method : 0.00015926361083984375 time for calcul the mask position with numpy : 0.009926319122314453 nb_pixel_total : 179 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.009645223617553711 nb_pixel_total : 420 time to create 1 rle with old method : 0.00054931640625 time for calcul the mask position with numpy : 0.010012149810791016 nb_pixel_total : 6883 time to create 1 rle with old method : 0.008034706115722656 time for calcul the mask position with numpy : 0.009912490844726562 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005691051483154297 time for calcul the mask position with numpy : 0.009884119033813477 nb_pixel_total : 26 time to create 1 rle with old method : 7.653236389160156e-05 time for calcul the mask position with numpy : 0.009725332260131836 nb_pixel_total : 10892 time to create 1 rle with old method : 0.012450933456420898 time for calcul the mask position with numpy : 0.009460210800170898 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010919570922851562 time for calcul the mask position with numpy : 0.009748458862304688 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005750656127929688 time for calcul the mask position with numpy : 0.010614156723022461 nb_pixel_total : 207 time to create 1 rle with old method : 0.00028777122497558594 time for calcul the mask position with numpy : 0.00993967056274414 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008161067962646484 time for calcul the mask position with numpy : 0.0099334716796875 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.00961613655090332 nb_pixel_total : 2475 time to create 1 rle with old method : 0.0031812191009521484 time for calcul the mask position with numpy : 0.00613856315612793 nb_pixel_total : 3633 time to create 1 rle with old method : 0.004421234130859375 time for calcul the mask position with numpy : 0.005972146987915039 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005335807800292969 time for calcul the mask position with numpy : 0.005814313888549805 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003101825714111328 time for calcul the mask position with numpy : 0.0060808658599853516 nb_pixel_total : 1256 time to create 1 rle with old method : 0.00151824951171875 time for calcul the mask position with numpy : 0.006037712097167969 nb_pixel_total : 22 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.005671024322509766 nb_pixel_total : 706 time to create 1 rle with old method : 0.0007884502410888672 time for calcul the mask position with numpy : 0.006014585494995117 nb_pixel_total : 12032 time to create 1 rle with old method : 0.0134735107421875 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 136 time to create 1 rle with old method : 0.00017786026000976562 time for calcul the mask position with numpy : 0.005899667739868164 nb_pixel_total : 889 time to create 1 rle with old method : 0.0010781288146972656 time for calcul the mask position with numpy : 0.006018638610839844 nb_pixel_total : 3 time to create 1 rle with old method : 3.361701965332031e-05 time for calcul the mask position with numpy : 0.005651950836181641 nb_pixel_total : 196 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 675 time to create 1 rle with old method : 0.0008018016815185547 time for calcul the mask position with numpy : 0.005662202835083008 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0014450550079345703 time for calcul the mask position with numpy : 0.005944013595581055 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010104179382324219 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.006520748138427734 nb_pixel_total : 816 time to create 1 rle with old method : 0.0008823871612548828 time for calcul the mask position with numpy : 0.00574183464050293 nb_pixel_total : 7941 time to create 1 rle with old method : 0.009291887283325195 time for calcul the mask position with numpy : 0.005947589874267578 nb_pixel_total : 3528 time to create 1 rle with old method : 0.003873109817504883 time for calcul the mask position with numpy : 0.007480621337890625 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0017278194427490234 time for calcul the mask position with numpy : 0.0057392120361328125 nb_pixel_total : 335 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.005852460861206055 nb_pixel_total : 2166 time to create 1 rle with old method : 0.0026428699493408203 time for calcul the mask position with numpy : 0.005976438522338867 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006644725799560547 time for calcul the mask position with numpy : 0.006018161773681641 nb_pixel_total : 927 time to create 1 rle with old method : 0.0010845661163330078 time for calcul the mask position with numpy : 0.005874156951904297 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 103 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.005844831466674805 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007846355438232422 time for calcul the mask position with numpy : 0.0057909488677978516 nb_pixel_total : 1011 time to create 1 rle with old method : 0.001188516616821289 time for calcul the mask position with numpy : 0.005952596664428711 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005667209625244141 time for calcul the mask position with numpy : 0.0061414241790771484 nb_pixel_total : 13895 time to create 1 rle with old method : 0.01509857177734375 time for calcul the mask position with numpy : 0.005701303482055664 nb_pixel_total : 2457 time to create 1 rle with old method : 0.0027184486389160156 time for calcul the mask position with numpy : 0.005747079849243164 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005824565887451172 time for calcul the mask position with numpy : 0.0058803558349609375 nb_pixel_total : 40 time to create 1 rle with old method : 6.604194641113281e-05 time for calcul the mask position with numpy : 0.005853176116943359 nb_pixel_total : 1395 time to create 1 rle with old method : 0.0021491050720214844 time for calcul the mask position with numpy : 0.0062792301177978516 nb_pixel_total : 105718 time to create 1 rle with old method : 0.11536836624145508 time for calcul the mask position with numpy : 0.005857944488525391 nb_pixel_total : 84 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.005696296691894531 nb_pixel_total : 3523 time to create 1 rle with old method : 0.004000186920166016 time for calcul the mask position with numpy : 0.005741596221923828 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.007651090621948242 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.010270118713378906 nb_pixel_total : 130 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.006643772125244141 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004558563232421875 time for calcul the mask position with numpy : 0.005800724029541016 nb_pixel_total : 910 time to create 1 rle with old method : 0.0010781288146972656 time for calcul the mask position with numpy : 0.005808830261230469 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001819133758544922 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 13 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.005686521530151367 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006184577941894531 time for calcul the mask position with numpy : 0.005602359771728516 nb_pixel_total : 3365 time to create 1 rle with old method : 0.003736734390258789 time for calcul the mask position with numpy : 0.005650997161865234 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.005955219268798828 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006580352783203125 time for calcul the mask position with numpy : 0.005791187286376953 nb_pixel_total : 688 time to create 1 rle with old method : 0.0007674694061279297 time for calcul the mask position with numpy : 0.00577092170715332 nb_pixel_total : 817 time to create 1 rle with old method : 0.0009257793426513672 time for calcul the mask position with numpy : 0.005816936492919922 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004706382751464844 time for calcul the mask position with numpy : 0.0058324337005615234 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002887248992919922 time for calcul the mask position with numpy : 0.0057220458984375 nb_pixel_total : 122 time to create 1 rle with old method : 0.00015306472778320312 time for calcul the mask position with numpy : 0.005791902542114258 nb_pixel_total : 2513 time to create 1 rle with old method : 0.0029311180114746094 time for calcul the mask position with numpy : 0.005886554718017578 nb_pixel_total : 356 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.005743265151977539 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005376338958740234 time for calcul the mask position with numpy : 0.0059359073638916016 nb_pixel_total : 41 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.005776166915893555 nb_pixel_total : 413 time to create 1 rle with old method : 0.00045943260192871094 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 293 time to create 1 rle with old method : 0.0003616809844970703 time for calcul the mask position with numpy : 0.00585174560546875 nb_pixel_total : 261 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.005881309509277344 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010197162628173828 time for calcul the mask position with numpy : 0.005918741226196289 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.006045341491699219 nb_pixel_total : 441 time to create 1 rle with old method : 0.0004985332489013672 time for calcul the mask position with numpy : 0.009209871292114258 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004773139953613281 time for calcul the mask position with numpy : 0.005705356597900391 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011157989501953125 create new chi : 1.1071867942810059 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014286041259765625 batch 1 Loaded 103 chid ids of type : 4230 Number RLEs to save : 11112 TO DO : save crop sub photo not yet done ! save time : 0.6390647888183594 nb_obj : 101 nb_hashtags : 8 time to prepare the origin masks : 1.3071188926696777 time for calcul the mask position with numpy : 0.021181106567382812 nb_pixel_total : 1788959 time to create 1 rle with new method : 0.0464625358581543 time for calcul the mask position with numpy : 0.005803823471069336 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0014452934265136719 time for calcul the mask position with numpy : 0.005544900894165039 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.0055179595947265625 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001742839813232422 time for calcul the mask position with numpy : 0.0057866573333740234 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0012562274932861328 time for calcul the mask position with numpy : 0.009490251541137695 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004258155822753906 time for calcul the mask position with numpy : 0.00944972038269043 nb_pixel_total : 2044 time to create 1 rle with old method : 0.002439260482788086 time for calcul the mask position with numpy : 0.009757757186889648 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007867813110351562 time for calcul the mask position with numpy : 0.0066759586334228516 nb_pixel_total : 59460 time to create 1 rle with old method : 0.06452250480651855 time for calcul the mask position with numpy : 0.00617527961730957 nb_pixel_total : 855 time to create 1 rle with old method : 0.0010631084442138672 time for calcul the mask position with numpy : 0.006182432174682617 nb_pixel_total : 795 time to create 1 rle with old method : 0.0010170936584472656 time for calcul the mask position with numpy : 0.0065114498138427734 nb_pixel_total : 27 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001232624053955078 time for calcul the mask position with numpy : 0.006161212921142578 nb_pixel_total : 53 time to create 1 rle with old method : 9.584426879882812e-05 time for calcul the mask position with numpy : 0.0059626102447509766 nb_pixel_total : 52 time to create 1 rle with old method : 9.393692016601562e-05 time for calcul the mask position with numpy : 0.006691694259643555 nb_pixel_total : 21 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.007335662841796875 nb_pixel_total : 16 time to create 1 rle with old method : 5.507469177246094e-05 time for calcul the mask position with numpy : 0.0064351558685302734 nb_pixel_total : 2037 time to create 1 rle with old method : 0.0026378631591796875 time for calcul the mask position with numpy : 0.0063037872314453125 nb_pixel_total : 1719 time to create 1 rle with old method : 0.0020208358764648438 time for calcul the mask position with numpy : 0.006444454193115234 nb_pixel_total : 13796 time to create 1 rle with old method : 0.016461849212646484 time for calcul the mask position with numpy : 0.006001710891723633 nb_pixel_total : 585 time to create 1 rle with old method : 0.0006809234619140625 time for calcul the mask position with numpy : 0.006944179534912109 nb_pixel_total : 242 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.00573277473449707 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011081695556640625 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 704 time to create 1 rle with old method : 0.0008580684661865234 time for calcul the mask position with numpy : 0.005994558334350586 nb_pixel_total : 1343 time to create 1 rle with old method : 0.0015802383422851562 time for calcul the mask position with numpy : 0.0060346126556396484 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006344318389892578 time for calcul the mask position with numpy : 0.006224870681762695 nb_pixel_total : 37 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.007023334503173828 nb_pixel_total : 6627 time to create 1 rle with old method : 0.007610321044921875 time for calcul the mask position with numpy : 0.005770683288574219 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006458759307861328 time for calcul the mask position with numpy : 0.005804777145385742 nb_pixel_total : 11765 time to create 1 rle with old method : 0.013250589370727539 time for calcul the mask position with numpy : 0.005776882171630859 nb_pixel_total : 377 time to create 1 rle with old method : 0.00044417381286621094 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005893707275390625 time for calcul the mask position with numpy : 0.00667119026184082 nb_pixel_total : 31 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.0059967041015625 nb_pixel_total : 1569 time to create 1 rle with old method : 0.001743316650390625 time for calcul the mask position with numpy : 0.006003856658935547 nb_pixel_total : 696 time to create 1 rle with old method : 0.0008525848388671875 time for calcul the mask position with numpy : 0.006113290786743164 nb_pixel_total : 184 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.005717277526855469 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002127408981323242 time for calcul the mask position with numpy : 0.005994319915771484 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003414154052734375 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.005869388580322266 nb_pixel_total : 983 time to create 1 rle with old method : 0.0012230873107910156 time for calcul the mask position with numpy : 0.005675554275512695 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0020835399627685547 time for calcul the mask position with numpy : 0.0059168338775634766 nb_pixel_total : 552 time to create 1 rle with old method : 0.0005993843078613281 time for calcul the mask position with numpy : 0.005969524383544922 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003848075866699219 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 914 time to create 1 rle with old method : 0.0011188983917236328 time for calcul the mask position with numpy : 0.005859375 nb_pixel_total : 681 time to create 1 rle with old method : 0.0007491111755371094 time for calcul the mask position with numpy : 0.005694150924682617 nb_pixel_total : 819 time to create 1 rle with old method : 0.0008649826049804688 time for calcul the mask position with numpy : 0.005971193313598633 nb_pixel_total : 611 time to create 1 rle with old method : 0.0007863044738769531 time for calcul the mask position with numpy : 0.0060558319091796875 nb_pixel_total : 1276 time to create 1 rle with old method : 0.001436471939086914 time for calcul the mask position with numpy : 0.0058939456939697266 nb_pixel_total : 817 time to create 1 rle with old method : 0.0009663105010986328 time for calcul the mask position with numpy : 0.005748748779296875 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002865791320800781 time for calcul the mask position with numpy : 0.006241559982299805 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.005686044692993164 nb_pixel_total : 807 time to create 1 rle with old method : 0.0010154247283935547 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 6 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 5134 time to create 1 rle with old method : 0.005908012390136719 time for calcul the mask position with numpy : 0.005743265151977539 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007812976837158203 time for calcul the mask position with numpy : 0.006011009216308594 nb_pixel_total : 3359 time to create 1 rle with old method : 0.003703594207763672 time for calcul the mask position with numpy : 0.005917549133300781 nb_pixel_total : 299 time to create 1 rle with old method : 0.00039005279541015625 time for calcul the mask position with numpy : 0.005946159362792969 nb_pixel_total : 1446 time to create 1 rle with old method : 0.0016019344329833984 time for calcul the mask position with numpy : 0.00568389892578125 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008292198181152344 time for calcul the mask position with numpy : 0.005597352981567383 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0012662410736083984 time for calcul the mask position with numpy : 0.005687236785888672 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005156993865966797 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.006128549575805664 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002372264862060547 time for calcul the mask position with numpy : 0.005955219268798828 nb_pixel_total : 688 time to create 1 rle with old method : 0.0008103847503662109 time for calcul the mask position with numpy : 0.005733013153076172 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0012476444244384766 time for calcul the mask position with numpy : 0.005717039108276367 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004646778106689453 time for calcul the mask position with numpy : 0.005775928497314453 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.005804538726806641 nb_pixel_total : 14878 time to create 1 rle with old method : 0.01705145835876465 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 2514 time to create 1 rle with old method : 0.0029408931732177734 time for calcul the mask position with numpy : 0.006028413772583008 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0016760826110839844 time for calcul the mask position with numpy : 0.006075859069824219 nb_pixel_total : 106704 time to create 1 rle with old method : 0.11796927452087402 time for calcul the mask position with numpy : 0.006092071533203125 nb_pixel_total : 89 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.006131172180175781 nb_pixel_total : 3695 time to create 1 rle with old method : 0.004596233367919922 time for calcul the mask position with numpy : 0.006246089935302734 nb_pixel_total : 1651 time to create 1 rle with old method : 0.001971006393432617 time for calcul the mask position with numpy : 0.005846977233886719 nb_pixel_total : 72 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.006026744842529297 nb_pixel_total : 117 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.0064716339111328125 nb_pixel_total : 124 time to create 1 rle with old method : 0.00017118453979492188 time for calcul the mask position with numpy : 0.0060749053955078125 nb_pixel_total : 415 time to create 1 rle with old method : 0.0004925727844238281 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 907 time to create 1 rle with old method : 0.0011184215545654297 time for calcul the mask position with numpy : 0.006058692932128906 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006563663482666016 time for calcul the mask position with numpy : 0.006931781768798828 nb_pixel_total : 3775 time to create 1 rle with old method : 0.004327535629272461 time for calcul the mask position with numpy : 0.006112813949584961 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022745132446289062 time for calcul the mask position with numpy : 0.006254673004150391 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007190704345703125 time for calcul the mask position with numpy : 0.006079435348510742 nb_pixel_total : 517 time to create 1 rle with old method : 0.0005795955657958984 time for calcul the mask position with numpy : 0.006237506866455078 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0015418529510498047 time for calcul the mask position with numpy : 0.006347179412841797 nb_pixel_total : 317 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.00634765625 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001842975616455078 time for calcul the mask position with numpy : 0.006000518798828125 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005662441253662109 time for calcul the mask position with numpy : 0.006237030029296875 nb_pixel_total : 2090 time to create 1 rle with old method : 0.0026674270629882812 time for calcul the mask position with numpy : 0.00580906867980957 nb_pixel_total : 76 time to create 1 rle with old method : 0.00011134147644042969 time for calcul the mask position with numpy : 0.005880832672119141 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004432201385498047 time for calcul the mask position with numpy : 0.0059969425201416016 nb_pixel_total : 288 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.006662130355834961 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006055831909179688 time for calcul the mask position with numpy : 0.0057220458984375 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003376007080078125 time for calcul the mask position with numpy : 0.0056836605072021484 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004372596740722656 time for calcul the mask position with numpy : 0.005999565124511719 nb_pixel_total : 10 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.006323099136352539 nb_pixel_total : 28 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.008167028427124023 nb_pixel_total : 394 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.007877588272094727 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004305839538574219 time for calcul the mask position with numpy : 0.009705305099487305 nb_pixel_total : 404 time to create 1 rle with old method : 0.0004487037658691406 create new chi : 1.0279629230499268 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015664100646972656 batch 1 Loaded 102 chid ids of type : 4230 Number RLEs to save : 10222 TO DO : save crop sub photo not yet done ! save time : 0.6087808609008789 map_output_result : {1337091193: (0.0, 'Should be the crop_list due to order', 0.0), 1337091189: (0.0, 'Should be the crop_list due to order', 0.0), 1337091092: (0.0, 'Should be the crop_list due to order', 0.0), 1337091024: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 4 /1337091193.Didn't retrieve data . /1337091189.Didn't retrieve data . /1337091092.Didn't retrieve data . /1337091024.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.015033721923828125 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.096316576004028 time spend to save output : 0.015421867370605469 total time spend for step 4 : 13.111738443374634 step5:crop_condition Wed Feb 12 13:21:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 408 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 125 About to insert : list_path_to_insert length 125 new photo from crops ! About to upload 125 photos upload in portfolio : 4869462 init cache_photo without model_param we have 125 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362878_3505163 we have uploaded 125 photos in the portfolio 4869462 time of upload the photos Elapsed time : 28.766373872756958 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 4869462 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362908_3505163 we have uploaded 56 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.058933019638062 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362921_3505163 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2686514854431152 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 4869462 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362923_3505163 we have uploaded 17 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.144037961959839 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 67 About to insert : list_path_to_insert length 67 new photo from crops ! About to upload 67 photos upload in portfolio : 4869462 init cache_photo without model_param we have 67 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362928_3505163 we have uploaded 67 photos in the portfolio 4869462 time of upload the photos Elapsed time : 19.998893976211548 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739362948_3505163 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5333313941955566 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 270 /1337098617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337098907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 814 time used for this insertion : 0.048476219177246094 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.0848035812378 time spend to save output : 0.0564727783203125 total time spend for step 5 : 73.1412763595581 step6:thcl Wed Feb 12 13:22:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.012181282043457031 time to convert the images to numpy array : 0.07319235801696777 time to import caffe and check if the image exist : 0.015579938888549805 time to convert the images to numpy array : 0.07906889915466309 time to import caffe and check if the image exist : 0.017959117889404297 time to convert the images to numpy array : 0.081634521484375 time to import caffe and check if the image exist : 0.01959061622619629 time to convert the images to numpy array : 0.08027076721191406 time to import caffe and check if the image exist : 0.015595674514770508 time to convert the images to numpy array : 0.08318948745727539 time to import caffe and check if the image exist : 0.022397756576538086 time to convert the images to numpy array : 0.0834968090057373 time to import caffe and check if the image exist : 0.026645183563232422 time to convert the images to numpy array : 0.08178925514221191 time to import caffe and check if the image exist : 0.019609451293945312 time to convert the images to numpy array : 0.09107065200805664 time to import caffe and check if the image exist : 0.024951457977294922 time to convert the images to numpy array : 0.08838915824890137 time to import caffe and check if the image exist : 0.03353142738342285 time to convert the images to numpy array : 0.07916522026062012 total time to convert the images to numpy array : 0.3451671600341797 list photo_ids error: [] list photo_ids correct : [1337098644, 1337098645, 1337098646, 1337098647, 1337098648, 1337098649, 1337098650, 1337098651, 1337098652, 1337098653, 1337098654, 1337098655, 1337098656, 1337098657, 1337098658, 1337098659, 1337098660, 1337098661, 1337098662, 1337098663, 1337098664, 1337098665, 1337098666, 1337098667, 1337098668, 1337098669, 1337098670, 1337098851, 1337098852, 1337098853, 1337098854, 1337098855, 1337098856, 1337098857, 1337098858, 1337098859, 1337098860, 1337098861, 1337098862, 1337098863, 1337098864, 1337098865, 1337098866, 1337098867, 1337098868, 1337098869, 1337098870, 1337098871, 1337098872, 1337098874, 1337098875, 1337098876, 1337098877, 1337098878, 1337098759, 1337098760, 1337098761, 1337098762, 1337098763, 1337098764, 1337098765, 1337098766, 1337098767, 1337098768, 1337098769, 1337098770, 1337098771, 1337098772, 1337098773, 1337098774, 1337098775, 1337098776, 1337098777, 1337098778, 1337098779, 1337098780, 1337098781, 1337098782, 1337098783, 1337098784, 1337098785, 1337098815, 1337098816, 1337098817, 1337098818, 1337098819, 1337098820, 1337098821, 1337098822, 1337098823, 1337098824, 1337098825, 1337098826, 1337098827, 1337098837, 1337098838, 1337098839, 1337098840, 1337098841, 1337098842, 1337098843, 1337098844, 1337098845, 1337098846, 1337098847, 1337098848, 1337098849, 1337098850, 1337098880, 1337098881, 1337098882, 1337098883, 1337098884, 1337098885, 1337098886, 1337098887, 1337098888, 1337098889, 1337098890, 1337098891, 1337098892, 1337098893, 1337098894, 1337098896, 1337098897, 1337098898, 1337098899, 1337098900, 1337098901, 1337098902, 1337098903, 1337098904, 1337098905, 1337098906, 1337098907, 1337098727, 1337098728, 1337098729, 1337098730, 1337098731, 1337098732, 1337098733, 1337098734, 1337098735, 1337098736, 1337098737, 1337098738, 1337098739, 1337098740, 1337098741, 1337098742, 1337098743, 1337098749, 1337098750, 1337098751, 1337098752, 1337098753, 1337098754, 1337098755, 1337098756, 1337098757, 1337098758, 1337098786, 1337098787, 1337098788, 1337098789, 1337098790, 1337098791, 1337098792, 1337098793, 1337098794, 1337098795, 1337098796, 1337098797, 1337098798, 1337098799, 1337098800, 1337098802, 1337098803, 1337098804, 1337098805, 1337098806, 1337098807, 1337098808, 1337098809, 1337098811, 1337098812, 1337098813, 1337098814, 1337098671, 1337098672, 1337098673, 1337098674, 1337098675, 1337098676, 1337098677, 1337098678, 1337098679, 1337098680, 1337098681, 1337098682, 1337098684, 1337098686, 1337098687, 1337098688, 1337098689, 1337098690, 1337098691, 1337098692, 1337098693, 1337098694, 1337098695, 1337098696, 1337098697, 1337098698, 1337098699, 1337098617, 1337098618, 1337098619, 1337098620, 1337098621, 1337098622, 1337098623, 1337098624, 1337098625, 1337098626, 1337098627, 1337098628, 1337098629, 1337098630, 1337098631, 1337098632, 1337098633, 1337098634, 1337098635, 1337098636, 1337098637, 1337098638, 1337098639, 1337098640, 1337098641, 1337098642, 1337098643, 1337098700, 1337098701, 1337098702, 1337098703, 1337098704, 1337098705, 1337098706, 1337098707, 1337098708, 1337098709, 1337098710, 1337098711, 1337098712, 1337098713, 1337098714, 1337098715, 1337098716, 1337098717, 1337098718, 1337098719, 1337098720, 1337098721, 1337098722, 1337098723, 1337098724, 1337098725, 1337098726] number of photos to traite : 270 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10772 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.241457223892212 time used to do the prediction : 0.9376072883605957 save descriptor for thcl : 3237 time to traite the descriptors : 1.640275001525879 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337098644 To insert : 1337098645 To insert : 1337098646 To insert : 1337098647 To insert : 1337098648 To insert : 1337098649 To insert : 1337098650 To insert : 1337098651 To insert : 1337098652 To insert : 1337098653 To insert : 1337098654 To insert : 1337098655 To insert : 1337098656 To insert : 1337098657 To insert : 1337098658 To insert : 1337098659 To insert : 1337098660 To insert : 1337098661 To insert : 1337098662 To insert : 1337098663 To insert : 1337098664 To insert : 1337098665 To insert : 1337098666 To insert : 1337098667 To insert : 1337098668 To insert : 1337098669 To insert : 1337098670 To insert : 1337098851 To insert : 1337098852 To insert : 1337098853 To insert : 1337098854 To insert : 1337098855 To insert : 1337098856 To insert : 1337098857 To insert : 1337098858 To insert : 1337098859 To insert : 1337098860 To insert : 1337098861 To insert : 1337098862 To insert : 1337098863 To insert : 1337098864 To insert : 1337098865 To insert : 1337098866 To insert : 1337098867 To insert : 1337098868 To insert : 1337098869 To insert : 1337098870 To insert : 1337098871 To insert : 1337098872 To insert : 1337098874 To insert : 1337098875 To insert : 1337098876 To insert : 1337098877 To insert : 1337098878 To insert : 1337098759 To insert : 1337098760 To insert : 1337098761 To insert : 1337098762 To insert : 1337098763 To insert : 1337098764 To insert : 1337098765 To insert : 1337098766 To insert : 1337098767 To insert : 1337098768 To insert : 1337098769 To insert : 1337098770 To insert : 1337098771 To insert : 1337098772 To insert : 1337098773 To insert : 1337098774 To insert : 1337098775 To insert : 1337098776 To insert : 1337098777 To insert : 1337098778 To insert : 1337098779 To insert : 1337098780 To insert : 1337098781 To insert : 1337098782 To insert : 1337098783 To insert : 1337098784 To insert : 1337098785 To insert : 1337098815 To insert : 1337098816 To insert : 1337098817 To insert : 1337098818 To insert : 1337098819 To insert : 1337098820 To insert : 1337098821 To insert : 1337098822 To insert : 1337098823 To insert : 1337098824 To insert : 1337098825 To insert : 1337098826 To insert : 1337098827 To insert : 1337098837 To insert : 1337098838 To insert : 1337098839 To insert : 1337098840 To insert : 1337098841 To insert : 1337098842 To insert : 1337098843 To insert : 1337098844 To insert : 1337098845 To insert : 1337098846 To insert : 1337098847 To insert : 1337098848 To insert : 1337098849 To insert : 1337098850 To insert : 1337098880 To insert : 1337098881 To insert : 1337098882 To insert : 1337098883 To insert : 1337098884 To insert : 1337098885 To insert : 1337098886 To insert : 1337098887 To insert : 1337098888 To insert : 1337098889 To insert : 1337098890 To insert : 1337098891 To insert : 1337098892 To insert : 1337098893 To insert : 1337098894 To insert : 1337098896 To insert : 1337098897 To insert : 1337098898 To insert : 1337098899 To insert : 1337098900 To insert : 1337098901 To insert : 1337098902 To insert : 1337098903 To insert : 1337098904 To insert : 1337098905 To insert : 1337098906 To insert : 1337098907 To insert : 1337098727 To insert : 1337098728 To insert : 1337098729 To insert : 1337098730 To insert : 1337098731 To insert : 1337098732 To insert : 1337098733 To insert : 1337098734 To insert : 1337098735 To insert : 1337098736 To insert : 1337098737 To insert : 1337098738 To insert : 1337098739 To insert : 1337098740 To insert : 1337098741 To insert : 1337098742 To insert : 1337098743 To insert : 1337098749 To insert : 1337098750 To insert : 1337098751 To insert : 1337098752 To insert : 1337098753 To insert : 1337098754 To insert : 1337098755 To insert : 1337098756 To insert : 1337098757 To insert : 1337098758 To insert : 1337098786 To insert : 1337098787 To insert : 1337098788 To insert : 1337098789 To insert : 1337098790 To insert : 1337098791 To insert : 1337098792 To insert : 1337098793 To insert : 1337098794 To insert : 1337098795 To insert : 1337098796 To insert : 1337098797 To insert : 1337098798 To insert : 1337098799 To insert : 1337098800 To insert : 1337098802 To insert : 1337098803 To insert : 1337098804 To insert : 1337098805 To insert : 1337098806 To insert : 1337098807 To insert : 1337098808 To insert : 1337098809 To insert : 1337098811 To insert : 1337098812 To insert : 1337098813 To insert : 1337098814 To insert : 1337098671 To insert : 1337098672 To insert : 1337098673 To insert : 1337098674 To insert : 1337098675 To insert : 1337098676 To insert : 1337098677 To insert : 1337098678 To insert : 1337098679 To insert : 1337098680 To insert : 1337098681 To insert : 1337098682 To insert : 1337098684 To insert : 1337098686 To insert : 1337098687 To insert : 1337098688 To insert : 1337098689 To insert : 1337098690 To insert : 1337098691 To insert : 1337098692 To insert : 1337098693 To insert : 1337098694 To insert : 1337098695 To insert : 1337098696 To insert : 1337098697 To insert : 1337098698 To insert : 1337098699 To insert : 1337098617 To insert : 1337098618 To insert : 1337098619 To insert : 1337098620 To insert : 1337098621 To insert : 1337098622 To insert : 1337098623 To insert : 1337098624 To insert : 1337098625 To insert : 1337098626 To insert : 1337098627 To insert : 1337098628 To insert : 1337098629 To insert : 1337098630 To insert : 1337098631 To insert : 1337098632 To insert : 1337098633 To insert : 1337098634 To insert : 1337098635 To insert : 1337098636 To insert : 1337098637 To insert : 1337098638 To insert : 1337098639 To insert : 1337098640 To insert : 1337098641 To insert : 1337098642 To insert : 1337098643 To insert : 1337098700 To insert : 1337098701 To insert : 1337098702 To insert : 1337098703 To insert : 1337098704 To insert : 1337098705 To insert : 1337098706 To insert : 1337098707 To insert : 1337098708 To insert : 1337098709 To insert : 1337098710 To insert : 1337098711 To insert : 1337098712 To insert : 1337098713 To insert : 1337098714 To insert : 1337098715 To insert : 1337098716 To insert : 1337098717 To insert : 1337098718 To insert : 1337098719 To insert : 1337098720 To insert : 1337098721 To insert : 1337098722 To insert : 1337098723 To insert : 1337098724 To insert : 1337098725 To insert : 1337098726 time to insert the descriptors : 54.64794397354126 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 404 time used for this insertion : 0.028835773468017578 save missing photos in datou_result : time spend for datou_step_exec : 62.80265974998474 time spend to save output : 0.07927608489990234 total time spend for step 6 : 62.881935834884644 step7:ventilate_hashtags_in_portfolio Wed Feb 12 13:23:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20476691 get user id for portfolio 20476691 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476691 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','pet_clair','metal','environnement','Carton','Film_plastique','PET_fonce','Papier','refus','flou','Tetrapak','PEHD','carton','autre','PET_clair','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476691 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','pet_clair','metal','environnement','Carton','Film_plastique','PET_fonce','Papier','refus','flou','Tetrapak','PEHD','carton','autre','PET_clair','mal_croppe')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476691 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','pet_clair','metal','environnement','Carton','Film_plastique','PET_fonce','Papier','refus','flou','Tetrapak','PEHD','carton','autre','PET_clair','mal_croppe')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476691 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','pet_clair','metal','environnement','Carton','Film_plastique','PET_fonce','Papier','refus','flou','Tetrapak','PEHD','carton','autre','PET_clair','mal_croppe')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20477026,20477030,20477025,20477033,20477021,20477022,20477031,20477024,20477027,20477028,20477029,20477032,20477034?tags=papier,pehd,pet_fonce,pet_clair,metal,environnement,carton,film_plastique,refus,flou,tetrapak,autre,mal_croppe&datou_id_consolidate=4235&port_consolidate=20476691 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 1 /20476691. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012794733047485352 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.1304025650024414 time spend to save output : 0.013065338134765625 total time spend for step 7 : 3.143467903137207 step8:final Wed Feb 12 13:23:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337091193: ('0.2119568776018645',), 1337091189: ('0.2119568776018645',), 1337091092: ('0.2119568776018645',), 1337091024: ('0.2119568776018645',)} new output for save of step final : {1337091193: ('0.2119568776018645',), 1337091189: ('0.2119568776018645',), 1337091092: ('0.2119568776018645',), 1337091024: ('0.2119568776018645',)} [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 4 /1337091193.Didn't retrieve data . /1337091189.Didn't retrieve data . /1337091092.Didn't retrieve data . /1337091024.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01458287239074707 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17394328117370605 time spend to save output : 0.014868736267089844 total time spend for step 8 : 0.1888120174407959 step9:velours_tree Wed Feb 12 13:23:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20477026,20477030,20477025,20477033,20477021,20477022,20477031,20477024,20477027,20477028,20477029,20477032,20477034 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477026 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477030 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477025 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477033 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477021 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477022 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477031 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477024 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477027 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477028 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477029 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477032 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20477034 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 270 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 3 0 0 1 1 4 4 1 1 4 1 5 3 1 0 2 3 2 3 2 2 0 2 2 3 2 2 0 4 5 0 5 5 3 4 0 1 4 1 4 1 4 3 0 2 2 5 3 5 3 2 2 2 3 2 0 2 4 5 4 5 5 5 3 0 1 1 1 4 1 4 4 4 3 1 0 2 2 5 3 3 5 2 0 2 2 3 2 0 2 4 5 5 4 5 4 0 1 1 0 4 1 4 1 4 3 0 2 1 3 3 5 2 5 2 2 3 2 0 4 5 5 4 4 0 0 3 3 3 1 1 3 4 1 0 5 0 0 3 0 1 5 5 1 3 4 1 5 0 0 0 0 0 3 3 3 1 3 2 2 3 4 1 0 0 0 0 5 3 3 3 3 2 5 2 3 4 1 0 0 0 0 0 0 3 5 4 2 5 4 5 2 4 5 3 2 5 3 5 2 4 0 1 4 3 5 3 2 5 2 1 5 5 2 5 5 5 3 0 0 0 1 1 5 3 5 5 5 2 1 2 5 3 0 0 3 0 3 1 5 3 5 5 3 2 1 1 2 5 5 5 3 0 1 5 5 3 5 5 5 2 2 1 5 2 5 3 5 1] Elapsed time: 0.04328274726867676 graph_id used : 78139 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20477026,20477030,20477025,20477033,20477021,20477022,20477031,20477024,20477027,20477028,20477029,20477032,20477034?tags=papier,pehd,pet_fonce,pet_clair,metal,environnement,carton,film_plastique,refus,flou,tetrapak,autre,mal_croppe&datou_id_consolidate=4235&port_consolidate=20476691&tree_id=78139 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 1 /20476691Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011913061141967773 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.824825525283813 time spend to save output : 0.012278079986572266 total time spend for step 9 : 15.837103605270386 step10:send_mail_cod Wed Feb 12 13:23:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf 20477008 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204770081739363031 20477012 change filename to text .imagette204770121739363032 20477007 imagette204770071739363032 20477015 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204770151739363032 20477003 change filename to text .change filename to text .change filename to text .change filename to text .imagette204770031739363033 20477013 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204770131739363033 20477006 imagette204770061739363034 20477009 imagette204770091739363034 20477010 imagette204770101739363034 20477011 imagette204770111739363034 20477014 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204770141739363034 20477016 imagette204770161739363035 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20476691 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20477026,20477030,20477025,20477033,20477021,20477022,20477031,20477024,20477027,20477028,20477029,20477032,20477034?tags=papier,pehd,pet_fonce,pet_clair,metal,environnement,carton,film_plastique,refus,flou,tetrapak,autre,mal_croppe&datou_id_consolidate=4235&port_consolidate=20476691&tree_id=78139 your option no_mail is active, we will not send the real mail to your client args[1337091193] : ((1337091193, -7.759898867685712, 492609224), (1337091193, -0.6383878335349383, 501862349), '0.2119568776018645') apple ((1337091193, -7.759898867685712, 492609224), (1337091193, -0.6383878335349383, 501862349), '0.2119568776018645') We are sending mail with results at cod@fotonower.com args[1337091189] : ((1337091189, -7.772766960336253, 492609224), (1337091189, -0.6411084534451547, 501862349), '0.2119568776018645') apple ((1337091189, -7.772766960336253, 492609224), (1337091189, -0.6411084534451547, 501862349), '0.2119568776018645') We are sending mail with results at cod@fotonower.com args[1337091092] : ((1337091092, -7.769749278832485, 492609224), (1337091092, -0.6435153074156725, 501862349), '0.2119568776018645') apple ((1337091092, -7.769749278832485, 492609224), (1337091092, -0.6435153074156725, 501862349), '0.2119568776018645') We are sending mail with results at cod@fotonower.com args[1337091024] : ((1337091024, -7.773260842275313, 492609224), (1337091024, -0.6440048637843578, 501862349), '0.2119568776018645') apple ((1337091024, -7.773260842275313, 492609224), (1337091024, -0.6440048637843578, 501862349), '0.2119568776018645') We are sending mail with results at cod@fotonower.com refus_total : 0.2119568776018645 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20476691 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20476691','results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf','pdf','','0.18','0.2119568776018645') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012131214141845703 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.917808294296265 time spend to save output : 0.012309551239013672 total time spend for step 10 : 4.930117845535278 step11:split_time_score Wed Feb 12 13:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12022025 20476691 Nombre de photos uploadées : 4 / 23040 (0%) 12022025 20476691 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 12022025 20476691 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00029158592224121094 elapsed_time : insert_dashboard_record_day_entry 0.023115873336791992 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15829996426485274 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20470706_12-02-2025_10_17_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20470706 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20470706 AND mptpi.`type`=4230 To do Qualite : 0.2571924266909986 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20474222_12-02-2025_11_47_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20474222 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20474222 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476682 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476683 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476684 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476685 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476686 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476321 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476322 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476323 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476324 order by id desc limit 1 Qualite : 0.17840314144925185 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476325_12-02-2025_12_46_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476325 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476325 AND mptpi.`type`=4230 To do Qualite : 0.23342179416285125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476326_12-02-2025_12_36_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476326 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476326 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476687 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476688 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476689 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476690 order by id desc limit 1 Qualite : 0.2119568776018645 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476691_12-02-2025_13_23_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476691 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476691 AND mptpi.`type`=4230 To do Qualite : 0.154875790367845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20476692_12-02-2025_13_17_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20476692 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20476692 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12022025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337091193, 1337091189, 1337091092, 1337091024] Looping around the photos to save general results len do output : 1 /20476691Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091193', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091189', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091092', None, None, None, None, None, '2579398') ('4234', None, None, None, None, None, None, None, '2579398') ('4234', '20476691', '1337091024', None, None, None, None, None, '2579398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012225627899169922 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.735290288925171 time spend to save output : 0.01245737075805664 total time spend for step 11 : 10.747747659683228 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 50.68user 29.00system 3:42.15elapsed 35%CPU (0avgtext+0avgdata 2540828maxresident)k 1120inputs+19472outputs (13major+2445801minor)pagefaults 0swaps