python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 44202 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2599316'] with mtr_portfolio_ids : ['20672519'] and first list_photo_ids : [] new path : /proc/44202/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.4356532096862793 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Feb 19 13:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-19 13:20:31.687154: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-19 13:20:31.711124: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-19 13:20:31.713052: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3fcc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-19 13:20:31.713097: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-19 13:20:31.716957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-19 13:20:31.988445: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x31e96d30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-19 13:20:31.988503: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-19 13:20:31.990128: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 13:20:31.990529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 13:20:31.993410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 13:20:31.995302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 13:20:31.995677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 13:20:31.997796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 13:20:31.998848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 13:20:32.003153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 13:20:32.004642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 13:20:32.004710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 13:20:32.005487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-19 13:20:32.005502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-19 13:20:32.005511: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-19 13:20:32.007234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-19 13:20:32.274323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 13:20:32.274437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 13:20:32.274470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 13:20:32.274502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 13:20:32.274530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 13:20:32.274558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 13:20:32.274585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 13:20:32.274614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 13:20:32.276401: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 13:20:32.277753: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 13:20:32.277797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 13:20:32.277815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 13:20:32.277839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 13:20:32.277859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 13:20:32.277877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 13:20:32.277893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 13:20:32.277911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 13:20:32.279554: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 13:20:32.279589: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-19 13:20:32.279600: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-19 13:20:32.279609: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-19 13:20:32.281041: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-19 13:20:40.127519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 13:20:40.329916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.61406 max: 148.65078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0017752647399902344 length of segment : 44 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0003237724304199219 length of segment : 44 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 31 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0011730194091796875 length of segment : 42 length of segment : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.64922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 2333 time to create 1 rle with old method : 0.003961086273193359 length of segment : 49 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 37 time to create 1 rle with old method : 0.00012826919555664062 length of segment : 6 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0004787445068359375 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 4496 time to create 1 rle with old method : 0.005770683288574219 length of segment : 88 time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 6124 time to create 1 rle with old method : 0.00749659538269043 length of segment : 139 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 14911 time to create 1 rle with old method : 0.01742243766784668 length of segment : 173 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 6719 time to create 1 rle with old method : 0.008250713348388672 length of segment : 137 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0008764266967773438 length of segment : 70 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0015244483947753906 length of segment : 43 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004405975341796875 length of segment : 20 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.70547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0007452964782714844 length of segment : 21 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0011203289031982422 length of segment : 124 time for calcul the mask position with numpy : 0.0005490779876708984 nb_pixel_total : 42016 time to create 1 rle with old method : 0.04626202583312988 length of segment : 306 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -90.33281 max: 79.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.74297 max: 149.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 95 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 10 time for calcul the mask position with numpy : 0.0006649494171142578 nb_pixel_total : 7892 time to create 1 rle with old method : 0.01291346549987793 length of segment : 122 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 1083 time to create 1 rle with old method : 0.0020651817321777344 length of segment : 26 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 2426 time to create 1 rle with old method : 0.0043582916259765625 length of segment : 48 time for calcul the mask position with numpy : 0.0002694129943847656 nb_pixel_total : 731 time to create 1 rle with old method : 0.0012631416320800781 length of segment : 20 time for calcul the mask position with numpy : 0.0001609325408935547 nb_pixel_total : 534 time to create 1 rle with old method : 0.001066446304321289 length of segment : 29 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0008170604705810547 length of segment : 21 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 1731 time to create 1 rle with old method : 0.0034112930297851562 length of segment : 59 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 22 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0008337497711181641 length of segment : 24 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 21 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1610 time to create 1 rle with old method : 0.002160310745239258 length of segment : 61 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 16 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 1675 time to create 1 rle with old method : 0.0024476051330566406 length of segment : 59 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 28 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005619525909423828 length of segment : 17 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0009644031524658203 length of segment : 35 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00021839141845703125 length of segment : 10 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005967617034912109 length of segment : 25 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0008387565612792969 length of segment : 29 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.00020051002502441406 length of segment : 28 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1761 time to create 1 rle with old method : 0.002311229705810547 length of segment : 31 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002884864807128906 length of segment : 11 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 17 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.000621795654296875 length of segment : 23 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00013399124145507812 length of segment : 11 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00031065940856933594 length of segment : 10 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005652904510498047 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002906322479248047 length of segment : 15 time for calcul the mask position with numpy : 0.0002014636993408203 nb_pixel_total : 420 time to create 1 rle with old method : 0.001020669937133789 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002372264862060547 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001971721649169922 length of segment : 9 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 3071 time to create 1 rle with old method : 0.0038459300994873047 length of segment : 101 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002732276916503906 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002605915069580078 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00041365623474121094 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007836818695068359 length of segment : 35 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005390644073486328 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004818439483642578 length of segment : 21 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00017452239990234375 length of segment : 11 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00014972686767578125 length of segment : 10 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 20 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007584095001220703 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.24297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00044035911560058594 length of segment : 17 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 3540 time to create 1 rle with old method : 0.004447221755981445 length of segment : 166 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.001558065414428711 length of segment : 38 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0012638568878173828 length of segment : 24 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0009419918060302734 length of segment : 25 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1035 time to create 1 rle with old method : 0.001455545425415039 length of segment : 29 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0009872913360595703 length of segment : 33 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 20 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 5512 time to create 1 rle with old method : 0.007269382476806641 length of segment : 181 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 510 time to create 1 rle with old method : 0.0007708072662353516 length of segment : 25 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 12755 time to create 1 rle with old method : 0.016161203384399414 length of segment : 246 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0024809837341308594 length of segment : 141 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 1520 time to create 1 rle with old method : 0.0029058456420898438 length of segment : 135 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0025377273559570312 length of segment : 84 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0016334056854248047 length of segment : 52 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0012853145599365234 length of segment : 52 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1659 time to create 1 rle with old method : 0.0022592544555664062 length of segment : 39 time for calcul the mask position with numpy : 0.0003027915954589844 nb_pixel_total : 3302 time to create 1 rle with old method : 0.0044291019439697266 length of segment : 174 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 1741 time to create 1 rle with old method : 0.002382516860961914 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 10.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0010139942169189453 nb_pixel_total : 106071 time to create 1 rle with old method : 0.12131524085998535 length of segment : 283 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0008664131164550781 length of segment : 52 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1460 time to create 1 rle with old method : 0.002610445022583008 length of segment : 35 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2812 time to create 1 rle with old method : 0.004868268966674805 length of segment : 50 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 13 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2320 time to create 1 rle with old method : 0.0044476985931396484 length of segment : 70 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0020940303802490234 length of segment : 22 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0009510517120361328 length of segment : 25 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 2576 time to create 1 rle with old method : 0.008368968963623047 length of segment : 103 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 2174 time to create 1 rle with old method : 0.0027337074279785156 length of segment : 122 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003190040588378906 length of segment : 20 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2207 time to create 1 rle with old method : 0.002620220184326172 length of segment : 66 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008339881896972656 length of segment : 33 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00033092498779296875 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003597736358642578 length of segment : 24 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1719 time to create 1 rle with old method : 0.002117633819580078 length of segment : 62 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009429454803466797 length of segment : 51 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00023317337036132812 length of segment : 15 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006022453308105469 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.00041222572326660156 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 17 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00024008750915527344 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.43203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 37 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.000713348388671875 length of segment : 37 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.001051187515258789 length of segment : 35 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00035762786865234375 length of segment : 18 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020241737365722656 length of segment : 11 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.00048279762268066406 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004551410675048828 length of segment : 21 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006463527679443359 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.00046825408935546875 length of segment : 25 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 5236 time to create 1 rle with old method : 0.006472349166870117 length of segment : 158 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0008003711700439453 length of segment : 49 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005197525024414062 length of segment : 27 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0013518333435058594 length of segment : 30 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0008456707000732422 length of segment : 37 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.001085042953491211 length of segment : 40 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006880760192871094 length of segment : 34 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00029969215393066406 length of segment : 18 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2148 time to create 1 rle with old method : 0.0025517940521240234 length of segment : 70 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004944801330566406 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 38 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 922 time to create 1 rle with old method : 0.0011744499206542969 length of segment : 41 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009131431579589844 length of segment : 33 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 16 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001850128173828125 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 14 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009317398071289062 length of segment : 46 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001499652862548828 length of segment : 8 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.001111745834350586 length of segment : 54 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00031375885009765625 length of segment : 16 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008094310760498047 length of segment : 27 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002543926239013672 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00033473968505859375 length of segment : 16 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 820 time to create 1 rle with old method : 0.00104522705078125 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 580 time to create 1 rle with old method : 0.0008301734924316406 length of segment : 30 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002474784851074219 length of segment : 15 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0008871555328369141 length of segment : 33 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016427040100097656 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.88125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 23 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006868839263916016 length of segment : 37 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002446174621582031 length of segment : 19 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 10 time to create 1 rle with old method : 3.5762786865234375e-05 length of segment : 6 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 22 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013303756713867188 length of segment : 25 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 26 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007677078247070312 length of segment : 56 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007734298706054688 length of segment : 41 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.0009627342224121094 length of segment : 42 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004189014434814453 length of segment : 45 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008087158203125 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 23 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004444122314453125 length of segment : 66 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 36 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 40046 time to create 1 rle with old method : 0.04341387748718262 length of segment : 225 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.53203 max: 149.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 961 time to create 1 rle with old method : 0.0011603832244873047 length of segment : 42 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 16 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001513957977294922 length of segment : 26 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00012350082397460938 length of segment : 23 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1983 time to create 1 rle with old method : 0.0025565624237060547 length of segment : 31 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00013828277587890625 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.14531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2299 time to create 1 rle with old method : 0.003930330276489258 length of segment : 47 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0016193389892578125 length of segment : 40 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 41 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 6 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00015020370483398438 length of segment : 16 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.18047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 6412 time to create 1 rle with old method : 0.007692098617553711 length of segment : 145 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 4262 time to create 1 rle with old method : 0.005145549774169922 length of segment : 95 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0013093948364257812 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 7031 time to create 1 rle with old method : 0.009956121444702148 length of segment : 150 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0013756752014160156 length of segment : 45 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 981 time to create 1 rle with old method : 0.0012240409851074219 length of segment : 68 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 24 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004322528839111328 length of segment : 21 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 21 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.92031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006814002990722656 length of segment : 20 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 50682 time to create 1 rle with old method : 0.05504488945007324 length of segment : 258 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 894 time to create 1 rle with old method : 0.001050710678100586 length of segment : 119 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.001224517822265625 length of segment : 63 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.0011217594146728516 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -90.99297 max: 78.30703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.99297 max: 149.59219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 10 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0018248558044433594 length of segment : 30 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 10184 time to create 1 rle with old method : 0.013220787048339844 length of segment : 138 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 25 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2616 time to create 1 rle with old method : 0.0034821033477783203 length of segment : 48 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005850791931152344 length of segment : 24 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005619525909423828 length of segment : 26 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005810260772705078 length of segment : 17 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005500316619873047 length of segment : 34 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0006804466247558594 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.96953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 10 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007741451263427734 length of segment : 35 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0005085468292236328 length of segment : 24 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0011444091796875 length of segment : 33 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00013566017150878906 length of segment : 9 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003418922424316406 length of segment : 17 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0006475448608398438 length of segment : 25 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004420280456542969 length of segment : 18 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 11 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00022983551025390625 length of segment : 16 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006656646728515625 length of segment : 35 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008380413055419922 length of segment : 28 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006527900695800781 length of segment : 22 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0012519359588623047 length of segment : 38 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 632 time to create 1 rle with old method : 0.0008714199066162109 length of segment : 29 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011920928955078125 length of segment : 12 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1429 time to create 1 rle with old method : 0.0019066333770751953 length of segment : 40 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0012693405151367188 length of segment : 40 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007975101470947266 length of segment : 46 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00018715858459472656 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002887248992919922 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.23516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003769397735595703 length of segment : 17 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 1603 time to create 1 rle with old method : 0.002758026123046875 length of segment : 58 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.001895904541015625 length of segment : 42 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0014843940734863281 length of segment : 28 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005099773406982422 length of segment : 23 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 2447 time to create 1 rle with old method : 0.0033757686614990234 length of segment : 105 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.001651763916015625 length of segment : 42 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 13911 time to create 1 rle with old method : 0.017386198043823242 length of segment : 283 time for calcul the mask position with numpy : 0.0002319812774658203 nb_pixel_total : 7460 time to create 1 rle with old method : 0.009387493133544922 length of segment : 244 time for calcul the mask position with numpy : 0.0005288124084472656 nb_pixel_total : 28466 time to create 1 rle with old method : 0.04390454292297363 length of segment : 313 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.50625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 1080 time to create 1 rle with old method : 0.001806020736694336 length of segment : 98 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0031938552856445312 length of segment : 42 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 1729 time to create 1 rle with old method : 0.0023407936096191406 length of segment : 84 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0004062652587890625 length of segment : 33 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0017511844635009766 length of segment : 113 time for calcul the mask position with numpy : 0.00020122528076171875 nb_pixel_total : 3458 time to create 1 rle with old method : 0.004347801208496094 length of segment : 178 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 4142 time to create 1 rle with old method : 0.005087852478027344 length of segment : 213 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009315013885498047 nb_pixel_total : 105814 time to create 1 rle with old method : 0.1202085018157959 length of segment : 286 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.94375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008170604705810547 length of segment : 34 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0012226104736328125 length of segment : 25 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 3529 time to create 1 rle with old method : 0.0046367645263671875 length of segment : 60 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 2225 time to create 1 rle with old method : 0.002877473831176758 length of segment : 89 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0013005733489990234 length of segment : 51 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2672 time to create 1 rle with old method : 0.0031974315643310547 length of segment : 57 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0010480880737304688 length of segment : 55 time for calcul the mask position with numpy : 0.0002589225769042969 nb_pixel_total : 13930 time to create 1 rle with old method : 0.016122102737426758 length of segment : 219 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 12 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004303455352783203 length of segment : 19 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 854 time to create 1 rle with old method : 0.001142263412475586 length of segment : 64 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 41 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 646 time to create 1 rle with old method : 0.0007622241973876953 length of segment : 39 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002586841583251953 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002503395080566406 length of segment : 13 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 26 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003228187561035156 length of segment : 15 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.001116037368774414 length of segment : 41 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00034809112548828125 length of segment : 17 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 1055 time to create 1 rle with old method : 0.0013251304626464844 length of segment : 30 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 36 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004832744598388672 length of segment : 28 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0018129348754882812 length of segment : 52 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001926422119140625 length of segment : 9 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0009028911590576172 length of segment : 32 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.000759124755859375 length of segment : 38 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 5341 time to create 1 rle with old method : 0.006190299987792969 length of segment : 164 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004420280456542969 length of segment : 24 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006506443023681641 length of segment : 26 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 16 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007507801055908203 length of segment : 35 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005707740783691406 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.00042247772216796875 length of segment : 23 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010013580322265625 length of segment : 35 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004627704620361328 length of segment : 32 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.000789642333984375 length of segment : 50 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002760887145996094 length of segment : 18 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 19 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00041937828063964844 length of segment : 24 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0012214183807373047 length of segment : 55 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001475811004638672 length of segment : 10 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.000446319580078125 length of segment : 25 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004658699035644531 length of segment : 22 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005295276641845703 length of segment : 22 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00032520294189453125 length of segment : 34 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009710788726806641 length of segment : 39 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 13 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 10 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1755 time to create 1 rle with old method : 0.0022644996643066406 length of segment : 47 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00021314620971679688 length of segment : 14 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 10 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006074905395507812 length of segment : 26 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010747909545898438 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.23672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004954338073730469 length of segment : 23 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00023126602172851562 length of segment : 36 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00023126602172851562 length of segment : 15 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0010771751403808594 length of segment : 77 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0007581710815429688 length of segment : 38 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006313323974609375 length of segment : 25 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 21 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.00035500526428222656 length of segment : 22 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00034928321838378906 length of segment : 25 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.00061798095703125 length of segment : 30 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1210 time to create 1 rle with old method : 0.0016598701477050781 length of segment : 70 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 35 time to create 1 rle with old method : 8.106231689453125e-05 length of segment : 7 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0007767677307128906 length of segment : 27 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.00077056884765625 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.38750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 44 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.64531 max: 148.92031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0011699199676513672 length of segment : 32 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011754035949707031 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.001064300537109375 length of segment : 29 length of segment : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2549 time to create 1 rle with old method : 0.003708362579345703 length of segment : 52 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.001249074935913086 length of segment : 53 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.00066375732421875 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 6201 time to create 1 rle with old method : 0.0074214935302734375 length of segment : 126 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 1484 time to create 1 rle with old method : 0.001961231231689453 length of segment : 80 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 990 time to create 1 rle with old method : 0.001241445541381836 length of segment : 66 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 3274 time to create 1 rle with old method : 0.0043103694915771484 length of segment : 111 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0015604496002197266 length of segment : 44 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00037789344787597656 length of segment : 19 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006937980651855469 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.60781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007674694061279297 length of segment : 20 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 45569 time to create 1 rle with old method : 0.05243563652038574 length of segment : 307 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1828 time to create 1 rle with old method : 0.0024538040161132812 length of segment : 76 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -93.48906 max: 75.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.23125 max: 149.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001742839813232422 length of segment : 10 time for calcul the mask position with numpy : 0.00020503997802734375 nb_pixel_total : 10436 time to create 1 rle with old method : 0.012060165405273438 length of segment : 136 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0014812946319580078 length of segment : 27 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005919933319091797 length of segment : 28 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 2814 time to create 1 rle with old method : 0.003469228744506836 length of segment : 53 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002593994140625 length of segment : 25 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1291 time to create 1 rle with old method : 0.0017595291137695312 length of segment : 56 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005786418914794922 length of segment : 23 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006802082061767578 length of segment : 21 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002968311309814453 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006279945373535156 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.00081634521484375 length of segment : 22 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 49 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.12969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00030994415283203125 length of segment : 10 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008282661437988281 length of segment : 37 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0014605522155761719 length of segment : 46 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004999637603759766 length of segment : 23 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007402896881103516 length of segment : 27 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002484321594238281 length of segment : 17 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.001260519027709961 length of segment : 33 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004425048828125 length of segment : 20 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 30 time to create 1 rle with old method : 7.2479248046875e-05 length of segment : 6 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 827 time to create 1 rle with old method : 0.0011186599731445312 length of segment : 63 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 21 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003542900085449219 length of segment : 13 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005943775177001953 length of segment : 31 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007288455963134766 length of segment : 35 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007073879241943359 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.000614166259765625 length of segment : 21 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1386 time to create 1 rle with old method : 0.0018169879913330078 length of segment : 39 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.0001347064971923828 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 11 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 11 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 7 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.0002315044403076172 length of segment : 11 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006389617919921875 length of segment : 22 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001723766326904297 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.05938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 4152 time to create 1 rle with old method : 0.004811525344848633 length of segment : 98 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 17 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 963 time to create 1 rle with old method : 0.0013043880462646484 length of segment : 27 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1398 time to create 1 rle with old method : 0.00185394287109375 length of segment : 31 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 870 time to create 1 rle with old method : 0.0011327266693115234 length of segment : 37 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.0010082721710205078 length of segment : 28 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1227 time to create 1 rle with old method : 0.001739501953125 length of segment : 42 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1202 time to create 1 rle with old method : 0.00150299072265625 length of segment : 39 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0019080638885498047 length of segment : 46 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009603500366210938 length of segment : 44 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 11932 time to create 1 rle with old method : 0.01363062858581543 length of segment : 234 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.18594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0020499229431152344 length of segment : 135 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2123 time to create 1 rle with old method : 0.002731800079345703 length of segment : 144 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1177 time to create 1 rle with old method : 0.0015327930450439453 length of segment : 43 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1150 time to create 1 rle with old method : 0.0014691352844238281 length of segment : 46 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1700 time to create 1 rle with old method : 0.002131223678588867 length of segment : 86 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0028142929077148438 length of segment : 260 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0011858940124511719 length of segment : 46 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002510547637939453 length of segment : 30 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0020732879638671875 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 9.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0009181499481201172 nb_pixel_total : 106171 time to create 1 rle with old method : 0.12022042274475098 length of segment : 283 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007698535919189453 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.62344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1926 time to create 1 rle with old method : 0.0023827552795410156 length of segment : 59 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 653 time to create 1 rle with old method : 0.0008091926574707031 length of segment : 32 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 3528 time to create 1 rle with old method : 0.004287004470825195 length of segment : 60 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1851 time to create 1 rle with old method : 0.002423524856567383 length of segment : 104 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.001073598861694336 length of segment : 26 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00032329559326171875 length of segment : 26 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1507 time to create 1 rle with old method : 0.0019307136535644531 length of segment : 50 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006761550903320312 length of segment : 50 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014929771423339844 length of segment : 93 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003859996795654297 length of segment : 20 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006816387176513672 length of segment : 28 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1312 time to create 1 rle with old method : 0.001542806625366211 length of segment : 69 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.0011782646179199219 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.52578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 38 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0009365081787109375 length of segment : 38 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003771781921386719 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006561279296875 length of segment : 36 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.0011324882507324219 length of segment : 40 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 11 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 14 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0019295215606689453 length of segment : 30 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0011644363403320312 length of segment : 50 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 21 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001614093780517578 length of segment : 16 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009684562683105469 length of segment : 51 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 7425 time to create 1 rle with old method : 0.008489131927490234 length of segment : 87 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 21 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00028228759765625 length of segment : 17 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008358955383300781 length of segment : 37 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004143714904785156 length of segment : 30 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0006868839263916016 length of segment : 50 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005452632904052734 length of segment : 28 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00022339820861816406 length of segment : 15 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005304813385009766 length of segment : 27 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 17 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005471706390380859 length of segment : 36 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00015807151794433594 length of segment : 11 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00017571449279785156 length of segment : 14 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.001123189926147461 length of segment : 37 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0016617774963378906 length of segment : 33 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.000331878662109375 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.0001461505889892578 length of segment : 11 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006034374237060547 length of segment : 39 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 907 time to create 1 rle with old method : 0.0012247562408447266 length of segment : 32 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00031113624572753906 length of segment : 16 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012090206146240234 length of segment : 43 time for calcul the mask position with numpy : 2.6702880859375e-05 nb_pixel_total : 26 time to create 1 rle with old method : 5.888938903808594e-05 length of segment : 7 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 22 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 10 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1448 time to create 1 rle with old method : 0.0017406940460205078 length of segment : 42 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011420249938964844 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005030632019042969 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008065700531005859 length of segment : 41 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003483295440673828 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006184577941894531 length of segment : 24 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0007262229919433594 length of segment : 28 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002789497375488281 length of segment : 21 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007698535919189453 length of segment : 48 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00038242340087890625 length of segment : 29 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005671977996826172 length of segment : 69 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011131763458251953 length of segment : 45 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 31 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 619 time to create 1 rle with old method : 0.0008053779602050781 length of segment : 37 Detection mask done ! Trying to reset tf kernel 44407 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 439 len(list_Values) 439 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 439 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 439 chid ids of type : 4228 Number RLEs to save : 20195 save missing photos in datou_result : time spend for datou_step_exec : 28.046427011489868 time spend to save output : 1.4001142978668213 total time spend for step 1 : 29.44654130935669 step2:brightness Wed Feb 19 13:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739967628_44202_1338532393_be0d39826a05c9fc7421c2ca8cccc107.jpg treat image : temp/1739967628_44202_1338532390_da0ee1d08729180179e6c7fa40597165.jpg treat image : temp/1739967628_44202_1338532387_f0a86cb9ac37ecb8d4ba4502d11eb6ff.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.013071298599243164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 3.9430041313171387 save missing photos in datou_result : time spend for datou_step_exec : 0.7268095016479492 time spend to save output : 3.9614202976226807 total time spend for step 2 : 4.68822979927063 step3:blur_detection Wed Feb 19 13:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739967628_44202_1338532393_be0d39826a05c9fc7421c2ca8cccc107.jpg resize: (1080, 1920) 1338532393 -7.9009723662777835 treat image : temp/1739967628_44202_1338532390_da0ee1d08729180179e6c7fa40597165.jpg resize: (1080, 1920) 1338532390 -7.905644662770203 treat image : temp/1739967628_44202_1338532387_f0a86cb9ac37ecb8d4ba4502d11eb6ff.jpg resize: (1080, 1920) 1338532387 -7.839110169600698 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.012620210647583008 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.012429237365722656 save missing photos in datou_result : time spend for datou_step_exec : 2.6061108112335205 time spend to save output : 0.029761552810668945 total time spend for step 3 : 2.6358723640441895 step4:rle_unique_nms_with_priority Wed Feb 19 13:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 439 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 154 nb_hashtags : 6 time to prepare the origin masks : 1.0363948345184326 time for calcul the mask position with numpy : 0.03633284568786621 nb_pixel_total : 1739583 time to create 1 rle with new method : 0.41385579109191895 time for calcul the mask position with numpy : 0.00848388671875 nb_pixel_total : 14911 time to create 1 rle with old method : 0.0160672664642334 time for calcul the mask position with numpy : 0.007895708084106445 nb_pixel_total : 4496 time to create 1 rle with old method : 0.004854679107666016 time for calcul the mask position with numpy : 0.007750272750854492 nb_pixel_total : 866 time to create 1 rle with old method : 0.0009953975677490234 time for calcul the mask position with numpy : 0.007929563522338867 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011112689971923828 time for calcul the mask position with numpy : 0.008134841918945312 nb_pixel_total : 208 time to create 1 rle with old method : 0.00024819374084472656 time for calcul the mask position with numpy : 0.008034229278564453 nb_pixel_total : 145 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.007950067520141602 nb_pixel_total : 139 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.008055448532104492 nb_pixel_total : 42016 time to create 1 rle with old method : 0.043848276138305664 time for calcul the mask position with numpy : 0.008114814758300781 nb_pixel_total : 29 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.007895231246948242 nb_pixel_total : 37 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.007819414138793945 nb_pixel_total : 2333 time to create 1 rle with old method : 0.0023651123046875 time for calcul the mask position with numpy : 0.007652759552001953 nb_pixel_total : 630 time to create 1 rle with old method : 0.0006914138793945312 time for calcul the mask position with numpy : 0.007616996765136719 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.007681131362915039 nb_pixel_total : 6124 time to create 1 rle with old method : 0.006180286407470703 time for calcul the mask position with numpy : 0.008003473281860352 nb_pixel_total : 6719 time to create 1 rle with old method : 0.0072438716888427734 time for calcul the mask position with numpy : 0.008072137832641602 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0011968612670898438 time for calcul the mask position with numpy : 0.00792837142944336 nb_pixel_total : 526 time to create 1 rle with old method : 0.0005698204040527344 time for calcul the mask position with numpy : 0.008082866668701172 nb_pixel_total : 1761 time to create 1 rle with old method : 0.0019626617431640625 time for calcul the mask position with numpy : 0.007982969284057617 nb_pixel_total : 5512 time to create 1 rle with old method : 0.006323337554931641 time for calcul the mask position with numpy : 0.008008480072021484 nb_pixel_total : 560 time to create 1 rle with old method : 0.000629425048828125 time for calcul the mask position with numpy : 0.007817506790161133 nb_pixel_total : 3540 time to create 1 rle with old method : 0.003655672073364258 time for calcul the mask position with numpy : 0.007924079895019531 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005533695220947266 time for calcul the mask position with numpy : 0.008052825927734375 nb_pixel_total : 3071 time to create 1 rle with old method : 0.0034110546112060547 time for calcul the mask position with numpy : 0.007987499237060547 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0012378692626953125 time for calcul the mask position with numpy : 0.007750034332275391 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001506805419921875 time for calcul the mask position with numpy : 0.007643938064575195 nb_pixel_total : 1659 time to create 1 rle with old method : 0.001672983169555664 time for calcul the mask position with numpy : 0.007710456848144531 nb_pixel_total : 7892 time to create 1 rle with old method : 0.00794219970703125 time for calcul the mask position with numpy : 0.0076596736907958984 nb_pixel_total : 14 time to create 1 rle with old method : 3.409385681152344e-05 time for calcul the mask position with numpy : 0.0077435970306396484 nb_pixel_total : 276 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.007808685302734375 nb_pixel_total : 16 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.007634401321411133 nb_pixel_total : 675 time to create 1 rle with old method : 0.0007426738739013672 time for calcul the mask position with numpy : 0.0075836181640625 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0020728111267089844 time for calcul the mask position with numpy : 0.007624626159667969 nb_pixel_total : 346 time to create 1 rle with old method : 0.0003745555877685547 time for calcul the mask position with numpy : 0.007606029510498047 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.007573843002319336 nb_pixel_total : 12747 time to create 1 rle with old method : 0.01327061653137207 time for calcul the mask position with numpy : 0.007909297943115234 nb_pixel_total : 209 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.007903814315795898 nb_pixel_total : 510 time to create 1 rle with old method : 0.0005936622619628906 time for calcul the mask position with numpy : 0.007673978805541992 nb_pixel_total : 3302 time to create 1 rle with old method : 0.003509044647216797 time for calcul the mask position with numpy : 0.007648944854736328 nb_pixel_total : 134 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.007622718811035156 nb_pixel_total : 112 time to create 1 rle with old method : 0.00013113021850585938 time for calcul the mask position with numpy : 0.007691383361816406 nb_pixel_total : 528 time to create 1 rle with old method : 0.0006163120269775391 time for calcul the mask position with numpy : 0.007756710052490234 nb_pixel_total : 270 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.007634878158569336 nb_pixel_total : 406 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.007842063903808594 nb_pixel_total : 214 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.007968664169311523 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0011775493621826172 time for calcul the mask position with numpy : 0.007955789566040039 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.00788736343383789 nb_pixel_total : 220 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.007899999618530273 nb_pixel_total : 2426 time to create 1 rle with old method : 0.002586841583251953 time for calcul the mask position with numpy : 0.008017539978027344 nb_pixel_total : 282 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.007823705673217773 nb_pixel_total : 320 time to create 1 rle with old method : 0.000377655029296875 time for calcul the mask position with numpy : 0.007682085037231445 nb_pixel_total : 591 time to create 1 rle with old method : 0.0006315708160400391 time for calcul the mask position with numpy : 0.007737398147583008 nb_pixel_total : 8 time to create 1 rle with old method : 1.8596649169921875e-05 time for calcul the mask position with numpy : 0.007782459259033203 nb_pixel_total : 95 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.007924079895019531 nb_pixel_total : 107 time to create 1 rle with old method : 0.00013375282287597656 time for calcul the mask position with numpy : 0.0078067779541015625 nb_pixel_total : 181 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.007834196090698242 nb_pixel_total : 195 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.007790565490722656 nb_pixel_total : 1 time to create 1 rle with old method : 6.67572021484375e-06 time for calcul the mask position with numpy : 0.007674217224121094 nb_pixel_total : 183 time to create 1 rle with old method : 0.00021839141845703125 time for calcul the mask position with numpy : 0.0079193115234375 nb_pixel_total : 149 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.0077686309814453125 nb_pixel_total : 397 time to create 1 rle with old method : 0.00040793418884277344 time for calcul the mask position with numpy : 0.007744312286376953 nb_pixel_total : 1731 time to create 1 rle with old method : 0.0018658638000488281 time for calcul the mask position with numpy : 0.007927179336547852 nb_pixel_total : 1741 time to create 1 rle with old method : 0.001850128173828125 time for calcul the mask position with numpy : 0.0076618194580078125 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006244182586669922 time for calcul the mask position with numpy : 0.00774693489074707 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003426074981689453 time for calcul the mask position with numpy : 0.0078277587890625 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005221366882324219 time for calcul the mask position with numpy : 0.007734537124633789 nb_pixel_total : 2 time to create 1 rle with old method : 1.1205673217773438e-05 time for calcul the mask position with numpy : 0.007803201675415039 nb_pixel_total : 20 time to create 1 rle with old method : 7.009506225585938e-05 time for calcul the mask position with numpy : 0.007722139358520508 nb_pixel_total : 447 time to create 1 rle with old method : 0.0004885196685791016 time for calcul the mask position with numpy : 0.007700443267822266 nb_pixel_total : 18 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.007663249969482422 nb_pixel_total : 60 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.00764012336730957 nb_pixel_total : 189 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.007616519927978516 nb_pixel_total : 127 time to create 1 rle with old method : 0.00014853477478027344 time for calcul the mask position with numpy : 0.007752418518066406 nb_pixel_total : 364 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.007752418518066406 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006742477416992188 time for calcul the mask position with numpy : 0.00799250602722168 nb_pixel_total : 534 time to create 1 rle with old method : 0.0006198883056640625 time for calcul the mask position with numpy : 0.007821083068847656 nb_pixel_total : 1083 time to create 1 rle with old method : 0.001123189926147461 time for calcul the mask position with numpy : 0.007961273193359375 nb_pixel_total : 879 time to create 1 rle with old method : 0.0008931159973144531 time for calcul the mask position with numpy : 0.007888078689575195 nb_pixel_total : 613 time to create 1 rle with old method : 0.0006732940673828125 time for calcul the mask position with numpy : 0.007689237594604492 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001857280731201172 time for calcul the mask position with numpy : 0.0076749324798583984 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001533031463623047 time for calcul the mask position with numpy : 0.00817418098449707 nb_pixel_total : 106071 time to create 1 rle with old method : 0.10748076438903809 time for calcul the mask position with numpy : 0.007663249969482422 nb_pixel_total : 300 time to create 1 rle with old method : 0.0003361701965332031 time for calcul the mask position with numpy : 0.00780487060546875 nb_pixel_total : 681 time to create 1 rle with old method : 0.0007257461547851562 time for calcul the mask position with numpy : 0.007873773574829102 nb_pixel_total : 272 time to create 1 rle with old method : 0.00032830238342285156 time for calcul the mask position with numpy : 0.00768280029296875 nb_pixel_total : 76 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.007635593414306641 nb_pixel_total : 2812 time to create 1 rle with old method : 0.0028259754180908203 time for calcul the mask position with numpy : 0.0076410770416259766 nb_pixel_total : 2320 time to create 1 rle with old method : 0.0024521350860595703 time for calcul the mask position with numpy : 0.007692098617553711 nb_pixel_total : 220 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.007730245590209961 nb_pixel_total : 10 time to create 1 rle with old method : 3.361701965332031e-05 time for calcul the mask position with numpy : 0.0076754093170166016 nb_pixel_total : 37 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.007639408111572266 nb_pixel_total : 227 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.007840156555175781 nb_pixel_total : 328 time to create 1 rle with old method : 0.0003540515899658203 time for calcul the mask position with numpy : 0.007649421691894531 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002574920654296875 time for calcul the mask position with numpy : 0.007665395736694336 nb_pixel_total : 95 time to create 1 rle with old method : 0.00011181831359863281 time for calcul the mask position with numpy : 0.007710695266723633 nb_pixel_total : 598 time to create 1 rle with old method : 0.0006077289581298828 time for calcul the mask position with numpy : 0.007788419723510742 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.007721900939941406 nb_pixel_total : 530 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.008942604064941406 nb_pixel_total : 377 time to create 1 rle with old method : 0.0006220340728759766 time for calcul the mask position with numpy : 0.009606361389160156 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.009614944458007812 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020813941955566406 time for calcul the mask position with numpy : 0.009594202041625977 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0016720294952392578 time for calcul the mask position with numpy : 0.009580612182617188 nb_pixel_total : 798 time to create 1 rle with old method : 0.0013134479522705078 time for calcul the mask position with numpy : 0.009579896926879883 nb_pixel_total : 320 time to create 1 rle with old method : 0.0005419254302978516 time for calcul the mask position with numpy : 0.00958108901977539 nb_pixel_total : 445 time to create 1 rle with old method : 0.0007953643798828125 time for calcul the mask position with numpy : 0.009428977966308594 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.007912635803222656 nb_pixel_total : 143 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.007961034774780273 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.00797891616821289 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.007708072662353516 nb_pixel_total : 39422 time to create 1 rle with old method : 0.038893938064575195 time for calcul the mask position with numpy : 0.007746696472167969 nb_pixel_total : 194 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.007828474044799805 nb_pixel_total : 167 time to create 1 rle with old method : 0.00018525123596191406 time for calcul the mask position with numpy : 0.007914543151855469 nb_pixel_total : 98 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.007933616638183594 nb_pixel_total : 2576 time to create 1 rle with old method : 0.0027561187744140625 time for calcul the mask position with numpy : 0.007924318313598633 nb_pixel_total : 26 time to create 1 rle with old method : 5.245208740234375e-05 time for calcul the mask position with numpy : 0.007926225662231445 nb_pixel_total : 596 time to create 1 rle with old method : 0.0006945133209228516 time for calcul the mask position with numpy : 0.008011102676391602 nb_pixel_total : 768 time to create 1 rle with old method : 0.0008938312530517578 time for calcul the mask position with numpy : 0.007979393005371094 nb_pixel_total : 1460 time to create 1 rle with old method : 0.0014905929565429688 time for calcul the mask position with numpy : 0.007835865020751953 nb_pixel_total : 513 time to create 1 rle with old method : 0.0005521774291992188 time for calcul the mask position with numpy : 0.007662296295166016 nb_pixel_total : 17 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.007797956466674805 nb_pixel_total : 357 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005176067352294922 time for calcul the mask position with numpy : 0.007834196090698242 nb_pixel_total : 70 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.007835865020751953 nb_pixel_total : 2174 time to create 1 rle with old method : 0.0024809837341308594 time for calcul the mask position with numpy : 0.0077283382415771484 nb_pixel_total : 857 time to create 1 rle with old method : 0.0009071826934814453 time for calcul the mask position with numpy : 0.007883548736572266 nb_pixel_total : 766 time to create 1 rle with old method : 0.0008139610290527344 time for calcul the mask position with numpy : 0.0077724456787109375 nb_pixel_total : 2148 time to create 1 rle with old method : 0.0022606849670410156 time for calcul the mask position with numpy : 0.00803232192993164 nb_pixel_total : 922 time to create 1 rle with old method : 0.0009503364562988281 time for calcul the mask position with numpy : 0.008091449737548828 nb_pixel_total : 143 time to create 1 rle with old method : 0.00015974044799804688 time for calcul the mask position with numpy : 0.00791025161743164 nb_pixel_total : 599 time to create 1 rle with old method : 0.0006477832794189453 time for calcul the mask position with numpy : 0.007925033569335938 nb_pixel_total : 515 time to create 1 rle with old method : 0.0005550384521484375 time for calcul the mask position with numpy : 0.007937192916870117 nb_pixel_total : 274 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.0076770782470703125 nb_pixel_total : 711 time to create 1 rle with old method : 0.0007634162902832031 time for calcul the mask position with numpy : 0.007997751235961914 nb_pixel_total : 420 time to create 1 rle with old method : 0.0004909038543701172 time for calcul the mask position with numpy : 0.008048772811889648 nb_pixel_total : 5 time to create 1 rle with old method : 1.33514404296875e-05 time for calcul the mask position with numpy : 0.008001565933227539 nb_pixel_total : 624 time to create 1 rle with old method : 0.000720977783203125 time for calcul the mask position with numpy : 0.008149147033691406 nb_pixel_total : 5236 time to create 1 rle with old method : 0.005945920944213867 time for calcul the mask position with numpy : 0.00809788703918457 nb_pixel_total : 1719 time to create 1 rle with old method : 0.0020301342010498047 time for calcul the mask position with numpy : 0.007995367050170898 nb_pixel_total : 955 time to create 1 rle with old method : 0.0010836124420166016 time for calcul the mask position with numpy : 0.00815272331237793 nb_pixel_total : 163 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.00792694091796875 nb_pixel_total : 545 time to create 1 rle with old method : 0.0005886554718017578 time for calcul the mask position with numpy : 0.008009195327758789 nb_pixel_total : 321 time to create 1 rle with old method : 0.00036215782165527344 time for calcul the mask position with numpy : 0.008052587509155273 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.007992982864379883 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005323886871337891 time for calcul the mask position with numpy : 0.0079498291015625 nb_pixel_total : 727 time to create 1 rle with old method : 0.0008425712585449219 time for calcul the mask position with numpy : 0.008061408996582031 nb_pixel_total : 10 time to create 1 rle with old method : 1.7881393432617188e-05 time for calcul the mask position with numpy : 0.00771784782409668 nb_pixel_total : 587 time to create 1 rle with old method : 0.0006186962127685547 time for calcul the mask position with numpy : 0.007811546325683594 nb_pixel_total : 39 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.00796651840209961 nb_pixel_total : 291 time to create 1 rle with old method : 0.00033545494079589844 time for calcul the mask position with numpy : 0.008169412612915039 nb_pixel_total : 112 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.007901906967163086 nb_pixel_total : 820 time to create 1 rle with old method : 0.0008759498596191406 time for calcul the mask position with numpy : 0.007821798324584961 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003237724304199219 time for calcul the mask position with numpy : 0.007933855056762695 nb_pixel_total : 213 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.007705211639404297 nb_pixel_total : 2 time to create 1 rle with old method : 9.5367431640625e-06 time for calcul the mask position with numpy : 0.007697582244873047 nb_pixel_total : 83 time to create 1 rle with old method : 8.940696716308594e-05 create new chi : 2.0334107875823975 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01170492172241211 batch 1 Loaded 155 chid ids of type : 4230 Number RLEs to save : 13911 TO DO : save crop sub photo not yet done ! save time : 1.3294410705566406 nb_obj : 141 nb_hashtags : 6 time to prepare the origin masks : 2.3033223152160645 time for calcul the mask position with numpy : 0.03390240669250488 nb_pixel_total : 1752775 time to create 1 rle with new method : 0.059798240661621094 time for calcul the mask position with numpy : 0.006256580352783203 nb_pixel_total : 4262 time to create 1 rle with old method : 0.004572868347167969 time for calcul the mask position with numpy : 0.005768299102783203 nb_pixel_total : 894 time to create 1 rle with old method : 0.000993967056274414 time for calcul the mask position with numpy : 0.005947113037109375 nb_pixel_total : 22 time to create 1 rle with old method : 4.9591064453125e-05 time for calcul the mask position with numpy : 0.005745887756347656 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003745555877685547 time for calcul the mask position with numpy : 0.00590062141418457 nb_pixel_total : 961 time to create 1 rle with old method : 0.0011756420135498047 time for calcul the mask position with numpy : 0.005723476409912109 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.009580850601196289 nb_pixel_total : 1983 time to create 1 rle with old method : 0.0019898414611816406 time for calcul the mask position with numpy : 0.009415626525878906 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011730194091796875 time for calcul the mask position with numpy : 0.009655237197875977 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.00965738296508789 nb_pixel_total : 41 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.009822368621826172 nb_pixel_total : 34 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.009564638137817383 nb_pixel_total : 2299 time to create 1 rle with old method : 0.002796649932861328 time for calcul the mask position with numpy : 0.009743452072143555 nb_pixel_total : 50682 time to create 1 rle with old method : 0.05543923377990723 time for calcul the mask position with numpy : 0.009771108627319336 nb_pixel_total : 981 time to create 1 rle with old method : 0.0011248588562011719 time for calcul the mask position with numpy : 0.009697675704956055 nb_pixel_total : 206 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.009525775909423828 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.006023406982421875 nb_pixel_total : 937 time to create 1 rle with old method : 0.001094818115234375 time for calcul the mask position with numpy : 0.005728960037231445 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009543895721435547 time for calcul the mask position with numpy : 0.005789756774902344 nb_pixel_total : 6412 time to create 1 rle with old method : 0.0070247650146484375 time for calcul the mask position with numpy : 0.005734443664550781 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005238056182861328 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 7031 time to create 1 rle with old method : 0.007391452789306641 time for calcul the mask position with numpy : 0.0057065486907958984 nb_pixel_total : 841 time to create 1 rle with old method : 0.00087738037109375 time for calcul the mask position with numpy : 0.005764961242675781 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0012302398681640625 time for calcul the mask position with numpy : 0.0057485103607177734 nb_pixel_total : 986 time to create 1 rle with old method : 0.0011720657348632812 time for calcul the mask position with numpy : 0.005939006805419922 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006008148193359375 time for calcul the mask position with numpy : 0.006699800491333008 nb_pixel_total : 1429 time to create 1 rle with old method : 0.0015103816986083984 time for calcul the mask position with numpy : 0.005727052688598633 nb_pixel_total : 2447 time to create 1 rle with old method : 0.0027043819427490234 time for calcul the mask position with numpy : 0.0058269500732421875 nb_pixel_total : 7460 time to create 1 rle with old method : 0.00795435905456543 time for calcul the mask position with numpy : 0.006682157516479492 nb_pixel_total : 62 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.009389638900756836 nb_pixel_total : 1603 time to create 1 rle with old method : 0.0018775463104248047 time for calcul the mask position with numpy : 0.0097503662109375 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0016200542449951172 time for calcul the mask position with numpy : 0.009793519973754883 nb_pixel_total : 10184 time to create 1 rle with old method : 0.011418819427490234 time for calcul the mask position with numpy : 0.009113073348999023 nb_pixel_total : 1839 time to create 1 rle with old method : 0.0021026134490966797 time for calcul the mask position with numpy : 0.005539894104003906 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002932548522949219 time for calcul the mask position with numpy : 0.00552678108215332 nb_pixel_total : 14801 time to create 1 rle with old method : 0.015488147735595703 time for calcul the mask position with numpy : 0.006026744842529297 nb_pixel_total : 13911 time to create 1 rle with old method : 0.015187501907348633 time for calcul the mask position with numpy : 0.005769968032836914 nb_pixel_total : 167 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.005896806716918945 nb_pixel_total : 65 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.005658626556396484 nb_pixel_total : 903 time to create 1 rle with old method : 0.0009696483612060547 time for calcul the mask position with numpy : 0.005518674850463867 nb_pixel_total : 913 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.0055201053619384766 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0012111663818359375 time for calcul the mask position with numpy : 0.005492448806762695 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.005729198455810547 nb_pixel_total : 3458 time to create 1 rle with old method : 0.0036194324493408203 time for calcul the mask position with numpy : 0.005526065826416016 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006015300750732422 time for calcul the mask position with numpy : 0.0054819583892822266 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008399486541748047 time for calcul the mask position with numpy : 0.005674123764038086 nb_pixel_total : 292 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.0055124759674072266 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0011436939239501953 time for calcul the mask position with numpy : 0.005545139312744141 nb_pixel_total : 178 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.005811452865600586 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.005772829055786133 nb_pixel_total : 2616 time to create 1 rle with old method : 0.003079652786254883 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005881786346435547 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0013229846954345703 time for calcul the mask position with numpy : 0.0060656070709228516 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.006001472473144531 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001442432403564453 time for calcul the mask position with numpy : 0.005969047546386719 nb_pixel_total : 231 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.005902767181396484 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004696846008300781 time for calcul the mask position with numpy : 0.005897998809814453 nb_pixel_total : 155 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.006175994873046875 nb_pixel_total : 1729 time to create 1 rle with old method : 0.002003192901611328 time for calcul the mask position with numpy : 0.006310939788818359 nb_pixel_total : 572 time to create 1 rle with old method : 0.0006761550903320312 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005359649658203125 time for calcul the mask position with numpy : 0.006035327911376953 nb_pixel_total : 379 time to create 1 rle with old method : 0.00046753883361816406 time for calcul the mask position with numpy : 0.00612950325012207 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005526542663574219 time for calcul the mask position with numpy : 0.0060384273529052734 nb_pixel_total : 351 time to create 1 rle with old method : 0.00041866302490234375 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 63 time to create 1 rle with old method : 8.225440979003906e-05 time for calcul the mask position with numpy : 0.005821704864501953 nb_pixel_total : 188 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.0057010650634765625 nb_pixel_total : 144 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 550 time to create 1 rle with old method : 0.0006377696990966797 time for calcul the mask position with numpy : 0.005708932876586914 nb_pixel_total : 332 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.00589752197265625 nb_pixel_total : 1299 time to create 1 rle with old method : 0.001407623291015625 time for calcul the mask position with numpy : 0.005839347839355469 nb_pixel_total : 109 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.005789995193481445 nb_pixel_total : 441 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.005919218063354492 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004127025604248047 time for calcul the mask position with numpy : 0.00583195686340332 nb_pixel_total : 154 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.006101131439208984 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.006075143814086914 nb_pixel_total : 103 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 105814 time to create 1 rle with old method : 0.10727310180664062 time for calcul the mask position with numpy : 0.005936145782470703 nb_pixel_total : 3529 time to create 1 rle with old method : 0.0038805007934570312 time for calcul the mask position with numpy : 0.005953311920166016 nb_pixel_total : 445 time to create 1 rle with old method : 0.0004875659942626953 time for calcul the mask position with numpy : 0.005708217620849609 nb_pixel_total : 192 time to create 1 rle with old method : 0.00022172927856445312 time for calcul the mask position with numpy : 0.005873918533325195 nb_pixel_total : 207 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.009026050567626953 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.005805015563964844 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004074573516845703 time for calcul the mask position with numpy : 0.006575345993041992 nb_pixel_total : 238 time to create 1 rle with old method : 0.00035643577575683594 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012946128845214844 time for calcul the mask position with numpy : 0.005812883377075195 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006258487701416016 time for calcul the mask position with numpy : 0.005860328674316406 nb_pixel_total : 644 time to create 1 rle with old method : 0.0007305145263671875 time for calcul the mask position with numpy : 0.00574183464050293 nb_pixel_total : 28 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.005598306655883789 nb_pixel_total : 161 time to create 1 rle with old method : 0.00020074844360351562 time for calcul the mask position with numpy : 0.005662679672241211 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003466606140136719 time for calcul the mask position with numpy : 0.00583338737487793 nb_pixel_total : 202 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.0059528350830078125 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.0061380863189697266 nb_pixel_total : 13930 time to create 1 rle with old method : 0.015581130981445312 time for calcul the mask position with numpy : 0.0059053897857666016 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.005878925323486328 nb_pixel_total : 877 time to create 1 rle with old method : 0.00104522705078125 time for calcul the mask position with numpy : 0.005928516387939453 nb_pixel_total : 1055 time to create 1 rle with old method : 0.0011265277862548828 time for calcul the mask position with numpy : 0.005961179733276367 nb_pixel_total : 356 time to create 1 rle with old method : 0.00042557716369628906 time for calcul the mask position with numpy : 0.0057125091552734375 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.0058574676513671875 nb_pixel_total : 298 time to create 1 rle with old method : 0.00033593177795410156 time for calcul the mask position with numpy : 0.006018400192260742 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001666545867919922 time for calcul the mask position with numpy : 0.006018638610839844 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.005831241607666016 nb_pixel_total : 3 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.00587010383605957 nb_pixel_total : 2294 time to create 1 rle with old method : 0.0025963783264160156 time for calcul the mask position with numpy : 0.005960226058959961 nb_pixel_total : 387 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.005957841873168945 nb_pixel_total : 2225 time to create 1 rle with old method : 0.00231170654296875 time for calcul the mask position with numpy : 0.005888223648071289 nb_pixel_total : 646 time to create 1 rle with old method : 0.0007674694061279297 time for calcul the mask position with numpy : 0.0062732696533203125 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006649494171142578 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 362 time to create 1 rle with old method : 0.00038361549377441406 time for calcul the mask position with numpy : 0.005893230438232422 nb_pixel_total : 133 time to create 1 rle with old method : 0.00018310546875 time for calcul the mask position with numpy : 0.0059223175048828125 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004172325134277344 time for calcul the mask position with numpy : 0.005992412567138672 nb_pixel_total : 35 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.005884647369384766 nb_pixel_total : 854 time to create 1 rle with old method : 0.0009894371032714844 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.005957841873168945 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010039806365966797 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 324 time to create 1 rle with old method : 0.0003962516784667969 time for calcul the mask position with numpy : 0.005839347839355469 nb_pixel_total : 1210 time to create 1 rle with old method : 0.0014104843139648438 time for calcul the mask position with numpy : 0.0057277679443359375 nb_pixel_total : 852 time to create 1 rle with old method : 0.0009257793426513672 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 24 time to create 1 rle with old method : 6.437301635742188e-05 time for calcul the mask position with numpy : 0.005689382553100586 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005536079406738281 time for calcul the mask position with numpy : 0.005610942840576172 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.0056989192962646484 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006067752838134766 time for calcul the mask position with numpy : 0.005863666534423828 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0015034675598144531 time for calcul the mask position with numpy : 0.00565791130065918 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.00566864013671875 nb_pixel_total : 1755 time to create 1 rle with old method : 0.0018093585968017578 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 663 time to create 1 rle with old method : 0.0006971359252929688 time for calcul the mask position with numpy : 0.005833148956298828 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009367465972900391 time for calcul the mask position with numpy : 0.005839824676513672 nb_pixel_total : 194 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.005822420120239258 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005025863647460938 time for calcul the mask position with numpy : 0.0055370330810546875 nb_pixel_total : 789 time to create 1 rle with old method : 0.0009837150573730469 time for calcul the mask position with numpy : 0.0055768489837646484 nb_pixel_total : 5341 time to create 1 rle with old method : 0.0061359405517578125 time for calcul the mask position with numpy : 0.005856513977050781 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0010843276977539062 time for calcul the mask position with numpy : 0.005830526351928711 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0011403560638427734 time for calcul the mask position with numpy : 0.005791664123535156 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003921985626220703 time for calcul the mask position with numpy : 0.0057811737060546875 nb_pixel_total : 173 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.005665302276611328 nb_pixel_total : 769 time to create 1 rle with old method : 0.0009150505065917969 time for calcul the mask position with numpy : 0.005750894546508789 nb_pixel_total : 578 time to create 1 rle with old method : 0.0006682872772216797 time for calcul the mask position with numpy : 0.006002187728881836 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003085136413574219 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.005975961685180664 nb_pixel_total : 119 time to create 1 rle with old method : 0.0001690387725830078 time for calcul the mask position with numpy : 0.00574803352355957 nb_pixel_total : 113 time to create 1 rle with old method : 0.00014281272888183594 time for calcul the mask position with numpy : 0.005677700042724609 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001823902130126953 create new chi : 1.3278684616088867 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016007423400878906 batch 1 Loaded 142 chid ids of type : 4230 Number RLEs to save : 14105 TO DO : save crop sub photo not yet done ! save time : 0.8070356845855713 nb_obj : 140 nb_hashtags : 6 time to prepare the origin masks : 1.3221068382263184 time for calcul the mask position with numpy : 0.03877544403076172 nb_pixel_total : 1798240 time to create 1 rle with new method : 0.7024002075195312 time for calcul the mask position with numpy : 0.006291866302490234 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0017504692077636719 time for calcul the mask position with numpy : 0.005719661712646484 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005559921264648438 time for calcul the mask position with numpy : 0.006051063537597656 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009944438934326172 time for calcul the mask position with numpy : 0.005811452865600586 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002422332763671875 time for calcul the mask position with numpy : 0.006281614303588867 nb_pixel_total : 45569 time to create 1 rle with old method : 0.05010414123535156 time for calcul the mask position with numpy : 0.007149219512939453 nb_pixel_total : 21 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.005776643753051758 nb_pixel_total : 65 time to create 1 rle with old method : 9.107589721679688e-05 time for calcul the mask position with numpy : 0.005988597869873047 nb_pixel_total : 2549 time to create 1 rle with old method : 0.002847909927368164 time for calcul the mask position with numpy : 0.0058743953704833984 nb_pixel_total : 990 time to create 1 rle with old method : 0.0010759830474853516 time for calcul the mask position with numpy : 0.005785942077636719 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011057853698730469 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.005778312683105469 nb_pixel_total : 6201 time to create 1 rle with old method : 0.0063512325286865234 time for calcul the mask position with numpy : 0.005655527114868164 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005283355712890625 time for calcul the mask position with numpy : 0.005891561508178711 nb_pixel_total : 3274 time to create 1 rle with old method : 0.003509521484375 time for calcul the mask position with numpy : 0.005845546722412109 nb_pixel_total : 1828 time to create 1 rle with old method : 0.002106904983520508 time for calcul the mask position with numpy : 0.006728172302246094 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0012836456298828125 time for calcul the mask position with numpy : 0.006081342697143555 nb_pixel_total : 537 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.006236076354980469 nb_pixel_total : 1386 time to create 1 rle with old method : 0.0015418529510498047 time for calcul the mask position with numpy : 0.006152629852294922 nb_pixel_total : 4152 time to create 1 rle with old method : 0.008202075958251953 time for calcul the mask position with numpy : 0.0058901309967041016 nb_pixel_total : 870 time to create 1 rle with old method : 0.0009984970092773438 time for calcul the mask position with numpy : 0.005769968032836914 nb_pixel_total : 276 time to create 1 rle with old method : 0.00035381317138671875 time for calcul the mask position with numpy : 0.005948781967163086 nb_pixel_total : 1202 time to create 1 rle with old method : 0.001363515853881836 time for calcul the mask position with numpy : 0.006489753723144531 nb_pixel_total : 885 time to create 1 rle with old method : 0.0009181499481201172 time for calcul the mask position with numpy : 0.0057752132415771484 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0018405914306640625 time for calcul the mask position with numpy : 0.005846738815307617 nb_pixel_total : 10436 time to create 1 rle with old method : 0.011428356170654297 time for calcul the mask position with numpy : 0.005964994430541992 nb_pixel_total : 158 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.005989789962768555 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.005957603454589844 nb_pixel_total : 738 time to create 1 rle with old method : 0.0008714199066162109 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 43 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.005982160568237305 nb_pixel_total : 703 time to create 1 rle with old method : 0.0009012222290039062 time for calcul the mask position with numpy : 0.006767988204956055 nb_pixel_total : 1576 time to create 1 rle with old method : 0.001861572265625 time for calcul the mask position with numpy : 0.006020545959472656 nb_pixel_total : 11931 time to create 1 rle with old method : 0.012323141098022461 time for calcul the mask position with numpy : 0.006188631057739258 nb_pixel_total : 690 time to create 1 rle with old method : 0.0008680820465087891 time for calcul the mask position with numpy : 0.007354736328125 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0015139579772949219 time for calcul the mask position with numpy : 0.007103443145751953 nb_pixel_total : 679 time to create 1 rle with old method : 0.0007877349853515625 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 827 time to create 1 rle with old method : 0.0009222030639648438 time for calcul the mask position with numpy : 0.0061798095703125 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0027208328247070312 time for calcul the mask position with numpy : 0.007603168487548828 nb_pixel_total : 850 time to create 1 rle with old method : 0.001035928726196289 time for calcul the mask position with numpy : 0.005955219268798828 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003895759582519531 time for calcul the mask position with numpy : 0.006515026092529297 nb_pixel_total : 13 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.0059010982513427734 nb_pixel_total : 178 time to create 1 rle with old method : 0.00021910667419433594 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 1398 time to create 1 rle with old method : 0.0015072822570800781 time for calcul the mask position with numpy : 0.005872964859008789 nb_pixel_total : 238 time to create 1 rle with old method : 0.0002865791320800781 time for calcul the mask position with numpy : 0.006037473678588867 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005807876586914062 time for calcul the mask position with numpy : 0.005854606628417969 nb_pixel_total : 2814 time to create 1 rle with old method : 0.003034830093383789 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 535 time to create 1 rle with old method : 0.0005862712860107422 time for calcul the mask position with numpy : 0.005921125411987305 nb_pixel_total : 1227 time to create 1 rle with old method : 0.0014536380767822266 time for calcul the mask position with numpy : 0.005820512771606445 nb_pixel_total : 93 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.005686044692993164 nb_pixel_total : 7 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.009690046310424805 nb_pixel_total : 192 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.009728670120239258 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002472400665283203 time for calcul the mask position with numpy : 0.00949859619140625 nb_pixel_total : 231 time to create 1 rle with old method : 0.0002605915069580078 time for calcul the mask position with numpy : 0.009438514709472656 nb_pixel_total : 1700 time to create 1 rle with old method : 0.0018053054809570312 time for calcul the mask position with numpy : 0.008964300155639648 nb_pixel_total : 143 time to create 1 rle with old method : 0.00017547607421875 time for calcul the mask position with numpy : 0.00947260856628418 nb_pixel_total : 1291 time to create 1 rle with old method : 0.0013806819915771484 time for calcul the mask position with numpy : 0.00927114486694336 nb_pixel_total : 616 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.00936269760131836 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004336833953857422 time for calcul the mask position with numpy : 0.009354591369628906 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005245208740234375 time for calcul the mask position with numpy : 0.009325027465820312 nb_pixel_total : 34 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.009046792984008789 nb_pixel_total : 446 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.008967399597167969 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004513263702392578 time for calcul the mask position with numpy : 0.00897073745727539 nb_pixel_total : 1 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.009037256240844727 nb_pixel_total : 77 time to create 1 rle with old method : 9.72747802734375e-05 time for calcul the mask position with numpy : 0.008966684341430664 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002300739288330078 time for calcul the mask position with numpy : 0.00903463363647461 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004024505615234375 time for calcul the mask position with numpy : 0.0065538883209228516 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003924369812011719 time for calcul the mask position with numpy : 0.005739927291870117 nb_pixel_total : 515 time to create 1 rle with old method : 0.00055694580078125 time for calcul the mask position with numpy : 0.0057446956634521484 nb_pixel_total : 42 time to create 1 rle with old method : 6.67572021484375e-05 time for calcul the mask position with numpy : 0.0057430267333984375 nb_pixel_total : 30 time to create 1 rle with old method : 5.125999450683594e-05 time for calcul the mask position with numpy : 0.005889892578125 nb_pixel_total : 963 time to create 1 rle with old method : 0.0010988712310791016 time for calcul the mask position with numpy : 0.005989789962768555 nb_pixel_total : 1131 time to create 1 rle with old method : 0.0011856555938720703 time for calcul the mask position with numpy : 0.006009578704833984 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005216598510742188 time for calcul the mask position with numpy : 0.005934715270996094 nb_pixel_total : 157 time to create 1 rle with old method : 0.00019311904907226562 time for calcul the mask position with numpy : 0.0055463314056396484 nb_pixel_total : 316 time to create 1 rle with old method : 0.00034928321838378906 time for calcul the mask position with numpy : 0.006371974945068359 nb_pixel_total : 106171 time to create 1 rle with old method : 0.10584759712219238 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 3528 time to create 1 rle with old method : 0.003859996795654297 time for calcul the mask position with numpy : 0.005736112594604492 nb_pixel_total : 1851 time to create 1 rle with old method : 0.001984119415283203 time for calcul the mask position with numpy : 0.005705356597900391 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.005643367767333984 nb_pixel_total : 695 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.0056874752044677734 nb_pixel_total : 70 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.005705356597900391 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.005522966384887695 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001785755157470703 time for calcul the mask position with numpy : 0.00574493408203125 nb_pixel_total : 227 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.0058002471923828125 nb_pixel_total : 94 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.005655527114868164 nb_pixel_total : 260 time to create 1 rle with old method : 0.00028014183044433594 time for calcul the mask position with numpy : 0.005577564239501953 nb_pixel_total : 96 time to create 1 rle with old method : 0.00011730194091796875 time for calcul the mask position with numpy : 0.005656719207763672 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.005728483200073242 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006105899810791016 time for calcul the mask position with numpy : 0.0056476593017578125 nb_pixel_total : 653 time to create 1 rle with old method : 0.0006778240203857422 time for calcul the mask position with numpy : 0.005660057067871094 nb_pixel_total : 153 time to create 1 rle with old method : 0.00018072128295898438 time for calcul the mask position with numpy : 0.0056612491607666016 nb_pixel_total : 291 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.006017923355102539 nb_pixel_total : 122 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.005700111389160156 nb_pixel_total : 857 time to create 1 rle with old method : 0.0009350776672363281 time for calcul the mask position with numpy : 0.005539894104003906 nb_pixel_total : 111 time to create 1 rle with old method : 0.00016450881958007812 time for calcul the mask position with numpy : 0.005658626556396484 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0011801719665527344 time for calcul the mask position with numpy : 0.0056040287017822266 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004227161407470703 time for calcul the mask position with numpy : 0.005645275115966797 nb_pixel_total : 141 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.005554676055908203 nb_pixel_total : 287 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.005575895309448242 nb_pixel_total : 953 time to create 1 rle with old method : 0.0010309219360351562 time for calcul the mask position with numpy : 0.0055201053619384766 nb_pixel_total : 206 time to create 1 rle with old method : 0.000240325927734375 time for calcul the mask position with numpy : 0.005609035491943359 nb_pixel_total : 1926 time to create 1 rle with old method : 0.002062082290649414 time for calcul the mask position with numpy : 0.0055425167083740234 nb_pixel_total : 687 time to create 1 rle with old method : 0.0007898807525634766 time for calcul the mask position with numpy : 0.005555629730224609 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005283355712890625 time for calcul the mask position with numpy : 0.005825996398925781 nb_pixel_total : 22 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.005617856979370117 nb_pixel_total : 389 time to create 1 rle with old method : 0.00043010711669921875 time for calcul the mask position with numpy : 0.005557537078857422 nb_pixel_total : 566 time to create 1 rle with old method : 0.0006546974182128906 time for calcul the mask position with numpy : 0.005607128143310547 nb_pixel_total : 92 time to create 1 rle with old method : 0.00011777877807617188 time for calcul the mask position with numpy : 0.005829811096191406 nb_pixel_total : 81 time to create 1 rle with old method : 0.00011420249938964844 time for calcul the mask position with numpy : 0.005749940872192383 nb_pixel_total : 1507 time to create 1 rle with old method : 0.0017817020416259766 time for calcul the mask position with numpy : 0.005793571472167969 nb_pixel_total : 821 time to create 1 rle with old method : 0.0008947849273681641 time for calcul the mask position with numpy : 0.005919218063354492 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003485679626464844 time for calcul the mask position with numpy : 0.0057947635650634766 nb_pixel_total : 44 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.005825519561767578 nb_pixel_total : 879 time to create 1 rle with old method : 0.0009391307830810547 time for calcul the mask position with numpy : 0.0058422088623046875 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0013322830200195312 time for calcul the mask position with numpy : 0.006120443344116211 nb_pixel_total : 896 time to create 1 rle with old method : 0.0009529590606689453 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007269382476806641 time for calcul the mask position with numpy : 0.006228208541870117 nb_pixel_total : 695 time to create 1 rle with old method : 0.0007917881011962891 time for calcul the mask position with numpy : 0.006144046783447266 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.006345510482788086 nb_pixel_total : 1448 time to create 1 rle with old method : 0.0016436576843261719 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.006230354309082031 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005230903625488281 time for calcul the mask position with numpy : 0.006012439727783203 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007367134094238281 time for calcul the mask position with numpy : 0.005995035171508789 nb_pixel_total : 346 time to create 1 rle with old method : 0.0003955364227294922 time for calcul the mask position with numpy : 0.006054401397705078 nb_pixel_total : 380 time to create 1 rle with old method : 0.000484466552734375 time for calcul the mask position with numpy : 0.00600886344909668 nb_pixel_total : 7425 time to create 1 rle with old method : 0.008324861526489258 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 26 time to create 1 rle with old method : 5.245208740234375e-05 time for calcul the mask position with numpy : 0.007643461227416992 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0022306442260742188 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 149 time to create 1 rle with old method : 0.000202178955078125 time for calcul the mask position with numpy : 0.006236076354980469 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005064010620117188 time for calcul the mask position with numpy : 0.006131410598754883 nb_pixel_total : 269 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.006484031677246094 nb_pixel_total : 51 time to create 1 rle with old method : 8.702278137207031e-05 time for calcul the mask position with numpy : 0.006178140640258789 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023317337036132812 time for calcul the mask position with numpy : 0.006134510040283203 nb_pixel_total : 600 time to create 1 rle with old method : 0.0007119178771972656 time for calcul the mask position with numpy : 0.006292819976806641 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 907 time to create 1 rle with old method : 0.001056671142578125 time for calcul the mask position with numpy : 0.006096363067626953 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0014088153839111328 time for calcul the mask position with numpy : 0.006028175354003906 nb_pixel_total : 258 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021386146545410156 create new chi : 1.9420316219329834 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016574859619140625 batch 1 Loaded 141 chid ids of type : 4230 Number RLEs to save : 12549 TO DO : save crop sub photo not yet done ! save time : 0.757718563079834 map_output_result : {1338532393: (0.0, 'Should be the crop_list due to order', 0.0), 1338532390: (0.0, 'Should be the crop_list due to order', 0.0), 1338532387: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 3 /1338532393.Didn't retrieve data . /1338532390.Didn't retrieve data . /1338532387.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013317108154296875 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.256717205047607 time spend to save output : 0.01360940933227539 total time spend for step 4 : 14.270326614379883 step5:crop_condition Wed Feb 19 13:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 438 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 190 About to insert : list_path_to_insert length 190 new photo from crops ! About to upload 190 photos upload in portfolio : 4869462 init cache_photo without model_param we have 190 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739967682_44202 we have uploaded 190 photos in the portfolio 4869462 time of upload the photos Elapsed time : 46.2521436214447 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 4869462 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739967729_44202 we have uploaded 48 photos in the portfolio 4869462 time of upload the photos Elapsed time : 22.41645359992981 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739967752_44202 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.5934228897094727 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 4869462 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739967757_44202 we have uploaded 48 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.499903678894043 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 298 /1338547226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338547534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 897 time used for this insertion : 0.04555225372314453 save_final save missing photos in datou_result : time spend for datou_step_exec : 89.90743827819824 time spend to save output : 0.05335426330566406 total time spend for step 5 : 89.9607925415039 step6:thcl Wed Feb 19 13:22:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.020676374435424805 time to convert the images to numpy array : 0.08769488334655762 time to import caffe and check if the image exist : 0.025688648223876953 time to convert the images to numpy array : 0.09675002098083496 time to import caffe and check if the image exist : 0.01875019073486328 time to convert the images to numpy array : 0.11200881004333496 time to import caffe and check if the image exist : 0.026103734970092773 time to convert the images to numpy array : 0.10620260238647461 time to import caffe and check if the image exist : 0.027910709381103516 time to convert the images to numpy array : 0.10559439659118652 time to import caffe and check if the image exist : 0.029620647430419922 time to convert the images to numpy array : 0.10546469688415527 time to import caffe and check if the image exist : 0.02900862693786621 time to convert the images to numpy array : 0.10718202590942383 time to import caffe and check if the image exist : 0.04369378089904785 time to convert the images to numpy array : 0.09446382522583008 time to import caffe and check if the image exist : 0.028595924377441406 time to convert the images to numpy array : 0.10851836204528809 time to import caffe and check if the image exist : 0.033208608627319336 time to convert the images to numpy array : 0.10648608207702637 total time to convert the images to numpy array : 0.4222567081451416 list photo_ids error: [] list photo_ids correct : [1338547376, 1338547377, 1338547378, 1338547379, 1338547380, 1338547381, 1338547382, 1338547383, 1338547384, 1338547385, 1338547386, 1338547387, 1338547388, 1338547389, 1338547390, 1338547391, 1338547392, 1338547393, 1338547394, 1338547395, 1338547396, 1338547397, 1338547398, 1338547399, 1338547400, 1338547401, 1338547402, 1338547403, 1338547404, 1338547405, 1338547316, 1338547317, 1338547318, 1338547319, 1338547320, 1338547321, 1338547322, 1338547323, 1338547324, 1338547325, 1338547326, 1338547327, 1338547328, 1338547329, 1338547330, 1338547331, 1338547332, 1338547333, 1338547334, 1338547335, 1338547336, 1338547337, 1338547338, 1338547339, 1338547340, 1338547341, 1338547342, 1338547343, 1338547344, 1338547345, 1338547406, 1338547407, 1338547408, 1338547409, 1338547410, 1338547411, 1338547412, 1338547413, 1338547414, 1338547415, 1338547418, 1338547419, 1338547420, 1338547421, 1338547422, 1338547423, 1338547424, 1338547425, 1338547426, 1338547427, 1338547428, 1338547429, 1338547430, 1338547431, 1338547432, 1338547433, 1338547434, 1338547435, 1338547436, 1338547437, 1338547226, 1338547227, 1338547228, 1338547229, 1338547230, 1338547231, 1338547232, 1338547233, 1338547234, 1338547235, 1338547236, 1338547237, 1338547238, 1338547239, 1338547240, 1338547241, 1338547242, 1338547243, 1338547244, 1338547245, 1338547246, 1338547247, 1338547248, 1338547249, 1338547250, 1338547251, 1338547252, 1338547253, 1338547254, 1338547255, 1338547471, 1338547472, 1338547473, 1338547474, 1338547475, 1338547476, 1338547477, 1338547478, 1338547479, 1338547480, 1338547486, 1338547487, 1338547488, 1338547489, 1338547490, 1338547491, 1338547492, 1338547493, 1338547494, 1338547495, 1338547496, 1338547497, 1338547498, 1338547499, 1338547500, 1338547501, 1338547502, 1338547503, 1338547504, 1338547505, 1338547256, 1338547257, 1338547258, 1338547259, 1338547260, 1338547261, 1338547262, 1338547263, 1338547264, 1338547265, 1338547266, 1338547267, 1338547268, 1338547269, 1338547270, 1338547271, 1338547272, 1338547273, 1338547274, 1338547275, 1338547276, 1338547277, 1338547278, 1338547279, 1338547280, 1338547281, 1338547282, 1338547283, 1338547284, 1338547285, 1338547346, 1338547347, 1338547348, 1338547349, 1338547350, 1338547351, 1338547352, 1338547353, 1338547354, 1338547355, 1338547356, 1338547357, 1338547358, 1338547359, 1338547360, 1338547361, 1338547362, 1338547363, 1338547364, 1338547365, 1338547366, 1338547367, 1338547368, 1338547369, 1338547370, 1338547371, 1338547372, 1338547373, 1338547374, 1338547375, 1338547286, 1338547287, 1338547288, 1338547289, 1338547290, 1338547291, 1338547292, 1338547293, 1338547294, 1338547295, 1338547296, 1338547297, 1338547298, 1338547299, 1338547300, 1338547301, 1338547302, 1338547303, 1338547304, 1338547305, 1338547306, 1338547307, 1338547308, 1338547309, 1338547310, 1338547311, 1338547312, 1338547313, 1338547314, 1338547315, 1338547506, 1338547507, 1338547508, 1338547509, 1338547510, 1338547511, 1338547512, 1338547513, 1338547514, 1338547515, 1338547516, 1338547517, 1338547518, 1338547519, 1338547520, 1338547521, 1338547522, 1338547523, 1338547524, 1338547525, 1338547526, 1338547528, 1338547529, 1338547530, 1338547531, 1338547532, 1338547533, 1338547534, 1338547438, 1338547439, 1338547440, 1338547441, 1338547442, 1338547443, 1338547444, 1338547445, 1338547446, 1338547447, 1338547448, 1338547449, 1338547450, 1338547451, 1338547452, 1338547453, 1338547454, 1338547455, 1338547456, 1338547459, 1338547460, 1338547461, 1338547462, 1338547463, 1338547464, 1338547465, 1338547466, 1338547467, 1338547469, 1338547470] number of photos to traite : 298 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7037 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6818 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.3582868576049805 time used to do the prediction : 1.0553562641143799 save descriptor for thcl : 3237 time to traite the descriptors : 1.6497678756713867 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1338547376 To insert : 1338547377 To insert : 1338547378 To insert : 1338547379 To insert : 1338547380 To insert : 1338547381 To insert : 1338547382 To insert : 1338547383 To insert : 1338547384 To insert : 1338547385 To insert : 1338547386 To insert : 1338547387 To insert : 1338547388 To insert : 1338547389 To insert : 1338547390 To insert : 1338547391 To insert : 1338547392 To insert : 1338547393 To insert : 1338547394 To insert : 1338547395 To insert : 1338547396 To insert : 1338547397 To insert : 1338547398 To insert : 1338547399 To insert : 1338547400 To insert : 1338547401 To insert : 1338547402 To insert : 1338547403 To insert : 1338547404 To insert : 1338547405 To insert : 1338547316 To insert : 1338547317 To insert : 1338547318 To insert : 1338547319 To insert : 1338547320 To insert : 1338547321 To insert : 1338547322 To insert : 1338547323 To insert : 1338547324 To insert : 1338547325 To insert : 1338547326 To insert : 1338547327 To insert : 1338547328 To insert : 1338547329 To insert : 1338547330 To insert : 1338547331 To insert : 1338547332 To insert : 1338547333 To insert : 1338547334 To insert : 1338547335 To insert : 1338547336 To insert : 1338547337 To insert : 1338547338 To insert : 1338547339 To insert : 1338547340 To insert : 1338547341 To insert : 1338547342 To insert : 1338547343 To insert : 1338547344 To insert : 1338547345 To insert : 1338547406 To insert : 1338547407 To insert : 1338547408 To insert : 1338547409 To insert : 1338547410 To insert : 1338547411 To insert : 1338547412 To insert : 1338547413 To insert : 1338547414 To insert : 1338547415 To insert : 1338547418 To insert : 1338547419 To insert : 1338547420 To insert : 1338547421 To insert : 1338547422 To insert : 1338547423 To insert : 1338547424 To insert : 1338547425 To insert : 1338547426 To insert : 1338547427 To insert : 1338547428 To insert : 1338547429 To insert : 1338547430 To insert : 1338547431 To insert : 1338547432 To insert : 1338547433 To insert : 1338547434 To insert : 1338547435 To insert : 1338547436 To insert : 1338547437 To insert : 1338547226 To insert : 1338547227 To insert : 1338547228 To insert : 1338547229 To insert : 1338547230 To insert : 1338547231 To insert : 1338547232 To insert : 1338547233 To insert : 1338547234 To insert : 1338547235 To insert : 1338547236 To insert : 1338547237 To insert : 1338547238 To insert : 1338547239 To insert : 1338547240 To insert : 1338547241 To insert : 1338547242 To insert : 1338547243 To insert : 1338547244 To insert : 1338547245 To insert : 1338547246 To insert : 1338547247 To insert : 1338547248 To insert : 1338547249 To insert : 1338547250 To insert : 1338547251 To insert : 1338547252 To insert : 1338547253 To insert : 1338547254 To insert : 1338547255 To insert : 1338547471 To insert : 1338547472 To insert : 1338547473 To insert : 1338547474 To insert : 1338547475 To insert : 1338547476 To insert : 1338547477 To insert : 1338547478 To insert : 1338547479 To insert : 1338547480 To insert : 1338547486 To insert : 1338547487 To insert : 1338547488 To insert : 1338547489 To insert : 1338547490 To insert : 1338547491 To insert : 1338547492 To insert : 1338547493 To insert : 1338547494 To insert : 1338547495 To insert : 1338547496 To insert : 1338547497 To insert : 1338547498 To insert : 1338547499 To insert : 1338547500 To insert : 1338547501 To insert : 1338547502 To insert : 1338547503 To insert : 1338547504 To insert : 1338547505 To insert : 1338547256 To insert : 1338547257 To insert : 1338547258 To insert : 1338547259 To insert : 1338547260 To insert : 1338547261 To insert : 1338547262 To insert : 1338547263 To insert : 1338547264 To insert : 1338547265 To insert : 1338547266 To insert : 1338547267 To insert : 1338547268 To insert : 1338547269 To insert : 1338547270 To insert : 1338547271 To insert : 1338547272 To insert : 1338547273 To insert : 1338547274 To insert : 1338547275 To insert : 1338547276 To insert : 1338547277 To insert : 1338547278 To insert : 1338547279 To insert : 1338547280 To insert : 1338547281 To insert : 1338547282 To insert : 1338547283 To insert : 1338547284 To insert : 1338547285 To insert : 1338547346 To insert : 1338547347 To insert : 1338547348 To insert : 1338547349 To insert : 1338547350 To insert : 1338547351 To insert : 1338547352 To insert : 1338547353 To insert : 1338547354 To insert : 1338547355 To insert : 1338547356 To insert : 1338547357 To insert : 1338547358 To insert : 1338547359 To insert : 1338547360 To insert : 1338547361 To insert : 1338547362 To insert : 1338547363 To insert : 1338547364 To insert : 1338547365 To insert : 1338547366 To insert : 1338547367 To insert : 1338547368 To insert : 1338547369 To insert : 1338547370 To insert : 1338547371 To insert : 1338547372 To insert : 1338547373 To insert : 1338547374 To insert : 1338547375 To insert : 1338547286 To insert : 1338547287 To insert : 1338547288 To insert : 1338547289 To insert : 1338547290 To insert : 1338547291 To insert : 1338547292 To insert : 1338547293 To insert : 1338547294 To insert : 1338547295 To insert : 1338547296 To insert : 1338547297 To insert : 1338547298 To insert : 1338547299 To insert : 1338547300 To insert : 1338547301 To insert : 1338547302 To insert : 1338547303 To insert : 1338547304 To insert : 1338547305 To insert : 1338547306 To insert : 1338547307 To insert : 1338547308 To insert : 1338547309 To insert : 1338547310 To insert : 1338547311 To insert : 1338547312 To insert : 1338547313 To insert : 1338547314 To insert : 1338547315 To insert : 1338547506 To insert : 1338547507 To insert : 1338547508 To insert : 1338547509 To insert : 1338547510 To insert : 1338547511 To insert : 1338547512 To insert : 1338547513 To insert : 1338547514 To insert : 1338547515 To insert : 1338547516 To insert : 1338547517 To insert : 1338547518 To insert : 1338547519 To insert : 1338547520 To insert : 1338547521 To insert : 1338547522 To insert : 1338547523 To insert : 1338547524 To insert : 1338547525 To insert : 1338547526 To insert : 1338547528 To insert : 1338547529 To insert : 1338547530 To insert : 1338547531 To insert : 1338547532 To insert : 1338547533 To insert : 1338547534 To insert : 1338547438 To insert : 1338547439 To insert : 1338547440 To insert : 1338547441 To insert : 1338547442 To insert : 1338547443 To insert : 1338547444 To insert : 1338547445 To insert : 1338547446 To insert : 1338547447 To insert : 1338547448 To insert : 1338547449 To insert : 1338547450 To insert : 1338547451 To insert : 1338547452 To insert : 1338547453 To insert : 1338547454 To insert : 1338547455 To insert : 1338547456 To insert : 1338547459 To insert : 1338547460 To insert : 1338547461 To insert : 1338547462 To insert : 1338547463 To insert : 1338547464 To insert : 1338547465 To insert : 1338547466 To insert : 1338547467 To insert : 1338547469 To insert : 1338547470 time to insert the descriptors : 69.3841941356659 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 434 time used for this insertion : 0.030544757843017578 save missing photos in datou_result : time spend for datou_step_exec : 77.71032762527466 time spend to save output : 0.08268380165100098 total time spend for step 6 : 77.79301142692566 step7:ventilate_hashtags_in_portfolio Wed Feb 19 13:24:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20672519 get user id for portfolio 20672519 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672519 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','refus','mal_croppe','Papier','pehd','Carton','Tetrapak','Film_plastique','pet_fonce','carton','autre','PET_clair','flou','metal','pet_clair','environnement','PEHD','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672519 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','refus','mal_croppe','Papier','pehd','Carton','Tetrapak','Film_plastique','pet_fonce','carton','autre','PET_clair','flou','metal','pet_clair','environnement','PEHD','papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672519 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','refus','mal_croppe','Papier','pehd','Carton','Tetrapak','Film_plastique','pet_fonce','carton','autre','PET_clair','flou','metal','pet_clair','environnement','PEHD','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672519 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','refus','mal_croppe','Papier','pehd','Carton','Tetrapak','Film_plastique','pet_fonce','carton','autre','PET_clair','flou','metal','pet_clair','environnement','PEHD','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20673604,20673597,20673598,20673613,20673612,20673605,20673602,20673603,20673606,20673610,20673608,20673609,20673611?tags=pet_fonce,refus,mal_croppe,papier,pehd,carton,tetrapak,film_plastique,autre,pet_clair,flou,metal,environnement&datou_id_consolidate=4235&port_consolidate=20672519 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 1 /20672519. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012539863586425781 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.220149040222168 time spend to save output : 0.01278829574584961 total time spend for step 7 : 4.232937335968018 step8:final Wed Feb 19 13:24:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338532393: ('0.24979999291006424',), 1338532390: ('0.24979999291006424',), 1338532387: ('0.24979999291006424',)} new output for save of step final : {1338532393: ('0.24979999291006424',), 1338532390: ('0.24979999291006424',), 1338532387: ('0.24979999291006424',)} [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 3 /1338532393.Didn't retrieve data . /1338532390.Didn't retrieve data . /1338532387.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012597322463989258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11915326118469238 time spend to save output : 0.012821674346923828 total time spend for step 8 : 0.1319749355316162 step9:velours_tree Wed Feb 19 13:24:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20673604,20673597,20673598,20673613,20673612,20673605,20673602,20673603,20673606,20673610,20673608,20673609,20673611 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673604 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673597 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673598 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673613 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673612 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673605 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673602 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673603 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673606 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673610 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673608 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673609 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20673611 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 298 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 2 4 2 1 2 2 1 2 2 1 4 4 4 5 1 1 1 1 0 5 4 0 3 0 3 0 0 1 5 5 1 5 1 3 0 1 5 1 0 1 1 1 1 1 4 1 5 5 1 2 2 1 1 0 4 2 1 5 5 2 1 1 5 2 2 1 2 2 2 2 1 2 5 0 1 0 1 1 5 5 0 0 1 0 3 0 3 2 0 5 5 1 3 0 1 5 1 0 5 1 1 1 1 1 1 4 1 5 5 2 2 5 0 4 5 2 5 1 1 5 5 1 2 5 2 2 2 2 2 2 2 1 0 0 5 5 0 1 1 1 1 5 0 0 4 3 0 0 3 0 0 1 1 5 5 0 5 1 3 0 0 1 1 0 5 1 1 1 2 1 1 5 5 1 2 2 1 2 2 4 5 2 5 5 2 5 5 1 5 0 2 0 1 1 5 0 1 1 4 1 1 2 0 2 1 2 0 5 2 0 2 1 1 5 0 2 1 2 1 2 0 0 5 0 1 1 1 1 5 2 1 2 2 0 5 2 2 1 0 0 0 1 1 5 2 0 1 0 1 4 1 1 2 0 2 1 2 1 1 5 1 1 2 5 2 2 4 5 2 2 5 1 1 2 2 5 2 1 2 2 4 4 4 5 2 1 2 1 2 1 1 1 2 5 2 2 4] Elapsed time: 0.05064511299133301 graph_id used : 79397 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20673604,20673597,20673598,20673613,20673612,20673605,20673602,20673603,20673606,20673610,20673608,20673609,20673611?tags=pet_fonce,refus,mal_croppe,papier,pehd,carton,tetrapak,film_plastique,autre,pet_clair,flou,metal,environnement&datou_id_consolidate=4235&port_consolidate=20672519&tree_id=79397 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 1 /20672519Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011958122253417969 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.27677631378174 time spend to save output : 0.012258529663085938 total time spend for step 9 : 23.289034843444824 step10:send_mail_cod Wed Feb 19 13:24:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20672519_19-02-2025_13_24_35.pdf 20673586 imagette206735861739967875 20673579 imagette206735791739967875 20673580 imagette206735801739967875 20673595 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206735951739967875 20673594 imagette206735941739967876 20673587 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206735871739967876 20673584 imagette206735841739967877 20673585 imagette206735851739967877 20673588 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206735881739967877 20673592 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206735921739967878 20673590 imagette206735901739967878 20673591 imagette206735911739967878 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20672519 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20673604,20673597,20673598,20673613,20673612,20673605,20673602,20673603,20673606,20673610,20673608,20673609,20673611?tags=pet_fonce,refus,mal_croppe,papier,pehd,carton,tetrapak,film_plastique,autre,pet_clair,flou,metal,environnement&datou_id_consolidate=4235&port_consolidate=20672519&tree_id=79397 your option no_mail is active, we will not send the real mail to your client args[1338532393] : ((1338532393, -7.9009723662777835, 492609224), (1338532393, -0.389483755028751, 496442774), '0.24979999291006424') We are sending mail with results at cod@fotonower.com args[1338532390] : ((1338532390, -7.905644662770203, 492609224), (1338532390, -0.4349530517375115, 496442774), '0.24979999291006424') We are sending mail with results at cod@fotonower.com args[1338532387] : ((1338532387, -7.839110169600698, 492609224), (1338532387, -0.5043450511818497, 501862349), '0.24979999291006424') We are sending mail with results at cod@fotonower.com refus_total : 0.24979999291006424 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20672519 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 error for generate pdf : 'mal_croppe' Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013118267059326172 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7209911346435547 time spend to save output : 0.013258695602416992 total time spend for step 10 : 3.7342498302459717 step11:split_time_score Wed Feb 19 13:24:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19022025 20672519 Nombre de photos uploadées : 3 / 23040 (0%) 19022025 20672519 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 19022025 20672519 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00021886825561523438 elapsed_time : insert_dashboard_record_day_entry 0.024621248245239258 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.25956874725343604 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20670366 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20670366 AND mptpi.`type`=4230 To do Qualite : 0.2666850779312825 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20670367 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20670367 AND mptpi.`type`=4230 To do Qualite : 0.2530287167745901 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20670368 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20670368 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671393 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671394 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671395 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671396 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671399 order by id desc limit 1 Qualite : 0.26358611823303346 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671400 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20671400 AND mptpi.`type`=4230 To do Qualite : 0.2528177934262221 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20671401 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20671401 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672109 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672110 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672111 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672112 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672113 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672114 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672115 order by id desc limit 1 Qualite : 0.2696868686325735 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672116 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672116 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672518 order by id desc limit 1 Qualite : 0.24979999291006424 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672519 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672519 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672520 order by id desc limit 1 Qualite : 0.21043939747365406 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672521 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672521 AND mptpi.`type`=4230 To do Qualite : 0.26453395756362685 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20672522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20672522 AND mptpi.`type`=4230 To do Qualite : 0.24125439942052185 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20673030_19-02-2025_13_02_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20673030 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20673030 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338532393, 1338532390, 1338532387] Looping around the photos to save general results len do output : 1 /20672519Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532393', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532390', None, None, None, None, None, '2599316') ('4234', None, None, None, None, None, None, None, '2599316') ('4234', '20672519', '1338532387', None, None, None, None, None, '2599316') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013087749481201172 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.333589792251587 time spend to save output : 0.013256549835205078 total time spend for step 11 : 21.346846342086792 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 45.19user 29.08system 4:34.33elapsed 27%CPU (0avgtext+0avgdata 2784228maxresident)k 1071448inputs+18936outputs (2015major+2734456minor)pagefaults 0swaps