python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1715395 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2610485'] with mtr_portfolio_ids : ['20779169'] and first list_photo_ids : [] new path : /proc/1715395/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.46364665031433105 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 24 18:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-24 18:20:32.957558: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-24 18:20:32.983289: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-24 18:20:32.984929: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f074c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-24 18:20:32.984952: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-24 18:20:32.988063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-24 18:20:33.271835: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1058ba80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-24 18:20:33.271930: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-24 18:20:33.272720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 18:20:33.273165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 18:20:33.276026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 18:20:33.279182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 18:20:33.279692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 18:20:33.284517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 18:20:33.286252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 18:20:33.293272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 18:20:33.294587: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 18:20:33.294707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 18:20:33.295403: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 18:20:33.295424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 18:20:33.295436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 18:20:33.296573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2512 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-24 18:20:33.577962: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 18:20:33.578053: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 18:20:33.578076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 18:20:33.578097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 18:20:33.578117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 18:20:33.578138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 18:20:33.578158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 18:20:33.578178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 18:20:33.579193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 18:20:33.580205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-24 18:20:33.580242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-24 18:20:33.580261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 18:20:33.580279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-24 18:20:33.580296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-24 18:20:33.580313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-24 18:20:33.580330: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-24 18:20:33.580348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 18:20:33.581326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-24 18:20:33.581357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-24 18:20:33.581367: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-24 18:20:33.581377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-24 18:20:33.582409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2512 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-24 18:20:42.003547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-24 18:20:42.212660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-24 18:20:43.551015: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.551122: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.559667: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.559693: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.566505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.566531: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.567081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.567109: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.601571: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.601636: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.607966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.607990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.608467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.608506: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-24 18:20:43.650081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.650600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.700820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.701613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.733107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.734139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.736587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.737602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.744770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.745513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.747733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.748444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.756220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.757294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.759828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.760608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.820975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.821611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.822231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.822913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.827074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.827780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.843728: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.844233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.844700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.845157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.858887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.859409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.859906: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.860399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.865449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.865950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.872052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.872566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.884789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.885263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.889369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.889834: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.890289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.890745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.891498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.892002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.902703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.903264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.903832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.904346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.904857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.905338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.922623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.923188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.957537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.957653: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-24 18:20:43.958993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.963585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.972444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.978429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.992438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:43.993032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.009975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.010737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.011465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.012216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.016653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.017202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.017737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.018252: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.019465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.029446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.029916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.038843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.039400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.039907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.040439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.041008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-24 18:20:44.041495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.42266 max: 150.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 866 time to create 1 rle with old method : 0.0019512176513671875 length of segment : 39 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0019316673278808594 length of segment : 37 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001704692840576172 length of segment : 27 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00018072128295898438 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.09453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0014977455139160156 length of segment : 36 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2332 time to create 1 rle with old method : 0.0028493404388427734 length of segment : 49 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.00045609474182128906 length of segment : 56 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001685619354248047 length of segment : 19 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 46 time to create 1 rle with old method : 9.489059448242188e-05 length of segment : 11 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 1257 time to create 1 rle with old method : 0.0019519329071044922 length of segment : 150 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0008034706115722656 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.57109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1791 time to create 1 rle with old method : 0.002627849578857422 length of segment : 50 time for calcul the mask position with numpy : 0.0004143714904785156 nb_pixel_total : 8278 time to create 1 rle with old method : 0.011278390884399414 length of segment : 214 time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 6956 time to create 1 rle with old method : 0.00940084457397461 length of segment : 206 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 6534 time to create 1 rle with old method : 0.009006023406982422 length of segment : 72 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 6991 time to create 1 rle with old method : 0.014272212982177734 length of segment : 65 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.73516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004267692565917969 length of segment : 26 time for calcul the mask position with numpy : 0.00019073486328125 nb_pixel_total : 9054 time to create 1 rle with old method : 0.018415212631225586 length of segment : 74 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 175.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 54.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007879734039306641 length of segment : 23 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.00048470497131347656 length of segment : 17 time for calcul the mask position with numpy : 0.0005390644073486328 nb_pixel_total : 47700 time to create 1 rle with old method : 0.05835413932800293 length of segment : 330 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 211.00000 molded_images shape: (1, 640, 640, 3) min: -96.83672 max: 90.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.24688 max: 151.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0010614395141601562 length of segment : 25 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0003292560577392578 length of segment : 40 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 2403 time to create 1 rle with old method : 0.004420280456542969 length of segment : 45 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0006208419799804688 length of segment : 22 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0011060237884521484 length of segment : 25 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 20 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 16787 time to create 1 rle with old method : 0.0196993350982666 length of segment : 170 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00025773048400878906 length of segment : 15 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 19 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 812 time to create 1 rle with old method : 0.0010912418365478516 length of segment : 33 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 24 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 1780 time to create 1 rle with old method : 0.002673625946044922 length of segment : 38 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0010759830474853516 length of segment : 36 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0009465217590332031 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.33281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0016124248504638672 length of segment : 33 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.001611948013305664 length of segment : 39 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 998 time to create 1 rle with old method : 0.0014195442199707031 length of segment : 30 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00037217140197753906 length of segment : 46 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 60.06094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1164 time to create 1 rle with old method : 0.0015926361083984375 length of segment : 110 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 3315 time to create 1 rle with old method : 0.004852294921875 length of segment : 177 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011336803436279297 length of segment : 33 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1521 time to create 1 rle with old method : 0.001974344253540039 length of segment : 76 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 936 time to create 1 rle with old method : 0.0013227462768554688 length of segment : 92 Processing 1 images image shape: (280, 400, 3) min: 20.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012335777282714844 nb_pixel_total : 106215 time to create 1 rle with old method : 0.12970185279846191 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.50625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 16 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002658367156982422 length of segment : 12 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 2815 time to create 1 rle with old method : 0.00401759147644043 length of segment : 57 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 18 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0009298324584960938 length of segment : 41 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 2694 time to create 1 rle with old method : 0.0035326480865478516 length of segment : 87 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00021576881408691406 length of segment : 13 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 3519 time to create 1 rle with old method : 0.004431962966918945 length of segment : 67 time for calcul the mask position with numpy : 9.250640869140625e-05 nb_pixel_total : 2838 time to create 1 rle with old method : 0.003650665283203125 length of segment : 61 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.001878499984741211 length of segment : 120 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004239082336425781 length of segment : 18 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 26 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 6858 time to create 1 rle with old method : 0.008580446243286133 length of segment : 164 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.56875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0009205341339111328 length of segment : 43 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 18 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1405 time to create 1 rle with old method : 0.0018587112426757812 length of segment : 50 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 18 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 28 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00038623809814453125 length of segment : 18 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 566 time to create 1 rle with old method : 0.0008606910705566406 length of segment : 21 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006270408630371094 length of segment : 25 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 1832 time to create 1 rle with old method : 0.0024466514587402344 length of segment : 70 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0007145404815673828 length of segment : 30 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006985664367675781 length of segment : 22 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00025177001953125 length of segment : 16 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0010581016540527344 length of segment : 32 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 907 time to create 1 rle with old method : 0.001260519027709961 length of segment : 47 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0007448196411132812 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.83047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 74 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0006494522094726562 length of segment : 27 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00036334991455078125 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00044035911560058594 length of segment : 20 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 16 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 25 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.001129150390625 length of segment : 40 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 11 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007119178771972656 length of segment : 31 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 32 time for calcul the mask position with numpy : 0.0004646778106689453 nb_pixel_total : 35794 time to create 1 rle with old method : 0.0449366569519043 length of segment : 328 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 41298 time to create 1 rle with old method : 0.048338890075683594 length of segment : 256 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.16875 max: 149.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 893 time to create 1 rle with old method : 0.0012373924255371094 length of segment : 46 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0013036727905273438 length of segment : 38 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 32 time to create 1 rle with old method : 8.559226989746094e-05 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0013928413391113281 length of segment : 42 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 14252 time to create 1 rle with old method : 0.01733541488647461 length of segment : 381 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 2421 time to create 1 rle with old method : 0.003254413604736328 length of segment : 53 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0014011859893798828 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.28984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 10370 time to create 1 rle with old method : 0.012686967849731445 length of segment : 166 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.002002716064453125 length of segment : 42 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 4748 time to create 1 rle with old method : 0.006042003631591797 length of segment : 132 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.37969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003681182861328125 length of segment : 25 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 8776 time to create 1 rle with old method : 0.011013984680175781 length of segment : 76 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 173.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 58.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0009133815765380859 length of segment : 22 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.001172780990600586 length of segment : 46 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 52537 time to create 1 rle with old method : 0.06278729438781738 length of segment : 278 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -96.78594 max: 94.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.46953 max: 151.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00031876564025878906 length of segment : 37 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0008089542388916016 length of segment : 26 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0006146430969238281 length of segment : 22 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2361 time to create 1 rle with old method : 0.003119230270385742 length of segment : 44 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 939 time to create 1 rle with old method : 0.0012600421905517578 length of segment : 40 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00019168853759765625 length of segment : 18 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 20 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002694129943847656 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.23906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011239051818847656 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 20 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 14 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 9817 time to create 1 rle with old method : 0.011163711547851562 length of segment : 187 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003921985626220703 length of segment : 17 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0022242069244384766 length of segment : 37 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.00054931640625 length of segment : 23 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009286403656005859 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008058547973632812 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.85625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0018155574798583984 length of segment : 29 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0021598339080810547 length of segment : 40 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1083 time to create 1 rle with old method : 0.001832723617553711 length of segment : 31 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1696 time to create 1 rle with old method : 0.002126455307006836 length of segment : 152 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006873607635498047 length of segment : 14 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003902912139892578 length of segment : 17 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 172.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 57.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 910 time to create 1 rle with old method : 0.001209259033203125 length of segment : 33 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.001781463623046875 length of segment : 129 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015473365783691406 length of segment : 16 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00021028518676757812 length of segment : 29 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 2954 time to create 1 rle with old method : 0.0037713050842285156 length of segment : 177 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.001384735107421875 length of segment : 101 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 3626 time to create 1 rle with old method : 0.004574298858642578 length of segment : 216 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001195669174194336 nb_pixel_total : 104872 time to create 1 rle with old method : 0.13277101516723633 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 17 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 13 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 3173 time to create 1 rle with old method : 0.004170894622802734 length of segment : 52 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 2953 time to create 1 rle with old method : 0.0038983821868896484 length of segment : 49 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 3657 time to create 1 rle with old method : 0.004697561264038086 length of segment : 86 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 17 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002646446228027344 length of segment : 12 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003349781036376953 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009019374847412109 length of segment : 45 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005471706390380859 length of segment : 18 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001404285430908203 length of segment : 17 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002892017364501953 length of segment : 22 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007627010345458984 length of segment : 35 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00043129920959472656 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0009865760803222656 length of segment : 29 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007138252258300781 length of segment : 39 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 26 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005741119384765625 length of segment : 23 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 13 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 17 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 19 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004515647888183594 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005726814270019531 length of segment : 33 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00037860870361328125 length of segment : 22 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002987384796142578 length of segment : 35 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.001230478286743164 length of segment : 52 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003914833068847656 length of segment : 15 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00044536590576171875 length of segment : 21 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004260540008544922 length of segment : 22 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 6712 time to create 1 rle with old method : 0.008037567138671875 length of segment : 175 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 19 time to create 1 rle with old method : 5.650520324707031e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.54375 max: 150.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0012087821960449219 length of segment : 47 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.000133514404296875 length of segment : 26 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0013363361358642578 length of segment : 43 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 19 time to create 1 rle with old method : 5.6743621826171875e-05 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.08672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.0001456737518310547 length of segment : 12 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 2521 time to create 1 rle with old method : 0.0032923221588134766 length of segment : 51 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2513 time to create 1 rle with old method : 0.003280162811279297 length of segment : 49 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.0011980533599853516 length of segment : 37 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005614757537841797 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.98906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 9847 time to create 1 rle with old method : 0.011267662048339844 length of segment : 167 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006954669952392578 length of segment : 27 time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 5247 time to create 1 rle with old method : 0.006312847137451172 length of segment : 161 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007436275482177734 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00035881996154785156 length of segment : 24 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 9191 time to create 1 rle with old method : 0.010864973068237305 length of segment : 75 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 55.49062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002346038818359375 length of segment : 16 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007886886596679688 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -94.29766 max: 94.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.09453 max: 150.31875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007169246673583984 length of segment : 27 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2497 time to create 1 rle with old method : 0.0030639171600341797 length of segment : 48 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003056526184082031 length of segment : 42 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0010445117950439453 length of segment : 25 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00016999244689941406 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006029605865478516 length of segment : 21 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018548965454101562 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.07891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00034236907958984375 length of segment : 21 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 7940 time to create 1 rle with old method : 0.010641813278198242 length of segment : 135 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1773 time to create 1 rle with old method : 0.002337932586669922 length of segment : 36 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.001119375228881836 length of segment : 31 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00020575523376464844 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 17 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0008208751678466797 length of segment : 36 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005900859832763672 length of segment : 23 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0009779930114746094 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.62188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 976 time to create 1 rle with old method : 0.0018873214721679688 length of segment : 29 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.002193927764892578 length of segment : 40 time for calcul the mask position with numpy : 0.00012135505676269531 nb_pixel_total : 989 time to create 1 rle with old method : 0.001455545425415039 length of segment : 58 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 173.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 57.66641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1680 time to create 1 rle with old method : 0.0022115707397460938 length of segment : 138 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 904 time to create 1 rle with old method : 0.0011892318725585938 length of segment : 35 time for calcul the mask position with numpy : 0.00013375282287597656 nb_pixel_total : 2868 time to create 1 rle with old method : 0.0037336349487304688 length of segment : 181 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1258 time to create 1 rle with old method : 0.0015358924865722656 length of segment : 85 Processing 1 images image shape: (280, 400, 3) min: 16.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 82.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 106114 time to create 1 rle with old method : 0.1213529109954834 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.34609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003662109375 length of segment : 16 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2685 time to create 1 rle with old method : 0.003567934036254883 length of segment : 60 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00020575523376464844 length of segment : 13 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 950 time to create 1 rle with old method : 0.001276254653930664 length of segment : 70 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004260540008544922 length of segment : 17 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 11 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014090538024902344 length of segment : 23 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003020763397216797 length of segment : 25 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 2909 time to create 1 rle with old method : 0.003625154495239258 length of segment : 79 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 2943 time to create 1 rle with old method : 0.003614664077758789 length of segment : 53 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010752677917480469 length of segment : 9 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 30125 time to create 1 rle with old method : 0.03518509864807129 length of segment : 194 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.74062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008177757263183594 length of segment : 44 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013566017150878906 length of segment : 17 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005323886871337891 length of segment : 19 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2724 time to create 1 rle with old method : 0.0033669471740722656 length of segment : 94 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 25 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005140304565429688 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004546642303466797 length of segment : 24 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0018279552459716797 length of segment : 49 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 20 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 28 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005514621734619141 length of segment : 33 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0005567073822021484 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.49453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005259513854980469 length of segment : 27 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00041222572326660156 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006062984466552734 length of segment : 29 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007216930389404297 length of segment : 30 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.00032806396484375 length of segment : 15 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 8786 time to create 1 rle with old method : 0.010364770889282227 length of segment : 206 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 15 time to create 1 rle with old method : 4.839897155761719e-05 length of segment : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.96172 max: 150.24844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010037422180175781 length of segment : 21 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.0015103816986083984 length of segment : 39 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0014181137084960938 length of segment : 41 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00015783309936523438 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2337 time to create 1 rle with old method : 0.0029354095458984375 length of segment : 52 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 2263 time to create 1 rle with old method : 0.002956867218017578 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.93828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 16827 time to create 1 rle with old method : 0.019253015518188477 length of segment : 176 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 7079 time to create 1 rle with old method : 0.008623361587524414 length of segment : 63 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 7276 time to create 1 rle with old method : 0.008778095245361328 length of segment : 271 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.48516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 36 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006935596466064453 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 184.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 68.21328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.001180410385131836 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -92.87578 max: 100.13125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00128936767578125 nb_pixel_total : 150160 time to create 1 rle with new method : 0.0018630027770996094 length of segment : 400 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.57109 max: 150.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 24 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 2524 time to create 1 rle with old method : 0.0033407211303710938 length of segment : 49 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004994869232177734 length of segment : 22 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 45 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0006110668182373047 length of segment : 19 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002353191375732422 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 20 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 2127 time to create 1 rle with old method : 0.002648591995239258 length of segment : 49 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.07891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00021576881408691406 length of segment : 16 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003845691680908203 length of segment : 20 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 9953 time to create 1 rle with old method : 0.012232542037963867 length of segment : 154 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 717 time to create 1 rle with old method : 0.0009551048278808594 length of segment : 43 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 14 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0018906593322753906 length of segment : 45 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0014307498931884766 length of segment : 32 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0009210109710693359 length of segment : 30 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007035732269287109 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.19609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.00092315673828125 length of segment : 83 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006871223449707031 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0013766288757324219 length of segment : 37 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0011034011840820312 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.58437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 2108 time to create 1 rle with old method : 0.002652406692504883 length of segment : 150 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 2048 time to create 1 rle with old method : 0.0027239322662353516 length of segment : 148 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004646778106689453 length of segment : 18 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.00160980224609375 length of segment : 30 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 1623 time to create 1 rle with old method : 0.003537893295288086 length of segment : 73 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 3801 time to create 1 rle with old method : 0.004782915115356445 length of segment : 211 Processing 1 images image shape: (280, 400, 3) min: 24.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 85.41641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013332366943359375 nb_pixel_total : 106433 time to create 1 rle with old method : 0.1385023593902588 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.68594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003509521484375 length of segment : 15 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0003056526184082031 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004010200500488281 length of segment : 18 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 3610 time to create 1 rle with old method : 0.004961967468261719 length of segment : 67 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2850 time to create 1 rle with old method : 0.003742694854736328 length of segment : 47 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00021529197692871094 length of segment : 11 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 47 time to create 1 rle with old method : 9.822845458984375e-05 length of segment : 16 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 30285 time to create 1 rle with old method : 0.034969329833984375 length of segment : 198 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1890 time to create 1 rle with old method : 0.0024073123931884766 length of segment : 64 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 2359 time to create 1 rle with old method : 0.002965688705444336 length of segment : 46 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009551048278808594 length of segment : 37 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 27 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 3470 time to create 1 rle with old method : 0.004844188690185547 length of segment : 65 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00034117698669433594 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.58437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 652 time to create 1 rle with old method : 0.0009021759033203125 length of segment : 43 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005028247833251953 length of segment : 18 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 17 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.001474618911743164 length of segment : 57 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00013780593872070312 length of segment : 17 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005407333374023438 length of segment : 42 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005464553833007812 length of segment : 27 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0018477439880371094 length of segment : 51 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 24 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.000881195068359375 length of segment : 23 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002396106719970703 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005331039428710938 length of segment : 21 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008249282836914062 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001900196075439453 length of segment : 19 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.000370025634765625 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006105899810791016 length of segment : 39 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0013921260833740234 length of segment : 52 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00039196014404296875 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005891323089599609 length of segment : 18 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 19 time to create 1 rle with old method : 6.532669067382812e-05 length of segment : 9 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 1800 time to create 1 rle with old method : 0.002227306365966797 length of segment : 68 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 11 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003261566162109375 length of segment : 21 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 16 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003674030303955078 length of segment : 22 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00030493736267089844 length of segment : 19 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 35562 time to create 1 rle with old method : 0.04450488090515137 length of segment : 274 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 19 time to create 1 rle with old method : 5.626678466796875e-05 length of segment : 4 Detection mask done ! Trying to reset tf kernel 1716094 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1769 tf kernel not reseted sub process len(results) : 325 len(list_Values) 325 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 325 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2964 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 325 chid ids of type : 4228 Number RLEs to save : 17678 save missing photos in datou_result : time spend for datou_step_exec : 29.415964126586914 time spend to save output : 1.3191311359405518 total time spend for step 1 : 30.735095262527466 step2:brightness Mon Feb 24 18:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740417629_1715395_1339366765_bcdaaa63c0d56b7364134184618ad3d2.jpg treat image : temp/1740417629_1715395_1339366762_42fbc93dd1e08ef57d3f54ebad9db79a.jpg treat image : temp/1740417629_1715395_1339366754_ed175f6628f118ba191c61d70bb11779.jpg treat image : temp/1740417629_1715395_1339366752_51b374caadb7ad2c7a1720ec6f735cda.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.013470649719238281 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01216268539428711 save missing photos in datou_result : time spend for datou_step_exec : 0.9867010116577148 time spend to save output : 0.030185937881469727 total time spend for step 2 : 1.0168869495391846 step3:blur_detection Mon Feb 24 18:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740417629_1715395_1339366765_bcdaaa63c0d56b7364134184618ad3d2.jpg resize: (1080, 1920) 1339366765 -7.217932158030192 treat image : temp/1740417629_1715395_1339366762_42fbc93dd1e08ef57d3f54ebad9db79a.jpg resize: (1080, 1920) 1339366762 -7.212570166418106 treat image : temp/1740417629_1715395_1339366754_ed175f6628f118ba191c61d70bb11779.jpg resize: (1080, 1920) 1339366754 -7.207532480994312 treat image : temp/1740417629_1715395_1339366752_51b374caadb7ad2c7a1720ec6f735cda.jpg resize: (1080, 1920) 1339366752 -7.34280756581889 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011761188507080078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.010842561721801758 save missing photos in datou_result : time spend for datou_step_exec : 5.247420072555542 time spend to save output : 0.027446746826171875 total time spend for step 3 : 5.274866819381714 step4:rle_unique_nms_with_priority Mon Feb 24 18:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 325 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 86 nb_hashtags : 6 time to prepare the origin masks : 1.1204218864440918 time for calcul the mask position with numpy : 0.4394047260284424 nb_pixel_total : 1767052 time to create 1 rle with new method : 0.13424062728881836 time for calcul the mask position with numpy : 0.007964611053466797 nb_pixel_total : 8278 time to create 1 rle with old method : 0.009652853012084961 time for calcul the mask position with numpy : 0.008968591690063477 nb_pixel_total : 6956 time to create 1 rle with old method : 0.010658740997314453 time for calcul the mask position with numpy : 0.00868082046508789 nb_pixel_total : 47700 time to create 1 rle with old method : 0.054509878158569336 time for calcul the mask position with numpy : 0.008411407470703125 nb_pixel_total : 866 time to create 1 rle with old method : 0.0010271072387695312 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 51 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.008343696594238281 nb_pixel_total : 14 time to create 1 rle with old method : 2.86102294921875e-05 time for calcul the mask position with numpy : 0.008382558822631836 nb_pixel_total : 46 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.008281946182250977 nb_pixel_total : 68 time to create 1 rle with old method : 0.00010561943054199219 time for calcul the mask position with numpy : 0.008345365524291992 nb_pixel_total : 350 time to create 1 rle with old method : 0.000423431396484375 time for calcul the mask position with numpy : 0.008328676223754883 nb_pixel_total : 70 time to create 1 rle with old method : 9.72747802734375e-05 time for calcul the mask position with numpy : 0.007803201675415039 nb_pixel_total : 2332 time to create 1 rle with old method : 0.0025529861450195312 time for calcul the mask position with numpy : 0.0077855587005615234 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001163482666015625 time for calcul the mask position with numpy : 0.007828950881958008 nb_pixel_total : 1257 time to create 1 rle with old method : 0.00151824951171875 time for calcul the mask position with numpy : 0.008409976959228516 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.008279561996459961 nb_pixel_total : 1791 time to create 1 rle with old method : 0.0021300315856933594 time for calcul the mask position with numpy : 0.008221149444580078 nb_pixel_total : 898 time to create 1 rle with old method : 0.0009484291076660156 time for calcul the mask position with numpy : 0.00803995132446289 nb_pixel_total : 6534 time to create 1 rle with old method : 0.007213592529296875 time for calcul the mask position with numpy : 0.008110523223876953 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0013203620910644531 time for calcul the mask position with numpy : 0.008122682571411133 nb_pixel_total : 9054 time to create 1 rle with old method : 0.00993490219116211 time for calcul the mask position with numpy : 0.0078277587890625 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003364086151123047 time for calcul the mask position with numpy : 0.00795125961303711 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006175041198730469 time for calcul the mask position with numpy : 0.008074283599853516 nb_pixel_total : 1780 time to create 1 rle with old method : 0.0018568038940429688 time for calcul the mask position with numpy : 0.008283138275146484 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007188320159912109 time for calcul the mask position with numpy : 0.008251190185546875 nb_pixel_total : 16787 time to create 1 rle with old method : 0.018810033798217773 time for calcul the mask position with numpy : 0.008735418319702148 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.008296012878417969 nb_pixel_total : 1242 time to create 1 rle with old method : 0.001329660415649414 time for calcul the mask position with numpy : 0.008272647857666016 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.009975910186767578 nb_pixel_total : 825 time to create 1 rle with old method : 0.0013735294342041016 time for calcul the mask position with numpy : 0.009682178497314453 nb_pixel_total : 1164 time to create 1 rle with old method : 0.001992464065551758 time for calcul the mask position with numpy : 0.009565591812133789 nb_pixel_total : 3315 time to create 1 rle with old method : 0.00531458854675293 time for calcul the mask position with numpy : 0.009629964828491211 nb_pixel_total : 837 time to create 1 rle with old method : 0.0014312267303466797 time for calcul the mask position with numpy : 0.00970005989074707 nb_pixel_total : 998 time to create 1 rle with old method : 0.0016531944274902344 time for calcul the mask position with numpy : 0.009854316711425781 nb_pixel_total : 750 time to create 1 rle with old method : 0.001313924789428711 time for calcul the mask position with numpy : 0.009877443313598633 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002033710479736328 time for calcul the mask position with numpy : 0.009412288665771484 nb_pixel_total : 637 time to create 1 rle with old method : 0.0006556510925292969 time for calcul the mask position with numpy : 0.008134841918945312 nb_pixel_total : 145 time to create 1 rle with old method : 0.00016236305236816406 time for calcul the mask position with numpy : 0.00825190544128418 nb_pixel_total : 2403 time to create 1 rle with old method : 0.0027272701263427734 time for calcul the mask position with numpy : 0.00824737548828125 nb_pixel_total : 812 time to create 1 rle with old method : 0.0009331703186035156 time for calcul the mask position with numpy : 0.008239030838012695 nb_pixel_total : 105 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.008219718933105469 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004940032958984375 time for calcul the mask position with numpy : 0.00819540023803711 nb_pixel_total : 1521 time to create 1 rle with old method : 0.0017428398132324219 time for calcul the mask position with numpy : 0.00789785385131836 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0012767314910888672 time for calcul the mask position with numpy : 0.007996797561645508 nb_pixel_total : 185 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.00794219970703125 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005412101745605469 time for calcul the mask position with numpy : 0.007723331451416016 nb_pixel_total : 417 time to create 1 rle with old method : 0.0004520416259765625 time for calcul the mask position with numpy : 0.008009672164916992 nb_pixel_total : 106215 time to create 1 rle with old method : 0.11215424537658691 time for calcul the mask position with numpy : 0.00782465934753418 nb_pixel_total : 120 time to create 1 rle with old method : 0.00013875961303710938 time for calcul the mask position with numpy : 0.007902145385742188 nb_pixel_total : 2838 time to create 1 rle with old method : 0.003164529800415039 time for calcul the mask position with numpy : 0.008129596710205078 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.007704734802246094 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.007706880569458008 nb_pixel_total : 2694 time to create 1 rle with old method : 0.002841472625732422 time for calcul the mask position with numpy : 0.007668733596801758 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0014982223510742188 time for calcul the mask position with numpy : 0.0077626705169677734 nb_pixel_total : 15 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.007792949676513672 nb_pixel_total : 261 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.008161306381225586 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.008833169937133789 nb_pixel_total : 5721 time to create 1 rle with old method : 0.0063898563385009766 time for calcul the mask position with numpy : 0.008547067642211914 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005483627319335938 time for calcul the mask position with numpy : 0.008526802062988281 nb_pixel_total : 35315 time to create 1 rle with old method : 0.03887820243835449 time for calcul the mask position with numpy : 0.008527278900146484 nb_pixel_total : 3519 time to create 1 rle with old method : 0.004120826721191406 time for calcul the mask position with numpy : 0.009148836135864258 nb_pixel_total : 823 time to create 1 rle with old method : 0.0009696483612060547 time for calcul the mask position with numpy : 0.008505821228027344 nb_pixel_total : 2815 time to create 1 rle with old method : 0.0033431053161621094 time for calcul the mask position with numpy : 0.008718729019165039 nb_pixel_total : 461 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.008666276931762695 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004661083221435547 time for calcul the mask position with numpy : 0.008503198623657227 nb_pixel_total : 6858 time to create 1 rle with old method : 0.007724761962890625 time for calcul the mask position with numpy : 0.008545637130737305 nb_pixel_total : 199 time to create 1 rle with old method : 0.00025653839111328125 time for calcul the mask position with numpy : 0.008572816848754883 nb_pixel_total : 907 time to create 1 rle with old method : 0.0010585784912109375 time for calcul the mask position with numpy : 0.008574247360229492 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007786750793457031 time for calcul the mask position with numpy : 0.00856637954711914 nb_pixel_total : 243 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.008425474166870117 nb_pixel_total : 1405 time to create 1 rle with old method : 0.0016357898712158203 time for calcul the mask position with numpy : 0.008249521255493164 nb_pixel_total : 90 time to create 1 rle with old method : 0.00011563301086425781 time for calcul the mask position with numpy : 0.008485555648803711 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004184246063232422 time for calcul the mask position with numpy : 0.008174896240234375 nb_pixel_total : 417 time to create 1 rle with old method : 0.0004994869232177734 time for calcul the mask position with numpy : 0.008250236511230469 nb_pixel_total : 13 time to create 1 rle with old method : 2.8371810913085938e-05 time for calcul the mask position with numpy : 0.008275985717773438 nb_pixel_total : 529 time to create 1 rle with old method : 0.0005581378936767578 time for calcul the mask position with numpy : 0.00829005241394043 nb_pixel_total : 247 time to create 1 rle with old method : 0.0002913475036621094 time for calcul the mask position with numpy : 0.008383512496948242 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.008110284805297852 nb_pixel_total : 566 time to create 1 rle with old method : 0.0006878376007080078 time for calcul the mask position with numpy : 0.008293628692626953 nb_pixel_total : 1832 time to create 1 rle with old method : 0.0020818710327148438 time for calcul the mask position with numpy : 0.00818634033203125 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007672309875488281 time for calcul the mask position with numpy : 0.008272171020507812 nb_pixel_total : 374 time to create 1 rle with old method : 0.00044536590576171875 time for calcul the mask position with numpy : 0.008331537246704102 nb_pixel_total : 274 time to create 1 rle with old method : 0.0003304481506347656 time for calcul the mask position with numpy : 0.008131265640258789 nb_pixel_total : 92 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.00820302963256836 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.008187055587768555 nb_pixel_total : 374 time to create 1 rle with old method : 0.0003941059112548828 time for calcul the mask position with numpy : 0.008157968521118164 nb_pixel_total : 158 time to create 1 rle with old method : 0.0001857280731201172 time for calcul the mask position with numpy : 0.008102893829345703 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003712177276611328 create new chi : 1.652024745941162 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010725021362304688 batch 1 Loaded 87 chid ids of type : 4230 Number RLEs to save : 10718 TO DO : save crop sub photo not yet done ! save time : 0.6314892768859863 nb_obj : 79 nb_hashtags : 6 time to prepare the origin masks : 1.8285200595855713 time for calcul the mask position with numpy : 0.032884836196899414 nb_pixel_total : 1813676 time to create 1 rle with new method : 0.06118321418762207 time for calcul the mask position with numpy : 0.010770797729492188 nb_pixel_total : 10370 time to create 1 rle with old method : 0.010915040969848633 time for calcul the mask position with numpy : 0.009778261184692383 nb_pixel_total : 4748 time to create 1 rle with old method : 0.005078315734863281 time for calcul the mask position with numpy : 0.009952783584594727 nb_pixel_total : 893 time to create 1 rle with old method : 0.001013040542602539 time for calcul the mask position with numpy : 0.009613990783691406 nb_pixel_total : 32 time to create 1 rle with old method : 6.222724914550781e-05 time for calcul the mask position with numpy : 0.009770631790161133 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.007623910903930664 nb_pixel_total : 52537 time to create 1 rle with old method : 0.05929374694824219 time for calcul the mask position with numpy : 0.0060732364654541016 nb_pixel_total : 2421 time to create 1 rle with old method : 0.002655029296875 time for calcul the mask position with numpy : 0.005976676940917969 nb_pixel_total : 14252 time to create 1 rle with old method : 0.014923810958862305 time for calcul the mask position with numpy : 0.005792140960693359 nb_pixel_total : 265 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.005755901336669922 nb_pixel_total : 36 time to create 1 rle with old method : 7.939338684082031e-05 time for calcul the mask position with numpy : 0.005913972854614258 nb_pixel_total : 1068 time to create 1 rle with old method : 0.001201629638671875 time for calcul the mask position with numpy : 0.005939006805419922 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0015304088592529297 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 8776 time to create 1 rle with old method : 0.009372234344482422 time for calcul the mask position with numpy : 0.005692481994628906 nb_pixel_total : 869 time to create 1 rle with old method : 0.0009946823120117188 time for calcul the mask position with numpy : 0.0058476924896240234 nb_pixel_total : 524 time to create 1 rle with old method : 0.0005824565887451172 time for calcul the mask position with numpy : 0.0059642791748046875 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0020477771759033203 time for calcul the mask position with numpy : 0.0062677860260009766 nb_pixel_total : 9 time to create 1 rle with old method : 4.2438507080078125e-05 time for calcul the mask position with numpy : 0.006154298782348633 nb_pixel_total : 767 time to create 1 rle with old method : 0.0008287429809570312 time for calcul the mask position with numpy : 0.005972385406494141 nb_pixel_total : 9817 time to create 1 rle with old method : 0.01159524917602539 time for calcul the mask position with numpy : 0.006175518035888672 nb_pixel_total : 142 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.0059010982513427734 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.005700349807739258 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0013818740844726562 time for calcul the mask position with numpy : 0.005831718444824219 nb_pixel_total : 910 time to create 1 rle with old method : 0.0009980201721191406 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003218650817871094 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011811256408691406 time for calcul the mask position with numpy : 0.0058820247650146484 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005345344543457031 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 2954 time to create 1 rle with old method : 0.003250598907470703 time for calcul the mask position with numpy : 0.005898237228393555 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0014338493347167969 time for calcul the mask position with numpy : 0.0057032108306884766 nb_pixel_total : 97 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.006226062774658203 nb_pixel_total : 307 time to create 1 rle with old method : 0.0004076957702636719 time for calcul the mask position with numpy : 0.005782604217529297 nb_pixel_total : 1696 time to create 1 rle with old method : 0.0018742084503173828 time for calcul the mask position with numpy : 0.006018400192260742 nb_pixel_total : 10 time to create 1 rle with old method : 2.5510787963867188e-05 time for calcul the mask position with numpy : 0.0061833858489990234 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003426074981689453 time for calcul the mask position with numpy : 0.005988121032714844 nb_pixel_total : 939 time to create 1 rle with old method : 0.0011742115020751953 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0012135505676269531 time for calcul the mask position with numpy : 0.0057904720306396484 nb_pixel_total : 114 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.005875825881958008 nb_pixel_total : 136 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.005783557891845703 nb_pixel_total : 2361 time to create 1 rle with old method : 0.002574443817138672 time for calcul the mask position with numpy : 0.0061376094818115234 nb_pixel_total : 974 time to create 1 rle with old method : 0.001088857650756836 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.00584101676940918 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.005892038345336914 nb_pixel_total : 1083 time to create 1 rle with old method : 0.0011744499206542969 time for calcul the mask position with numpy : 0.0058972835540771484 nb_pixel_total : 188 time to create 1 rle with old method : 0.00023436546325683594 time for calcul the mask position with numpy : 0.00589752197265625 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.0064008235931396484 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006513595581054688 time for calcul the mask position with numpy : 0.006569862365722656 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004923343658447266 time for calcul the mask position with numpy : 0.010851383209228516 nb_pixel_total : 104872 time to create 1 rle with old method : 0.11431717872619629 time for calcul the mask position with numpy : 0.01012420654296875 nb_pixel_total : 159 time to create 1 rle with old method : 0.00020575523376464844 time for calcul the mask position with numpy : 0.00985860824584961 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.009881973266601562 nb_pixel_total : 255 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.010002374649047852 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0035343170166015625 time for calcul the mask position with numpy : 0.010113239288330078 nb_pixel_total : 3657 time to create 1 rle with old method : 0.003927946090698242 time for calcul the mask position with numpy : 0.01011204719543457 nb_pixel_total : 103 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.00991678237915039 nb_pixel_total : 262 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.009590625762939453 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004734992980957031 time for calcul the mask position with numpy : 0.010250091552734375 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006091594696044922 time for calcul the mask position with numpy : 0.008675575256347656 nb_pixel_total : 879 time to create 1 rle with old method : 0.0009999275207519531 time for calcul the mask position with numpy : 0.006163835525512695 nb_pixel_total : 6712 time to create 1 rle with old method : 0.007430553436279297 time for calcul the mask position with numpy : 0.006288766860961914 nb_pixel_total : 2953 time to create 1 rle with old method : 0.0031592845916748047 time for calcul the mask position with numpy : 0.0060083866119384766 nb_pixel_total : 383 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.006343841552734375 nb_pixel_total : 252 time to create 1 rle with old method : 0.00036835670471191406 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 262 time to create 1 rle with old method : 0.00030612945556640625 time for calcul the mask position with numpy : 0.006520748138427734 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.00612187385559082 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005223751068115234 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003612041473388672 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 19 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.005991458892822266 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003638267517089844 time for calcul the mask position with numpy : 0.005944013595581055 nb_pixel_total : 306 time to create 1 rle with old method : 0.000339508056640625 time for calcul the mask position with numpy : 0.006021976470947266 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.0056760311126708984 nb_pixel_total : 122 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.006048679351806641 nb_pixel_total : 682 time to create 1 rle with old method : 0.0007984638214111328 time for calcul the mask position with numpy : 0.006512641906738281 nb_pixel_total : 538 time to create 1 rle with old method : 0.0005803108215332031 time for calcul the mask position with numpy : 0.006244182586669922 nb_pixel_total : 306 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.006254911422729492 nb_pixel_total : 194 time to create 1 rle with old method : 0.00023889541625976562 time for calcul the mask position with numpy : 0.006407022476196289 nb_pixel_total : 87 time to create 1 rle with old method : 0.00011229515075683594 time for calcul the mask position with numpy : 0.006045103073120117 nb_pixel_total : 732 time to create 1 rle with old method : 0.0008294582366943359 time for calcul the mask position with numpy : 0.006044864654541016 nb_pixel_total : 125 time to create 1 rle with old method : 0.00015425682067871094 time for calcul the mask position with numpy : 0.005734682083129883 nb_pixel_total : 311 time to create 1 rle with old method : 0.0003535747528076172 time for calcul the mask position with numpy : 0.005787372589111328 nb_pixel_total : 4 time to create 1 rle with old method : 2.3126602172851562e-05 create new chi : 0.9237015247344971 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0011649131774902344 batch 1 Loaded 80 chid ids of type : 4230 Number RLEs to save : 9134 TO DO : save crop sub photo not yet done ! save time : 0.5142614841461182 nb_obj : 75 nb_hashtags : 7 time to prepare the origin masks : 1.3661086559295654 time for calcul the mask position with numpy : 0.025687694549560547 nb_pixel_total : 1854753 time to create 1 rle with new method : 0.04002952575683594 time for calcul the mask position with numpy : 0.006176948547363281 nb_pixel_total : 9847 time to create 1 rle with old method : 0.01096034049987793 time for calcul the mask position with numpy : 0.005972385406494141 nb_pixel_total : 5247 time to create 1 rle with old method : 0.0060307979583740234 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010416507720947266 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 19 time to create 1 rle with old method : 4.220008850097656e-05 time for calcul the mask position with numpy : 0.005835533142089844 nb_pixel_total : 345 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.006558895111083984 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001010894775390625 time for calcul the mask position with numpy : 0.006098747253417969 nb_pixel_total : 57 time to create 1 rle with old method : 8.7738037109375e-05 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001583099365234375 time for calcul the mask position with numpy : 0.006208658218383789 nb_pixel_total : 200 time to create 1 rle with old method : 0.0005049705505371094 time for calcul the mask position with numpy : 0.007312774658203125 nb_pixel_total : 2521 time to create 1 rle with old method : 0.0028998851776123047 time for calcul the mask position with numpy : 0.006494760513305664 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.0066912174224853516 nb_pixel_total : 925 time to create 1 rle with old method : 0.0010786056518554688 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.006090879440307617 nb_pixel_total : 153 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.0063703060150146484 nb_pixel_total : 151 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.006417512893676758 nb_pixel_total : 9191 time to create 1 rle with old method : 0.010538339614868164 time for calcul the mask position with numpy : 0.006297588348388672 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006320476531982422 time for calcul the mask position with numpy : 0.006120204925537109 nb_pixel_total : 1773 time to create 1 rle with old method : 0.0020122528076171875 time for calcul the mask position with numpy : 0.0060961246490478516 nb_pixel_total : 729 time to create 1 rle with old method : 0.0008444786071777344 time for calcul the mask position with numpy : 0.0062255859375 nb_pixel_total : 7940 time to create 1 rle with old method : 0.008886098861694336 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.006863832473754883 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0014829635620117188 time for calcul the mask position with numpy : 0.006297111511230469 nb_pixel_total : 904 time to create 1 rle with old method : 0.0010688304901123047 time for calcul the mask position with numpy : 0.006543874740600586 nb_pixel_total : 234 time to create 1 rle with old method : 0.00031757354736328125 time for calcul the mask position with numpy : 0.007645130157470703 nb_pixel_total : 1680 time to create 1 rle with old method : 0.002066373825073242 time for calcul the mask position with numpy : 0.006561756134033203 nb_pixel_total : 2868 time to create 1 rle with old method : 0.0033409595489501953 time for calcul the mask position with numpy : 0.006241321563720703 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009186267852783203 time for calcul the mask position with numpy : 0.006112337112426758 nb_pixel_total : 378 time to create 1 rle with old method : 0.00048041343688964844 time for calcul the mask position with numpy : 0.0063550472259521484 nb_pixel_total : 976 time to create 1 rle with old method : 0.0011472702026367188 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 108 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.006006717681884766 nb_pixel_total : 130 time to create 1 rle with old method : 0.00020170211791992188 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 2497 time to create 1 rle with old method : 0.0028276443481445312 time for calcul the mask position with numpy : 0.00597834587097168 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009398460388183594 time for calcul the mask position with numpy : 0.0058705806732177734 nb_pixel_total : 107 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.0060002803802490234 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004401206970214844 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 1258 time to create 1 rle with old method : 0.001438140869140625 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 345 time to create 1 rle with old method : 0.00046634674072265625 time for calcul the mask position with numpy : 0.00600743293762207 nb_pixel_total : 202 time to create 1 rle with old method : 0.00025844573974609375 time for calcul the mask position with numpy : 0.006059169769287109 nb_pixel_total : 582 time to create 1 rle with old method : 0.0006721019744873047 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.006531953811645508 nb_pixel_total : 106114 time to create 1 rle with old method : 0.11723804473876953 time for calcul the mask position with numpy : 0.006078481674194336 nb_pixel_total : 57 time to create 1 rle with old method : 8.606910705566406e-05 time for calcul the mask position with numpy : 0.005938529968261719 nb_pixel_total : 104 time to create 1 rle with old method : 0.00014472007751464844 time for calcul the mask position with numpy : 0.005936861038208008 nb_pixel_total : 251 time to create 1 rle with old method : 0.00030493736267089844 time for calcul the mask position with numpy : 0.005853414535522461 nb_pixel_total : 146 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.006610393524169922 nb_pixel_total : 2943 time to create 1 rle with old method : 0.0033979415893554688 time for calcul the mask position with numpy : 0.006044626235961914 nb_pixel_total : 2821 time to create 1 rle with old method : 0.0032796859741210938 time for calcul the mask position with numpy : 0.006055116653442383 nb_pixel_total : 222 time to create 1 rle with old method : 0.00027179718017578125 time for calcul the mask position with numpy : 0.006098747253417969 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003292560577392578 time for calcul the mask position with numpy : 0.00604557991027832 nb_pixel_total : 77 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.006034135818481445 nb_pixel_total : 8786 time to create 1 rle with old method : 0.009932994842529297 time for calcul the mask position with numpy : 0.0061719417572021484 nb_pixel_total : 26510 time to create 1 rle with old method : 0.029878854751586914 time for calcul the mask position with numpy : 0.0061109066009521484 nb_pixel_total : 950 time to create 1 rle with old method : 0.001104593276977539 time for calcul the mask position with numpy : 0.006073951721191406 nb_pixel_total : 2685 time to create 1 rle with old method : 0.003059864044189453 time for calcul the mask position with numpy : 0.006106138229370117 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021195411682128906 time for calcul the mask position with numpy : 0.0060884952545166016 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004284381866455078 time for calcul the mask position with numpy : 0.006021976470947266 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003070831298828125 time for calcul the mask position with numpy : 0.00605320930480957 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003025531768798828 time for calcul the mask position with numpy : 0.006060600280761719 nb_pixel_total : 1435 time to create 1 rle with old method : 0.0016832351684570312 time for calcul the mask position with numpy : 0.00612950325012207 nb_pixel_total : 374 time to create 1 rle with old method : 0.00044345855712890625 time for calcul the mask position with numpy : 0.006071567535400391 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004353523254394531 time for calcul the mask position with numpy : 0.00595545768737793 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.006014347076416016 nb_pixel_total : 15 time to create 1 rle with old method : 3.504753112792969e-05 time for calcul the mask position with numpy : 0.0058252811431884766 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004031658172607422 time for calcul the mask position with numpy : 0.006001472473144531 nb_pixel_total : 2276 time to create 1 rle with old method : 0.002573251724243164 time for calcul the mask position with numpy : 0.006434202194213867 nb_pixel_total : 253 time to create 1 rle with old method : 0.00034689903259277344 time for calcul the mask position with numpy : 0.00601649284362793 nb_pixel_total : 670 time to create 1 rle with old method : 0.0008730888366699219 time for calcul the mask position with numpy : 0.005876064300537109 nb_pixel_total : 68 time to create 1 rle with old method : 0.0001125335693359375 time for calcul the mask position with numpy : 0.005834102630615234 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.005886554718017578 nb_pixel_total : 322 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.006096601486206055 nb_pixel_total : 27 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.006072521209716797 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005052089691162109 time for calcul the mask position with numpy : 0.006507396697998047 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012540817260742188 time for calcul the mask position with numpy : 0.006418466567993164 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028133392333984375 create new chi : 0.7787444591522217 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012669563293457031 batch 1 Loaded 76 chid ids of type : 4230 Number RLEs to save : 7975 TO DO : save crop sub photo not yet done ! save time : 0.6314034461975098 nb_obj : 85 nb_hashtags : 6 time to prepare the origin masks : 1.4469294548034668 time for calcul the mask position with numpy : 0.7695105075836182 nb_pixel_total : 1662727 time to create 1 rle with new method : 0.3646054267883301 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 16827 time to create 1 rle with old method : 0.018773555755615234 time for calcul the mask position with numpy : 0.0060994625091552734 nb_pixel_total : 7276 time to create 1 rle with old method : 0.011906147003173828 time for calcul the mask position with numpy : 0.006510496139526367 nb_pixel_total : 28 time to create 1 rle with old method : 0.00011539459228515625 time for calcul the mask position with numpy : 0.006560325622558594 nb_pixel_total : 871 time to create 1 rle with old method : 0.0014765262603759766 time for calcul the mask position with numpy : 0.006552696228027344 nb_pixel_total : 180 time to create 1 rle with old method : 0.00034165382385253906 time for calcul the mask position with numpy : 0.006422519683837891 nb_pixel_total : 44 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.006571769714355469 nb_pixel_total : 2337 time to create 1 rle with old method : 0.003802061080932617 time for calcul the mask position with numpy : 0.006507158279418945 nb_pixel_total : 104 time to create 1 rle with old method : 0.00027179718017578125 time for calcul the mask position with numpy : 0.006758213043212891 nb_pixel_total : 300 time to create 1 rle with old method : 0.0005118846893310547 time for calcul the mask position with numpy : 0.006722450256347656 nb_pixel_total : 7079 time to create 1 rle with old method : 0.009931325912475586 time for calcul the mask position with numpy : 0.006146430969238281 nb_pixel_total : 437 time to create 1 rle with old method : 0.000560760498046875 time for calcul the mask position with numpy : 0.005915641784667969 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.006033182144165039 nb_pixel_total : 591 time to create 1 rle with old method : 0.0006773471832275391 time for calcul the mask position with numpy : 0.007330894470214844 nb_pixel_total : 150160 time to create 1 rle with new method : 0.07335782051086426 time for calcul the mask position with numpy : 0.005974531173706055 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0014736652374267578 time for calcul the mask position with numpy : 0.005936145782470703 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008089542388916016 time for calcul the mask position with numpy : 0.006088972091674805 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009860992431640625 time for calcul the mask position with numpy : 0.005928993225097656 nb_pixel_total : 9953 time to create 1 rle with old method : 0.011074066162109375 time for calcul the mask position with numpy : 0.006001710891723633 nb_pixel_total : 172 time to create 1 rle with old method : 0.00020122528076171875 time for calcul the mask position with numpy : 0.005951404571533203 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0013201236724853516 time for calcul the mask position with numpy : 0.006453990936279297 nb_pixel_total : 745 time to create 1 rle with old method : 0.00087738037109375 time for calcul the mask position with numpy : 0.006071567535400391 nb_pixel_total : 218 time to create 1 rle with old method : 0.00028324127197265625 time for calcul the mask position with numpy : 0.006195068359375 nb_pixel_total : 2108 time to create 1 rle with old method : 0.0026073455810546875 time for calcul the mask position with numpy : 0.006372928619384766 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005898475646972656 time for calcul the mask position with numpy : 0.006117105484008789 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008974075317382812 time for calcul the mask position with numpy : 0.006490468978881836 nb_pixel_total : 3801 time to create 1 rle with old method : 0.004183292388916016 time for calcul the mask position with numpy : 0.0064945220947265625 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003657341003417969 time for calcul the mask position with numpy : 0.006538867950439453 nb_pixel_total : 308 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.006547212600708008 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007276535034179688 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 2127 time to create 1 rle with old method : 0.0022962093353271484 time for calcul the mask position with numpy : 0.006544828414916992 nb_pixel_total : 717 time to create 1 rle with old method : 0.0008080005645751953 time for calcul the mask position with numpy : 0.006577253341674805 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018715858459472656 time for calcul the mask position with numpy : 0.006768941879272461 nb_pixel_total : 132 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.006288290023803711 nb_pixel_total : 2524 time to create 1 rle with old method : 0.0028421878814697266 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0011751651763916016 time for calcul the mask position with numpy : 0.010222673416137695 nb_pixel_total : 132 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.010057210922241211 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005712509155273438 time for calcul the mask position with numpy : 0.010135173797607422 nb_pixel_total : 1623 time to create 1 rle with old method : 0.0018854141235351562 time for calcul the mask position with numpy : 0.009804487228393555 nb_pixel_total : 223 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.009796857833862305 nb_pixel_total : 538 time to create 1 rle with old method : 0.0005927085876464844 time for calcul the mask position with numpy : 0.00994729995727539 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.010044336318969727 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.0073697566986083984 nb_pixel_total : 106433 time to create 1 rle with old method : 0.1172637939453125 time for calcul the mask position with numpy : 0.005948781967163086 nb_pixel_total : 180 time to create 1 rle with old method : 0.00021600723266601562 time for calcul the mask position with numpy : 0.005968809127807617 nb_pixel_total : 119 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.005944490432739258 nb_pixel_total : 232 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 1890 time to create 1 rle with old method : 0.002123117446899414 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 3610 time to create 1 rle with old method : 0.003930807113647461 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 11 time to create 1 rle with old method : 7.748603820800781e-05 time for calcul the mask position with numpy : 0.006136178970336914 nb_pixel_total : 12 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.006047248840332031 nb_pixel_total : 260 time to create 1 rle with old method : 0.00031566619873046875 time for calcul the mask position with numpy : 0.005829572677612305 nb_pixel_total : 257 time to create 1 rle with old method : 0.00030994415283203125 time for calcul the mask position with numpy : 0.006452083587646484 nb_pixel_total : 35562 time to create 1 rle with old method : 0.04038643836975098 time for calcul the mask position with numpy : 0.00630497932434082 nb_pixel_total : 12 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.006278038024902344 nb_pixel_total : 27618 time to create 1 rle with old method : 0.030455589294433594 time for calcul the mask position with numpy : 0.006044149398803711 nb_pixel_total : 1800 time to create 1 rle with old method : 0.0021071434020996094 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.006160259246826172 nb_pixel_total : 2850 time to create 1 rle with old method : 0.0032875537872314453 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.005827903747558594 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004570484161376953 time for calcul the mask position with numpy : 0.0057218074798583984 nb_pixel_total : 346 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.005876302719116211 nb_pixel_total : 297 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.006281375885009766 nb_pixel_total : 19 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.005877494812011719 nb_pixel_total : 29 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.005868673324584961 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.0073621273040771484 nb_pixel_total : 3 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.009861946105957031 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0016810894012451172 time for calcul the mask position with numpy : 0.009916305541992188 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003459453582763672 time for calcul the mask position with numpy : 0.010059833526611328 nb_pixel_total : 376 time to create 1 rle with old method : 0.000469207763671875 time for calcul the mask position with numpy : 0.009784460067749023 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.009828805923461914 nb_pixel_total : 19 time to create 1 rle with old method : 4.1961669921875e-05 time for calcul the mask position with numpy : 0.009958505630493164 nb_pixel_total : 610 time to create 1 rle with old method : 0.000736236572265625 time for calcul the mask position with numpy : 0.010097265243530273 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004105567932128906 time for calcul the mask position with numpy : 0.008375406265258789 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005562305450439453 time for calcul the mask position with numpy : 0.008400440216064453 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.008299112319946289 nb_pixel_total : 65 time to create 1 rle with old method : 9.584426879882812e-05 time for calcul the mask position with numpy : 0.008235692977905273 nb_pixel_total : 652 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.008292675018310547 nb_pixel_total : 722 time to create 1 rle with old method : 0.000965118408203125 time for calcul the mask position with numpy : 0.008277654647827148 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0012996196746826172 time for calcul the mask position with numpy : 0.008345842361450195 nb_pixel_total : 59 time to create 1 rle with old method : 8.821487426757812e-05 time for calcul the mask position with numpy : 0.00845956802368164 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007121562957763672 time for calcul the mask position with numpy : 0.00825190544128418 nb_pixel_total : 134 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.008272647857666016 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001087188720703125 time for calcul the mask position with numpy : 0.008127212524414062 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004413127899169922 create new chi : 2.126331329345703 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013456344604492188 batch 1 Loaded 86 chid ids of type : 4230 Number RLEs to save : 9692 TO DO : save crop sub photo not yet done ! save time : 0.5747733116149902 map_output_result : {1339366765: (0.0, 'Should be the crop_list due to order', 0.0), 1339366762: (0.0, 'Should be the crop_list due to order', 0.0), 1339366754: (0.0, 'Should be the crop_list due to order', 0.0), 1339366752: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 4 /1339366765.Didn't retrieve data . /1339366762.Didn't retrieve data . /1339366754.Didn't retrieve data . /1339366752.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013466358184814453 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.06279730796814 time spend to save output : 0.013997793197631836 total time spend for step 4 : 14.076795101165771 step5:crop_condition Mon Feb 24 18:21:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 329 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 123 About to insert : list_path_to_insert length 123 new photo from crops ! About to upload 123 photos upload in portfolio : 4869462 init cache_photo without model_param we have 123 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740417684_1715395 we have uploaded 123 photos in the portfolio 4869462 time of upload the photos Elapsed time : 33.38703393936157 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 4869462 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740417717_1715395 we have uploaded 37 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.128168821334839 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740417727_1715395 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7161569595336914 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 4869462 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740417728_1715395 we have uploaded 11 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.1036906242370605 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 44 About to insert : list_path_to_insert length 44 new photo from crops ! About to upload 44 photos upload in portfolio : 4869462 init cache_photo without model_param we have 44 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740417732_1715395 we have uploaded 44 photos in the portfolio 4869462 time of upload the photos Elapsed time : 14.43873906135559 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 217 /1339370744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1339370970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 655 time used for this insertion : 0.09275221824645996 save_final save missing photos in datou_result : time spend for datou_step_exec : 65.44781041145325 time spend to save output : 0.0973653793334961 total time spend for step 5 : 65.54517579078674 step6:thcl Mon Feb 24 18:22:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01443028450012207 time to convert the images to numpy array : 0.07361555099487305 time to import caffe and check if the image exist : 0.0179293155670166 time to convert the images to numpy array : 0.07344484329223633 time to import caffe and check if the image exist : 0.01984262466430664 time to convert the images to numpy array : 0.07916617393493652 time to import caffe and check if the image exist : 0.019313573837280273 time to convert the images to numpy array : 0.08460593223571777 time to import caffe and check if the image exist : 0.04116034507751465 time to convert the images to numpy array : 0.0644986629486084 time to import caffe and check if the image exist : 0.020273685455322266 time to convert the images to numpy array : 0.08725261688232422 time to import caffe and check if the image exist : 0.02377796173095703 time to convert the images to numpy array : 0.08295369148254395 time to import caffe and check if the image exist : 0.023479700088500977 time to convert the images to numpy array : 0.08513879776000977 time to import caffe and check if the image exist : 0.028552770614624023 time to convert the images to numpy array : 0.07985424995422363 time to import caffe and check if the image exist : 0.027302265167236328 time to convert the images to numpy array : 0.08247041702270508 total time to convert the images to numpy array : 0.4049570560455322 list photo_ids error: [] list photo_ids correct : [1339370766, 1339370767, 1339370768, 1339370769, 1339370770, 1339370771, 1339370772, 1339370773, 1339370774, 1339370775, 1339370776, 1339370777, 1339370778, 1339370779, 1339370780, 1339370781, 1339370782, 1339370783, 1339370784, 1339370785, 1339370786, 1339370787, 1339370856, 1339370857, 1339370858, 1339370859, 1339370860, 1339370861, 1339370862, 1339370863, 1339370864, 1339370865, 1339370866, 1339370867, 1339370868, 1339370871, 1339370872, 1339370873, 1339370874, 1339370876, 1339370877, 1339370878, 1339370879, 1339370880, 1339370833, 1339370834, 1339370835, 1339370836, 1339370837, 1339370838, 1339370839, 1339370840, 1339370842, 1339370843, 1339370844, 1339370845, 1339370846, 1339370847, 1339370848, 1339370849, 1339370850, 1339370851, 1339370852, 1339370853, 1339370854, 1339370855, 1339370952, 1339370953, 1339370954, 1339370955, 1339370956, 1339370957, 1339370958, 1339370959, 1339370960, 1339370961, 1339370962, 1339370963, 1339370964, 1339370965, 1339370966, 1339370967, 1339370968, 1339370969, 1339370970, 1339370881, 1339370882, 1339370883, 1339370884, 1339370885, 1339370886, 1339370887, 1339370888, 1339370889, 1339370890, 1339370891, 1339370892, 1339370893, 1339370894, 1339370895, 1339370896, 1339370897, 1339370898, 1339370899, 1339370900, 1339370901, 1339370902, 1339370744, 1339370745, 1339370746, 1339370747, 1339370748, 1339370749, 1339370750, 1339370751, 1339370752, 1339370753, 1339370754, 1339370755, 1339370756, 1339370757, 1339370758, 1339370759, 1339370760, 1339370761, 1339370762, 1339370763, 1339370764, 1339370765, 1339370930, 1339370931, 1339370932, 1339370933, 1339370934, 1339370935, 1339370936, 1339370937, 1339370938, 1339370939, 1339370940, 1339370941, 1339370942, 1339370943, 1339370944, 1339370945, 1339370946, 1339370947, 1339370948, 1339370949, 1339370950, 1339370951, 1339370811, 1339370812, 1339370813, 1339370814, 1339370815, 1339370816, 1339370817, 1339370818, 1339370819, 1339370820, 1339370821, 1339370822, 1339370823, 1339370824, 1339370825, 1339370826, 1339370827, 1339370828, 1339370829, 1339370830, 1339370831, 1339370832, 1339370903, 1339370904, 1339370905, 1339370906, 1339370907, 1339370908, 1339370909, 1339370910, 1339370912, 1339370913, 1339370914, 1339370915, 1339370916, 1339370917, 1339370918, 1339370919, 1339370920, 1339370921, 1339370922, 1339370926, 1339370928, 1339370929, 1339370788, 1339370789, 1339370790, 1339370791, 1339370792, 1339370793, 1339370794, 1339370795, 1339370796, 1339370797, 1339370798, 1339370800, 1339370801, 1339370802, 1339370803, 1339370804, 1339370805, 1339370806, 1339370807, 1339370808, 1339370809, 1339370810] number of photos to traite : 217 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3185 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2966 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.0414729118347168 time used to do the prediction : 0.8042299747467041 save descriptor for thcl : 3237 time to traite the descriptors : 1.3777673244476318 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1339370766 To insert : 1339370767 To insert : 1339370768 To insert : 1339370769 To insert : 1339370770 To insert : 1339370771 To insert : 1339370772 To insert : 1339370773 To insert : 1339370774 To insert : 1339370775 To insert : 1339370776 To insert : 1339370777 To insert : 1339370778 To insert : 1339370779 To insert : 1339370780 To insert : 1339370781 To insert : 1339370782 To insert : 1339370783 To insert : 1339370784 To insert : 1339370785 To insert : 1339370786 To insert : 1339370787 To insert : 1339370856 To insert : 1339370857 To insert : 1339370858 To insert : 1339370859 To insert : 1339370860 To insert : 1339370861 To insert : 1339370862 To insert : 1339370863 To insert : 1339370864 To insert : 1339370865 To insert : 1339370866 To insert : 1339370867 To insert : 1339370868 To insert : 1339370871 To insert : 1339370872 To insert : 1339370873 To insert : 1339370874 To insert : 1339370876 To insert : 1339370877 To insert : 1339370878 To insert : 1339370879 To insert : 1339370880 To insert : 1339370833 To insert : 1339370834 To insert : 1339370835 To insert : 1339370836 To insert : 1339370837 To insert : 1339370838 To insert : 1339370839 To insert : 1339370840 To insert : 1339370842 To insert : 1339370843 To insert : 1339370844 To insert : 1339370845 To insert : 1339370846 To insert : 1339370847 To insert : 1339370848 To insert : 1339370849 To insert : 1339370850 To insert : 1339370851 To insert : 1339370852 To insert : 1339370853 To insert : 1339370854 To insert : 1339370855 To insert : 1339370952 To insert : 1339370953 To insert : 1339370954 To insert : 1339370955 To insert : 1339370956 To insert : 1339370957 To insert : 1339370958 To insert : 1339370959 To insert : 1339370960 To insert : 1339370961 To insert : 1339370962 To insert : 1339370963 To insert : 1339370964 To insert : 1339370965 To insert : 1339370966 To insert : 1339370967 To insert : 1339370968 To insert : 1339370969 To insert : 1339370970 To insert : 1339370881 To insert : 1339370882 To insert : 1339370883 To insert : 1339370884 To insert : 1339370885 To insert : 1339370886 To insert : 1339370887 To insert : 1339370888 To insert : 1339370889 To insert : 1339370890 To insert : 1339370891 To insert : 1339370892 To insert : 1339370893 To insert : 1339370894 To insert : 1339370895 To insert : 1339370896 To insert : 1339370897 To insert : 1339370898 To insert : 1339370899 To insert : 1339370900 To insert : 1339370901 To insert : 1339370902 To insert : 1339370744 To insert : 1339370745 To insert : 1339370746 To insert : 1339370747 To insert : 1339370748 To insert : 1339370749 To insert : 1339370750 To insert : 1339370751 To insert : 1339370752 To insert : 1339370753 To insert : 1339370754 To insert : 1339370755 To insert : 1339370756 To insert : 1339370757 To insert : 1339370758 To insert : 1339370759 To insert : 1339370760 To insert : 1339370761 To insert : 1339370762 To insert : 1339370763 To insert : 1339370764 To insert : 1339370765 To insert : 1339370930 To insert : 1339370931 To insert : 1339370932 To insert : 1339370933 To insert : 1339370934 To insert : 1339370935 To insert : 1339370936 To insert : 1339370937 To insert : 1339370938 To insert : 1339370939 To insert : 1339370940 To insert : 1339370941 To insert : 1339370942 To insert : 1339370943 To insert : 1339370944 To insert : 1339370945 To insert : 1339370946 To insert : 1339370947 To insert : 1339370948 To insert : 1339370949 To insert : 1339370950 To insert : 1339370951 To insert : 1339370811 To insert : 1339370812 To insert : 1339370813 To insert : 1339370814 To insert : 1339370815 To insert : 1339370816 To insert : 1339370817 To insert : 1339370818 To insert : 1339370819 To insert : 1339370820 To insert : 1339370821 To insert : 1339370822 To insert : 1339370823 To insert : 1339370824 To insert : 1339370825 To insert : 1339370826 To insert : 1339370827 To insert : 1339370828 To insert : 1339370829 To insert : 1339370830 To insert : 1339370831 To insert : 1339370832 To insert : 1339370903 To insert : 1339370904 To insert : 1339370905 To insert : 1339370906 To insert : 1339370907 To insert : 1339370908 To insert : 1339370909 To insert : 1339370910 To insert : 1339370912 To insert : 1339370913 To insert : 1339370914 To insert : 1339370915 To insert : 1339370916 To insert : 1339370917 To insert : 1339370918 To insert : 1339370919 To insert : 1339370920 To insert : 1339370921 To insert : 1339370922 To insert : 1339370926 To insert : 1339370928 To insert : 1339370929 To insert : 1339370788 To insert : 1339370789 To insert : 1339370790 To insert : 1339370791 To insert : 1339370792 To insert : 1339370793 To insert : 1339370794 To insert : 1339370795 To insert : 1339370796 To insert : 1339370797 To insert : 1339370798 To insert : 1339370800 To insert : 1339370801 To insert : 1339370802 To insert : 1339370803 To insert : 1339370804 To insert : 1339370805 To insert : 1339370806 To insert : 1339370807 To insert : 1339370808 To insert : 1339370809 To insert : 1339370810 time to insert the descriptors : 47.23659539222717 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 360 time used for this insertion : 0.03287100791931152 save missing photos in datou_result : time spend for datou_step_exec : 54.878644943237305 time spend to save output : 0.08407473564147949 total time spend for step 6 : 54.962719678878784 step7:ventilate_hashtags_in_portfolio Mon Feb 24 18:23:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20779169 get user id for portfolio 20779169 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','PET_clair','PET_fonce','Carton','carton','pet_fonce','pet_clair','refus','pehd','metal','Film_plastique','PEHD','autre','Papier','mal_croppe','Tetrapak','flou','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','PET_clair','PET_fonce','Carton','carton','pet_fonce','pet_clair','refus','pehd','metal','Film_plastique','PEHD','autre','Papier','mal_croppe','Tetrapak','flou','papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','PET_clair','PET_fonce','Carton','carton','pet_fonce','pet_clair','refus','pehd','metal','Film_plastique','PEHD','autre','Papier','mal_croppe','Tetrapak','flou','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','PET_clair','PET_fonce','Carton','carton','pet_fonce','pet_clair','refus','pehd','metal','Film_plastique','PEHD','autre','Papier','mal_croppe','Tetrapak','flou','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20779464,20779470,20779469,20779468,20779471,20779475,20779473,20779474,20779476,20779481,20779478,20779479,20779480?tags=environnement,pet_clair,pet_fonce,carton,refus,pehd,metal,film_plastique,autre,papier,mal_croppe,tetrapak,flou&datou_id_consolidate=4235&port_consolidate=20779169 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 1 /20779169. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012684822082519531 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4679934978485107 time spend to save output : 0.012906551361083984 total time spend for step 7 : 2.4809000492095947 step8:final Mon Feb 24 18:23:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1339366765: ('0.19892543137470436',), 1339366762: ('0.19892543137470436',), 1339366754: ('0.19892543137470436',), 1339366752: ('0.19892543137470436',)} new output for save of step final : {1339366765: ('0.19892543137470436',), 1339366762: ('0.19892543137470436',), 1339366754: ('0.19892543137470436',), 1339366752: ('0.19892543137470436',)} [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 4 /1339366765.Didn't retrieve data . /1339366762.Didn't retrieve data . /1339366754.Didn't retrieve data . /1339366752.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013294219970703125 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12317800521850586 time spend to save output : 0.013609170913696289 total time spend for step 8 : 0.13678717613220215 step9:velours_tree Mon Feb 24 18:23:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20779464,20779470,20779469,20779468,20779471,20779475,20779473,20779474,20779476,20779481,20779478,20779479,20779480 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779464 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779470 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779469 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779468 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779471 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779475 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779473 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779474 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779476 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779481 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779478 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779479 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779480 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 217 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 5 2 0 3 0 5 0 3 3 2 0 0 1 3 5 0 0 0 0 3 2 2 2 5 3 2 3 0 2 4 0 5 2 0 0 3 2 0 1 0 3 2 2 0 0 0 0 0 3 2 2 2 2 3 0 3 2 0 3 4 5 2 0 3 5 5 3 3 3 0 0 1 3 5 0 0 0 0 0 3 2 2 2 5 2 3 2 0 2 0 0 5 5 2 2 3 0 2 0 3 3 0 3 5 3 0 0 0 0 0 0 2 3 2 2 2 5 3 3 3 0 2 5 3 2 2 1 2 0 2 2 3 2 2 1 5 2 5 5 2 3 3 3 2 2 3 1 2 5 2 2 4 3 1 2 2 5 2 0 2 2 5 0 2 2 2 2 2 2 2 1 3 2 0 3 3 3 0 3 3 0 4 0 0 3 2 3 3 0 3 0 0 4 0 3 3 0 3 3 3 3 3 4 0 0 3 3 0 3 3 3 0 4 3 0 0] Elapsed time: 0.03349184989929199 graph_id used : 80080 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20779464,20779470,20779469,20779468,20779471,20779475,20779473,20779474,20779476,20779481,20779478,20779479,20779480?tags=environnement,pet_clair,pet_fonce,carton,refus,pehd,metal,film_plastique,autre,papier,mal_croppe,tetrapak,flou&datou_id_consolidate=4235&port_consolidate=20779169&tree_id=80080 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 1 /20779169Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014333486557006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.44153904914856 time spend to save output : 0.014702558517456055 total time spend for step 9 : 14.456241607666016 step10:send_mail_cod Mon Feb 24 18:23:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf 20779451 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207794511740417818 20779450 imagette207794501740417819 20779449 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207794491740417819 20779452 imagette207794521740417820 20779456 imagette207794561740417820 20779454 change filename to text .change filename to text .imagette207794541740417820 20779455 imagette207794551740417820 20779457 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207794571740417820 20779462 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207794621740417821 20779459 imagette207794591740417823 20779460 imagette207794601740417823 20779461 imagette207794611740417823 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20779169 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20779464,20779470,20779469,20779468,20779471,20779475,20779473,20779474,20779476,20779481,20779478,20779479,20779480?tags=environnement,pet_clair,pet_fonce,carton,refus,pehd,metal,film_plastique,autre,papier,mal_croppe,tetrapak,flou&datou_id_consolidate=4235&port_consolidate=20779169&tree_id=80080 your option no_mail is active, we will not send the real mail to your client args[1339366765] : ((1339366765, -7.217932158030192, 492609224), (1339366765, -0.683863846772641, 501862349), '0.19892543137470436') We are sending mail with results at cod@fotonower.com args[1339366762] : ((1339366762, -7.212570166418106, 492609224), (1339366762, -0.684396518711512, 501862349), '0.19892543137470436') We are sending mail with results at cod@fotonower.com args[1339366754] : ((1339366754, -7.207532480994312, 492609224), (1339366754, -0.677737833950181, 501862349), '0.19892543137470436') We are sending mail with results at cod@fotonower.com args[1339366752] : ((1339366752, -7.34280756581889, 492609224), (1339366752, -0.40495358614344934, 496442774), '0.19892543137470436') We are sending mail with results at cod@fotonower.com refus_total : 0.19892543137470436 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20779169 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20779169','results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf','pdf','','0.16','0.19892543137470436') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012862443923950195 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.247018098831177 time spend to save output : 0.01306915283203125 total time spend for step 10 : 5.260087251663208 step11:split_time_score Mon Feb 24 18:23:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24022025 20779169 Nombre de photos uploadées : 4 / 23040 (0%) 24022025 20779169 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 24022025 20779169 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ???? elapsed_time : fill_and_build_computed_from_old_data 0.0003154277801513672 elapsed_time : insert_dashboard_record_day_entry 0.026895523071289062 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12315286692610344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20767926_24-02-2025_10_46_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20767926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20767926 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769927 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769928 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769929 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769956 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769957 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769958 order by id desc limit 1 Qualite : 0.1833836220520911 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20769983_24-02-2025_11_54_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20769983 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20769985 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770547 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770549 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770550 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770551 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770553 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770554 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770555 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770556 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20770557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771585 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771590 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771593 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771595 order by id desc limit 1 Qualite : 0.24013689870139143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771596_24-02-2025_12_48_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771596 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771596 AND mptpi.`type`=4230 To do Qualite : 0.21094636630514205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771597_24-02-2025_12_33_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771597 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771597 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771917 order by id desc limit 1 Qualite : 0.2472142555454651 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771918_24-02-2025_15_49_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771918 AND mptpi.`type`=4230 To do Qualite : 0.2654924659269221 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771919_24-02-2025_14_50_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771919 AND mptpi.`type`=4230 To do Qualite : 0.24347313754946903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771920_24-02-2025_13_48_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771920 AND mptpi.`type`=4230 To do Qualite : 0.25477322572762684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20771921_24-02-2025_13_42_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20771921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20771921 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774301 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774302 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774303 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774304 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774305 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774306 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774307 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774308 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774309 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774310 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774311 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774312 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774313 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774314 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774807 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774808 order by id desc limit 1 Qualite : 0.22512550723363015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774809_24-02-2025_16_32_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774809 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774809 AND mptpi.`type`=4230 To do Qualite : 0.2676980827896467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20774811_24-02-2025_16_17_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20774811 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20774811 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776130 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776132 order by id desc limit 1 Qualite : 0.2740202887306019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776134_24-02-2025_17_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776134 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776137 order by id desc limit 1 Qualite : 0.15452677325102562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20776139_24-02-2025_16_50_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20776139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20776139 AND mptpi.`type`=4230 To do Qualite : 0.26795604366198006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20778556_24-02-2025_17_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20778556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20778556 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779166 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779167 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779168 order by id desc limit 1 Qualite : 0.19892543137470436 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779169_24-02-2025_18_23_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779169 AND mptpi.`type`=4230 To do Qualite : 0.22153100249252605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20779170_24-02-2025_18_17_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20779170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20779170 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24022025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1339366765, 1339366762, 1339366754, 1339366752] Looping around the photos to save general results len do output : 1 /20779169Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366765', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366762', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366754', None, None, None, None, None, '2610485') ('4234', None, None, None, None, None, None, None, '2610485') ('4234', '20779169', '1339366752', None, None, None, None, None, '2610485') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014527082443237305 save_final save missing photos in datou_result : time spend for datou_step_exec : 46.102344274520874 time spend to save output : 0.014713525772094727 total time spend for step 11 : 46.11705780029297 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 48.07user 33.72system 4:04.24elapsed 33%CPU (0avgtext+0avgdata 2390492maxresident)k 704464inputs+16456outputs (230major+2561415minor)pagefaults 0swaps