python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1302450 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 7>5 please execute split_portfolio.py -i 21064408 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2637956'] with mtr_portfolio_ids : ['21064408'] and first list_photo_ids : [] new path : /proc/1302450/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.24257659912109375 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Mar 5 14:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7037 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-05 14:20:33.091488: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-05 14:20:33.115280: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-05 14:20:33.117592: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb7e8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-05 14:20:33.117651: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-05 14:20:33.122406: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-05 14:20:33.269512: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xc632ec0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-05 14:20:33.269553: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-05 14:20:33.270311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 14:20:33.270628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 14:20:33.272724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 14:20:33.274715: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 14:20:33.275082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 14:20:33.277413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 14:20:33.278655: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 14:20:33.283446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 14:20:33.284963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 14:20:33.285037: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 14:20:33.285852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 14:20:33.285870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 14:20:33.285880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 14:20:33.287359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6472 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-05 14:20:33.593168: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 14:20:33.593339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 14:20:33.593379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 14:20:33.593413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 14:20:33.593447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 14:20:33.593481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 14:20:33.593548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 14:20:33.593582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 14:20:33.595218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 14:20:33.596511: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 14:20:33.596610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 14:20:33.596643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 14:20:33.596670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 14:20:33.596694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 14:20:33.596720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 14:20:33.596746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 14:20:33.596775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 14:20:33.598172: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 14:20:33.598210: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 14:20:33.598220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 14:20:33.598228: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 14:20:33.599378: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6472 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-05 14:20:41.482424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 14:20:41.675349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.33281 max: 149.91641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0006227493286132812 length of segment : 35 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0006501674652099609 length of segment : 49 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 34 time to create 1 rle with old method : 0.00011539459228515625 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.03984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 2549 time to create 1 rle with old method : 0.003080606460571289 length of segment : 109 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003788471221923828 length of segment : 35 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 3816 time to create 1 rle with old method : 0.005101203918457031 length of segment : 57 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0018737316131591797 length of segment : 37 time for calcul the mask position with numpy : 0.0001246929168701172 nb_pixel_total : 3538 time to create 1 rle with old method : 0.004628181457519531 length of segment : 53 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 3220 time to create 1 rle with old method : 0.004045009613037109 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -92.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 2060 time to create 1 rle with old method : 0.0031909942626953125 length of segment : 30 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.80938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.0001277923583984375 nb_pixel_total : 5340 time to create 1 rle with old method : 0.006719350814819336 length of segment : 83 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0008771419525146484 length of segment : 35 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1534 time to create 1 rle with old method : 0.002070903778076172 length of segment : 69 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00019073486328125 length of segment : 11 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008184909820556641 length of segment : 30 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 5782 time to create 1 rle with old method : 0.0071794986724853516 length of segment : 92 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.65859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.001188516616821289 length of segment : 18 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0026085376739501953 length of segment : 132 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0011031627655029297 length of segment : 29 time for calcul the mask position with numpy : 0.001203775405883789 nb_pixel_total : 53657 time to create 1 rle with old method : 0.08127379417419434 length of segment : 268 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 176.00000 molded_images shape: (1, 640, 640, 3) min: -97.24297 max: 56.58828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -114.55938 max: 126.73281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 1156 time to create 1 rle with old method : 0.002218484878540039 length of segment : 35 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.001470804214477539 length of segment : 44 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 11 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 9217 time to create 1 rle with old method : 0.017652511596679688 length of segment : 145 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 6067 time to create 1 rle with old method : 0.011236906051635742 length of segment : 70 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 836 time to create 1 rle with old method : 0.0017001628875732422 length of segment : 19 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.0005397796630859375 length of segment : 15 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 5678 time to create 1 rle with old method : 0.010561704635620117 length of segment : 59 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0004067420959472656 length of segment : 12 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0003428459167480469 length of segment : 11 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00020122528076171875 length of segment : 9 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0011408329010009766 length of segment : 28 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 9 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002605915069580078 length of segment : 24 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007016658782958984 length of segment : 20 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0019490718841552734 length of segment : 37 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.000469207763671875 length of segment : 17 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0011181831359863281 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.0001361370086669922 nb_pixel_total : 1596 time to create 1 rle with old method : 0.0022826194763183594 length of segment : 111 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1929 time to create 1 rle with old method : 0.0025801658630371094 length of segment : 36 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0008006095886230469 length of segment : 21 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1293 time to create 1 rle with old method : 0.0017306804656982422 length of segment : 41 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00048351287841796875 length of segment : 33 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 2634 time to create 1 rle with old method : 0.0052263736724853516 length of segment : 112 time for calcul the mask position with numpy : 0.0005643367767333984 nb_pixel_total : 30457 time to create 1 rle with old method : 0.036690473556518555 length of segment : 244 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 2005 time to create 1 rle with old method : 0.0027227401733398438 length of segment : 66 time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 20188 time to create 1 rle with old method : 0.02404046058654785 length of segment : 262 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0014138221740722656 length of segment : 84 time for calcul the mask position with numpy : 0.00036787986755371094 nb_pixel_total : 9782 time to create 1 rle with old method : 0.011688232421875 length of segment : 252 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0022554397583007812 length of segment : 31 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007834434509277344 length of segment : 56 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 684 time to create 1 rle with old method : 0.0010371208190917969 length of segment : 33 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006659030914306641 length of segment : 43 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 2872 time to create 1 rle with old method : 0.003557920455932617 length of segment : 172 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00033473968505859375 length of segment : 31 time for calcul the mask position with numpy : 0.00017547607421875 nb_pixel_total : 4340 time to create 1 rle with old method : 0.005094766616821289 length of segment : 214 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 3632 time to create 1 rle with old method : 0.004344940185546875 length of segment : 202 Processing 1 images image shape: (280, 400, 3) min: 6.00000 max: 170.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 40.47891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 105577 time to create 1 rle with old method : 0.14443039894104004 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.35781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.001519918441772461 length of segment : 27 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 571 time to create 1 rle with old method : 0.0010499954223632812 length of segment : 32 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0016074180603027344 length of segment : 43 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0006089210510253906 length of segment : 24 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0014646053314208984 length of segment : 47 time for calcul the mask position with numpy : 0.0007774829864501953 nb_pixel_total : 36689 time to create 1 rle with old method : 0.04571223258972168 length of segment : 259 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 33 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 22 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 6 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.25234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 62 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 33 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 17 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0007297992706298828 length of segment : 17 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007121562957763672 length of segment : 28 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.000545501708984375 length of segment : 37 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005729198455810547 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001785755157470703 length of segment : 11 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011718273162841797 length of segment : 44 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00020384788513183594 length of segment : 17 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002129077911376953 length of segment : 16 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003800392150878906 length of segment : 21 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 18 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008580684661865234 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00019860267639160156 length of segment : 9 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0006685256958007812 length of segment : 44 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0007004737854003906 length of segment : 34 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006546974182128906 length of segment : 19 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016570091247558594 length of segment : 14 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002598762512207031 length of segment : 14 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002486705780029297 length of segment : 11 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004336833953857422 length of segment : 26 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007712841033935547 length of segment : 36 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 1507 time to create 1 rle with old method : 0.001932382583618164 length of segment : 51 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0006015300750732422 length of segment : 22 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 18 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00033020973205566406 length of segment : 27 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00040221214294433594 length of segment : 15 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0013151168823242188 length of segment : 48 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 29 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.00011897087097167969 length of segment : 7 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005664825439453125 length of segment : 36 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 56 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 16 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 35 time to create 1 rle with old method : 0.00010943412780761719 length of segment : 7 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0003199577331542969 length of segment : 17 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 1465 time to create 1 rle with old method : 0.0026526451110839844 length of segment : 48 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003600120544433594 length of segment : 11 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 27 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.000213623046875 length of segment : 12 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002551078796386719 length of segment : 22 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001964569091796875 length of segment : 8 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018215179443359375 length of segment : 13 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 20 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005915164947509766 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.000171661376953125 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002849102020263672 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 10 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00021767616271972656 length of segment : 9 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.630752563476562e-05 length of segment : 13 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00014066696166992188 length of segment : 12 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006818771362304688 length of segment : 27 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005443096160888672 length of segment : 23 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007164478302001953 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 19 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00014472007751464844 length of segment : 8 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005106925964355469 length of segment : 52 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005738735198974609 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00025773048400878906 length of segment : 16 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00034546852111816406 length of segment : 56 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 36 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.00098419189453125 length of segment : 42 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003192424774169922 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2138 time to create 1 rle with old method : 0.002731800079345703 length of segment : 84 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 2069 time to create 1 rle with old method : 0.0026051998138427734 length of segment : 103 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0018889904022216797 length of segment : 119 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 26 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.00048470497131347656 length of segment : 29 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 34375 time to create 1 rle with old method : 0.043102264404296875 length of segment : 257 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.20391 max: 149.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0004177093505859375 length of segment : 39 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008182525634765625 length of segment : 64 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 26 time to create 1 rle with old method : 6.151199340820312e-05 length of segment : 9 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 24 time to create 1 rle with old method : 7.176399230957031e-05 length of segment : 7 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.15703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3837 time to create 1 rle with old method : 0.004980564117431641 length of segment : 57 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1803 time to create 1 rle with old method : 0.0022737979888916016 length of segment : 36 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004603862762451172 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.80547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 2094 time to create 1 rle with old method : 0.002721548080444336 length of segment : 43 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0005786418914794922 length of segment : 25 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0033936500549316406 length of segment : 45 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 32 time to create 1 rle with old method : 0.000194549560546875 length of segment : 3 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0009591579437255859 length of segment : 30 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0008792877197265625 length of segment : 24 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 6907 time to create 1 rle with old method : 0.01304483413696289 length of segment : 116 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 7280 time to create 1 rle with old method : 0.013824462890625 length of segment : 111 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0012969970703125 length of segment : 27 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0006422996520996094 length of segment : 23 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0013704299926757812 length of segment : 53 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0009305477142333984 length of segment : 20 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005705356597900391 length of segment : 25 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 43 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0002498626708984375 length of segment : 18 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 534 time to create 1 rle with old method : 0.0007340908050537109 length of segment : 40 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1607 time to create 1 rle with old method : 0.0018813610076904297 length of segment : 142 time for calcul the mask position with numpy : 0.0006787776947021484 nb_pixel_total : 55296 time to create 1 rle with old method : 0.0677177906036377 length of segment : 289 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 166.00000 molded_images shape: (1, 640, 640, 3) min: -101.30547 max: 45.39531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 235.00000 molded_images shape: (1, 640, 640, 3) min: -118.95391 max: 109.86953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1168 time to create 1 rle with old method : 0.00156402587890625 length of segment : 37 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006608963012695312 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.001009225845336914 length of segment : 48 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003056526184082031 length of segment : 16 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 15590 time to create 1 rle with old method : 0.0207061767578125 length of segment : 260 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00017547607421875 length of segment : 11 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 417 time to create 1 rle with old method : 0.0005986690521240234 length of segment : 25 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006070137023925781 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.46953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 8 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003662109375 length of segment : 16 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 6482 time to create 1 rle with old method : 0.009333610534667969 length of segment : 71 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 7412 time to create 1 rle with old method : 0.009300947189331055 length of segment : 72 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007812976837158203 length of segment : 29 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0015017986297607422 length of segment : 23 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002841949462890625 length of segment : 22 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 853 time to create 1 rle with old method : 0.0010547637939453125 length of segment : 56 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007977485656738281 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 11 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 10 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 21 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00022721290588378906 length of segment : 13 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003223419189453125 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1877 time to create 1 rle with old method : 0.0024023056030273438 length of segment : 119 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 10 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0011835098266601562 length of segment : 27 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1181 time to create 1 rle with old method : 0.0017540454864501953 length of segment : 41 time for calcul the mask position with numpy : 0.00048279762268066406 nb_pixel_total : 30267 time to create 1 rle with old method : 0.03498339653015137 length of segment : 196 time for calcul the mask position with numpy : 0.00029277801513671875 nb_pixel_total : 5914 time to create 1 rle with old method : 0.007177591323852539 length of segment : 241 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1709 time to create 1 rle with old method : 0.0023179054260253906 length of segment : 43 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1921 time to create 1 rle with old method : 0.0024199485778808594 length of segment : 52 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0009086132049560547 length of segment : 23 time for calcul the mask position with numpy : 0.0004601478576660156 nb_pixel_total : 28964 time to create 1 rle with old method : 0.033350467681884766 length of segment : 165 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003571510314941406 length of segment : 35 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 2406 time to create 1 rle with old method : 0.0028810501098632812 length of segment : 84 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 22129 time to create 1 rle with old method : 0.0342860221862793 length of segment : 310 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004661083221435547 length of segment : 33 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0014948844909667969 length of segment : 97 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 2021 time to create 1 rle with old method : 0.002647876739501953 length of segment : 43 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0020301342010498047 length of segment : 109 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003211498260498047 length of segment : 23 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1420 time to create 1 rle with old method : 0.001783132553100586 length of segment : 40 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006756782531738281 length of segment : 50 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006890296936035156 length of segment : 39 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004856586456298828 length of segment : 29 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 2200 time to create 1 rle with old method : 0.002901315689086914 length of segment : 159 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004956722259521484 length of segment : 37 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 4482 time to create 1 rle with old method : 0.005525112152099609 length of segment : 222 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 3808 time to create 1 rle with old method : 0.004662752151489258 length of segment : 199 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 34.27578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010342597961425781 nb_pixel_total : 105787 time to create 1 rle with old method : 0.13000822067260742 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.00078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 774 time to create 1 rle with old method : 0.0014541149139404297 length of segment : 27 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 608 time to create 1 rle with old method : 0.0011022090911865234 length of segment : 35 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 2544 time to create 1 rle with old method : 0.004563808441162109 length of segment : 54 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0016093254089355469 length of segment : 39 time for calcul the mask position with numpy : 0.0001976490020751953 nb_pixel_total : 8198 time to create 1 rle with old method : 0.011547088623046875 length of segment : 222 time for calcul the mask position with numpy : 0.0004999637603759766 nb_pixel_total : 41679 time to create 1 rle with old method : 0.048027992248535156 length of segment : 261 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00038623809814453125 length of segment : 34 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 783 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 79 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00013947486877441406 length of segment : 6 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0009632110595703125 length of segment : 42 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00036716461181640625 length of segment : 20 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004589557647705078 length of segment : 31 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0002658367156982422 length of segment : 23 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00024056434631347656 length of segment : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 842 time to create 1 rle with old method : 0.0010933876037597656 length of segment : 47 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 40 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 15 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002505779266357422 length of segment : 33 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007140636444091797 length of segment : 35 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005750656127929688 length of segment : 38 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.000621795654296875 length of segment : 18 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018835067749023438 length of segment : 12 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006301403045654297 length of segment : 38 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005869865417480469 length of segment : 28 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0011823177337646484 length of segment : 42 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005800724029541016 length of segment : 23 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.000736236572265625 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 17 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001804828643798828 length of segment : 15 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004911422729492188 length of segment : 31 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002474784851074219 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001385211944580078 length of segment : 12 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00021886825561523438 length of segment : 13 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 19 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004222393035888672 length of segment : 16 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0016770362854003906 length of segment : 48 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 19 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00013399124145507812 length of segment : 9 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011146068572998047 length of segment : 57 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.000156402587890625 length of segment : 10 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.00047326087951660156 length of segment : 35 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00023293495178222656 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 26 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 44 time to create 1 rle with old method : 9.1552734375e-05 length of segment : 7 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00022220611572265625 length of segment : 13 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003695487976074219 length of segment : 38 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003018379211425781 length of segment : 18 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.00017571449279785156 length of segment : 8 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002586841583251953 length of segment : 19 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010528564453125 length of segment : 39 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007643699645996094 length of segment : 36 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003833770751953125 length of segment : 19 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 21 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 45 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00020003318786621094 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002734661102294922 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.77578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0033130645751953125 length of segment : 97 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 2062 time to create 1 rle with old method : 0.003966808319091797 length of segment : 92 time for calcul the mask position with numpy : 0.0003273487091064453 nb_pixel_total : 1052 time to create 1 rle with old method : 0.002095937728881836 length of segment : 83 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 686 time to create 1 rle with old method : 0.0014312267303466797 length of segment : 75 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0005905628204345703 length of segment : 29 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.0013239383697509766 length of segment : 116 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 38275 time to create 1 rle with old method : 0.05397915840148926 length of segment : 275 Detection mask done ! Trying to reset tf kernel 1303598 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 11 tf kernel not reseted sub process len(results) : 273 len(list_Values) 273 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 273 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5300 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 273 chid ids of type : 4228 Number RLEs to save : 14351 save missing photos in datou_result : time spend for datou_step_exec : 24.809454917907715 time spend to save output : 1.3033390045166016 total time spend for step 1 : 26.112793922424316 step2:brightness Wed Mar 5 14:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741180830_1302450_1341011060_62668a1d39e3043d0677a559c32866eb.jpg treat image : temp/1741180830_1302450_1341011055_52a726dbfc60c1e034fe0ea0af8fc307.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.012456417083740234 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.012231826782226562 save missing photos in datou_result : time spend for datou_step_exec : 0.6211755275726318 time spend to save output : 0.029147624969482422 total time spend for step 2 : 0.6503231525421143 step3:blur_detection Wed Mar 5 14:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741180830_1302450_1341011060_62668a1d39e3043d0677a559c32866eb.jpg resize: (1080, 1920) 1341011060 -7.430566466997633 treat image : temp/1741180830_1302450_1341011055_52a726dbfc60c1e034fe0ea0af8fc307.jpg resize: (1080, 1920) 1341011055 -7.410886639672483 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011543750762939453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01094961166381836 save missing photos in datou_result : time spend for datou_step_exec : 1.8845515251159668 time spend to save output : 0.02704477310180664 total time spend for step 3 : 1.9115962982177734 step4:rle_unique_nms_with_priority Wed Mar 5 14:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 273 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 134 nb_hashtags : 6 time to prepare the origin masks : 1.2843618392944336 time for calcul the mask position with numpy : 0.30672764778137207 nb_pixel_total : 1708587 time to create 1 rle with new method : 0.2165234088897705 time for calcul the mask position with numpy : 0.008692741394042969 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003437995910644531 time for calcul the mask position with numpy : 0.008700370788574219 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004093647003173828 time for calcul the mask position with numpy : 0.008681058883666992 nb_pixel_total : 302 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.008805274963378906 nb_pixel_total : 3816 time to create 1 rle with old method : 0.004664421081542969 time for calcul the mask position with numpy : 0.00920867919921875 nb_pixel_total : 53657 time to create 1 rle with old method : 0.06042957305908203 time for calcul the mask position with numpy : 0.008608341217041016 nb_pixel_total : 120 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.010092496871948242 nb_pixel_total : 34 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.011144399642944336 nb_pixel_total : 1534 time to create 1 rle with old method : 0.0028104782104492188 time for calcul the mask position with numpy : 0.011286735534667969 nb_pixel_total : 77 time to create 1 rle with old method : 0.00018858909606933594 time for calcul the mask position with numpy : 0.013285636901855469 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0030264854431152344 time for calcul the mask position with numpy : 0.011203765869140625 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0017254352569580078 time for calcul the mask position with numpy : 0.008614540100097656 nb_pixel_total : 2549 time to create 1 rle with old method : 0.0030028820037841797 time for calcul the mask position with numpy : 0.00857996940612793 nb_pixel_total : 171 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.00857686996459961 nb_pixel_total : 657 time to create 1 rle with old method : 0.0007846355438232422 time for calcul the mask position with numpy : 0.008547782897949219 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006110668182373047 time for calcul the mask position with numpy : 0.008741617202758789 nb_pixel_total : 2060 time to create 1 rle with old method : 0.0025255680084228516 time for calcul the mask position with numpy : 0.008477926254272461 nb_pixel_total : 5340 time to create 1 rle with old method : 0.006208181381225586 time for calcul the mask position with numpy : 0.008595943450927734 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009336471557617188 time for calcul the mask position with numpy : 0.008592844009399414 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006201267242431641 time for calcul the mask position with numpy : 0.00866389274597168 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006401538848876953 time for calcul the mask position with numpy : 0.008731842041015625 nb_pixel_total : 2634 time to create 1 rle with old method : 0.0030045509338378906 time for calcul the mask position with numpy : 0.008751869201660156 nb_pixel_total : 1929 time to create 1 rle with old method : 0.0022339820861816406 time for calcul the mask position with numpy : 0.008597373962402344 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.008605003356933594 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009827613830566406 time for calcul the mask position with numpy : 0.008629560470581055 nb_pixel_total : 38 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.010900020599365234 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004432201385498047 time for calcul the mask position with numpy : 0.0085906982421875 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018596649169921875 time for calcul the mask position with numpy : 0.008586406707763672 nb_pixel_total : 1293 time to create 1 rle with old method : 0.0015804767608642578 time for calcul the mask position with numpy : 0.008805513381958008 nb_pixel_total : 9217 time to create 1 rle with old method : 0.010425090789794922 time for calcul the mask position with numpy : 0.008569002151489258 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.008520364761352539 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007231235504150391 time for calcul the mask position with numpy : 0.008790016174316406 nb_pixel_total : 6067 time to create 1 rle with old method : 0.007012844085693359 time for calcul the mask position with numpy : 0.00868678092956543 nb_pixel_total : 42 time to create 1 rle with old method : 0.0001895427703857422 time for calcul the mask position with numpy : 0.008676767349243164 nb_pixel_total : 206 time to create 1 rle with old method : 0.0002892017364501953 time for calcul the mask position with numpy : 0.00866246223449707 nb_pixel_total : 2005 time to create 1 rle with old method : 0.0022897720336914062 time for calcul the mask position with numpy : 0.008556127548217773 nb_pixel_total : 79 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.009071588516235352 nb_pixel_total : 30457 time to create 1 rle with old method : 0.03483176231384277 time for calcul the mask position with numpy : 0.008753538131713867 nb_pixel_total : 18855 time to create 1 rle with old method : 0.021058320999145508 time for calcul the mask position with numpy : 0.00865936279296875 nb_pixel_total : 684 time to create 1 rle with old method : 0.0008471012115478516 time for calcul the mask position with numpy : 0.008659839630126953 nb_pixel_total : 1485 time to create 1 rle with old method : 0.0017862319946289062 time for calcul the mask position with numpy : 0.008407831192016602 nb_pixel_total : 1598 time to create 1 rle with old method : 0.0018551349639892578 time for calcul the mask position with numpy : 0.008669614791870117 nb_pixel_total : 2872 time to create 1 rle with old method : 0.003325223922729492 time for calcul the mask position with numpy : 0.008693695068359375 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006909370422363281 time for calcul the mask position with numpy : 0.008732795715332031 nb_pixel_total : 102 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.008706808090209961 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009405612945556641 time for calcul the mask position with numpy : 0.009605646133422852 nb_pixel_total : 102 time to create 1 rle with old method : 0.00018525123596191406 time for calcul the mask position with numpy : 0.009840726852416992 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.00859975814819336 nb_pixel_total : 1596 time to create 1 rle with old method : 0.0018987655639648438 time for calcul the mask position with numpy : 0.008750438690185547 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002465248107910156 time for calcul the mask position with numpy : 0.008672237396240234 nb_pixel_total : 1156 time to create 1 rle with old method : 0.0014393329620361328 time for calcul the mask position with numpy : 0.008658885955810547 nb_pixel_total : 751 time to create 1 rle with old method : 0.0008597373962402344 time for calcul the mask position with numpy : 0.008535385131835938 nb_pixel_total : 179 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.008716106414794922 nb_pixel_total : 1330 time to create 1 rle with old method : 0.001580953598022461 time for calcul the mask position with numpy : 0.00853586196899414 nb_pixel_total : 488 time to create 1 rle with old method : 0.0006103515625 time for calcul the mask position with numpy : 0.008577108383178711 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.008724451065063477 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002536773681640625 time for calcul the mask position with numpy : 0.008836746215820312 nb_pixel_total : 134 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.009540319442749023 nb_pixel_total : 105577 time to create 1 rle with old method : 0.12003564834594727 time for calcul the mask position with numpy : 0.008239030838012695 nb_pixel_total : 77 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.009128570556640625 nb_pixel_total : 34976 time to create 1 rle with old method : 0.039275407791137695 time for calcul the mask position with numpy : 0.008741617202758789 nb_pixel_total : 394 time to create 1 rle with old method : 0.0004353523254394531 time for calcul the mask position with numpy : 0.008315801620483398 nb_pixel_total : 129 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.008281230926513672 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.008364677429199219 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001652240753173828 time for calcul the mask position with numpy : 0.008430957794189453 nb_pixel_total : 198 time to create 1 rle with old method : 0.00025463104248046875 time for calcul the mask position with numpy : 0.008360624313354492 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003209114074707031 time for calcul the mask position with numpy : 0.008530139923095703 nb_pixel_total : 492 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.008385896682739258 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002243518829345703 time for calcul the mask position with numpy : 0.008518695831298828 nb_pixel_total : 143 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.008454084396362305 nb_pixel_total : 4 time to create 1 rle with old method : 3.0517578125e-05 time for calcul the mask position with numpy : 0.008237838745117188 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009555816650390625 time for calcul the mask position with numpy : 0.008585453033447266 nb_pixel_total : 280 time to create 1 rle with old method : 0.00036716461181640625 time for calcul the mask position with numpy : 0.008774757385253906 nb_pixel_total : 34375 time to create 1 rle with old method : 0.037915945053100586 time for calcul the mask position with numpy : 0.008498191833496094 nb_pixel_total : 405 time to create 1 rle with old method : 0.00048089027404785156 time for calcul the mask position with numpy : 0.008497953414916992 nb_pixel_total : 39 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.00875234603881836 nb_pixel_total : 203 time to create 1 rle with old method : 0.00024271011352539062 time for calcul the mask position with numpy : 0.008841753005981445 nb_pixel_total : 92 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.00853872299194336 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.00818181037902832 nb_pixel_total : 117 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.008351802825927734 nb_pixel_total : 262 time to create 1 rle with old method : 0.0002932548522949219 time for calcul the mask position with numpy : 0.008392572402954102 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007688999176025391 time for calcul the mask position with numpy : 0.008728981018066406 nb_pixel_total : 329 time to create 1 rle with old method : 0.00038933753967285156 time for calcul the mask position with numpy : 0.0084686279296875 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006206035614013672 time for calcul the mask position with numpy : 0.008227109909057617 nb_pixel_total : 422 time to create 1 rle with old method : 0.00045299530029296875 time for calcul the mask position with numpy : 0.008635282516479492 nb_pixel_total : 58 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.008487224578857422 nb_pixel_total : 571 time to create 1 rle with old method : 0.0006465911865234375 time for calcul the mask position with numpy : 0.008175849914550781 nb_pixel_total : 280 time to create 1 rle with old method : 0.00032329559326171875 time for calcul the mask position with numpy : 0.008243799209594727 nb_pixel_total : 520 time to create 1 rle with old method : 0.0005958080291748047 time for calcul the mask position with numpy : 0.008011341094970703 nb_pixel_total : 81 time to create 1 rle with old method : 9.202957153320312e-05 time for calcul the mask position with numpy : 0.008167505264282227 nb_pixel_total : 154 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.008346080780029297 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.008157968521118164 nb_pixel_total : 1465 time to create 1 rle with old method : 0.0016057491302490234 time for calcul the mask position with numpy : 0.008159160614013672 nb_pixel_total : 797 time to create 1 rle with old method : 0.0009100437164306641 time for calcul the mask position with numpy : 0.008143424987792969 nb_pixel_total : 296 time to create 1 rle with old method : 0.00030732154846191406 time for calcul the mask position with numpy : 0.007915496826171875 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.008132457733154297 nb_pixel_total : 1507 time to create 1 rle with old method : 0.0017783641815185547 time for calcul the mask position with numpy : 0.008140087127685547 nb_pixel_total : 428 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.008178949356079102 nb_pixel_total : 137 time to create 1 rle with old method : 0.00022673606872558594 time for calcul the mask position with numpy : 0.008307933807373047 nb_pixel_total : 221 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.008546829223632812 nb_pixel_total : 3 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.0086517333984375 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004279613494873047 time for calcul the mask position with numpy : 0.008426427841186523 nb_pixel_total : 9 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.00847935676574707 nb_pixel_total : 417 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.008087158203125 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.008456230163574219 nb_pixel_total : 888 time to create 1 rle with old method : 0.00107574462890625 time for calcul the mask position with numpy : 0.008558511734008789 nb_pixel_total : 35 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.008447647094726562 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.007942438125610352 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005424022674560547 time for calcul the mask position with numpy : 0.007972240447998047 nb_pixel_total : 338 time to create 1 rle with old method : 0.00036406517028808594 time for calcul the mask position with numpy : 0.008190631866455078 nb_pixel_total : 2138 time to create 1 rle with old method : 0.002377748489379883 time for calcul the mask position with numpy : 0.008111953735351562 nb_pixel_total : 206 time to create 1 rle with old method : 0.000240325927734375 time for calcul the mask position with numpy : 0.008230447769165039 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.00841832160949707 nb_pixel_total : 896 time to create 1 rle with old method : 0.0010180473327636719 time for calcul the mask position with numpy : 0.008452415466308594 nb_pixel_total : 2 time to create 1 rle with old method : 1.5497207641601562e-05 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.008196830749511719 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001723766326904297 time for calcul the mask position with numpy : 0.008408546447753906 nb_pixel_total : 37 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.00803685188293457 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.008351802825927734 nb_pixel_total : 235 time to create 1 rle with old method : 0.00026416778564453125 time for calcul the mask position with numpy : 0.008393526077270508 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.008479833602905273 nb_pixel_total : 1000 time to create 1 rle with old method : 0.0011446475982666016 time for calcul the mask position with numpy : 0.008556604385375977 nb_pixel_total : 40 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.008445501327514648 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.008361339569091797 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005726814270019531 time for calcul the mask position with numpy : 0.008456707000732422 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.008559465408325195 nb_pixel_total : 118 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.008494377136230469 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.008538007736206055 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004611015319824219 time for calcul the mask position with numpy : 0.008413553237915039 nb_pixel_total : 44 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.008432865142822266 nb_pixel_total : 70 time to create 1 rle with old method : 9.870529174804688e-05 time for calcul the mask position with numpy : 0.008396148681640625 nb_pixel_total : 64 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.008392572402954102 nb_pixel_total : 341 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.0085906982421875 nb_pixel_total : 305 time to create 1 rle with old method : 0.0007433891296386719 time for calcul the mask position with numpy : 0.008623600006103516 nb_pixel_total : 49 time to create 1 rle with old method : 9.179115295410156e-05 create new chi : 2.117077350616455 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.011634588241577148 batch 1 Loaded 135 chid ids of type : 4230 Number RLEs to save : 12229 TO DO : save crop sub photo not yet done ! save time : 0.7436263561248779 nb_obj : 135 nb_hashtags : 7 time to prepare the origin masks : 2.8706295490264893 time for calcul the mask position with numpy : 0.06257128715515137 nb_pixel_total : 1680300 time to create 1 rle with new method : 0.22633624076843262 time for calcul the mask position with numpy : 0.011434078216552734 nb_pixel_total : 54839 time to create 1 rle with old method : 0.07258725166320801 time for calcul the mask position with numpy : 0.013307571411132812 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004782676696777344 time for calcul the mask position with numpy : 0.012119531631469727 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007739067077636719 time for calcul the mask position with numpy : 0.011638402938842773 nb_pixel_total : 17 time to create 1 rle with old method : 8.678436279296875e-05 time for calcul the mask position with numpy : 0.009681463241577148 nb_pixel_total : 281 time to create 1 rle with old method : 0.00045800209045410156 time for calcul the mask position with numpy : 0.008464574813842773 nb_pixel_total : 3837 time to create 1 rle with old method : 0.0047190189361572266 time for calcul the mask position with numpy : 0.00890207290649414 nb_pixel_total : 26 time to create 1 rle with old method : 8.034706115722656e-05 time for calcul the mask position with numpy : 0.008705854415893555 nb_pixel_total : 9 time to create 1 rle with old method : 6.532669067382812e-05 time for calcul the mask position with numpy : 0.009226322174072266 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008881092071533203 time for calcul the mask position with numpy : 0.014681816101074219 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0019690990447998047 time for calcul the mask position with numpy : 0.011858224868774414 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.010087966918945312 nb_pixel_total : 1803 time to create 1 rle with old method : 0.0023288726806640625 time for calcul the mask position with numpy : 0.01394033432006836 nb_pixel_total : 1607 time to create 1 rle with old method : 0.0023949146270751953 time for calcul the mask position with numpy : 0.01155996322631836 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005872249603271484 time for calcul the mask position with numpy : 0.010087966918945312 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003917217254638672 time for calcul the mask position with numpy : 0.011023521423339844 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006644725799560547 time for calcul the mask position with numpy : 0.009978532791137695 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005409717559814453 time for calcul the mask position with numpy : 0.008960962295532227 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005795955657958984 time for calcul the mask position with numpy : 0.012351274490356445 nb_pixel_total : 4 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.012015581130981445 nb_pixel_total : 2094 time to create 1 rle with old method : 0.0025370121002197266 time for calcul the mask position with numpy : 0.01271820068359375 nb_pixel_total : 534 time to create 1 rle with old method : 0.0007343292236328125 time for calcul the mask position with numpy : 0.012768268585205078 nb_pixel_total : 141 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.012560367584228516 nb_pixel_total : 757 time to create 1 rle with old method : 0.0016298294067382812 time for calcul the mask position with numpy : 0.013820171356201172 nb_pixel_total : 6907 time to create 1 rle with old method : 0.010356426239013672 time for calcul the mask position with numpy : 0.012299537658691406 nb_pixel_total : 392 time to create 1 rle with old method : 0.0006415843963623047 time for calcul the mask position with numpy : 0.014058589935302734 nb_pixel_total : 582 time to create 1 rle with old method : 0.0009243488311767578 time for calcul the mask position with numpy : 0.011171340942382812 nb_pixel_total : 2406 time to create 1 rle with old method : 0.0036814212799072266 time for calcul the mask position with numpy : 0.009696245193481445 nb_pixel_total : 378 time to create 1 rle with old method : 0.0006246566772460938 time for calcul the mask position with numpy : 0.01038050651550293 nb_pixel_total : 8 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.011507034301757812 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003864765167236328 time for calcul the mask position with numpy : 0.011893749237060547 nb_pixel_total : 108 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.010256767272949219 nb_pixel_total : 1660 time to create 1 rle with old method : 0.001909494400024414 time for calcul the mask position with numpy : 0.006144285202026367 nb_pixel_total : 841 time to create 1 rle with old method : 0.0010256767272949219 time for calcul the mask position with numpy : 0.006103038787841797 nb_pixel_total : 294 time to create 1 rle with old method : 0.00042366981506347656 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 56 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.0061798095703125 nb_pixel_total : 152 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.006231784820556641 nb_pixel_total : 14422 time to create 1 rle with old method : 0.01609182357788086 time for calcul the mask position with numpy : 0.007929801940917969 nb_pixel_total : 6482 time to create 1 rle with old method : 0.007349967956542969 time for calcul the mask position with numpy : 0.007814168930053711 nb_pixel_total : 1181 time to create 1 rle with old method : 0.0018548965454101562 time for calcul the mask position with numpy : 0.008274555206298828 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.00878453254699707 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007104873657226562 time for calcul the mask position with numpy : 0.00786280632019043 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003261566162109375 time for calcul the mask position with numpy : 0.007936716079711914 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0016341209411621094 time for calcul the mask position with numpy : 0.008875370025634766 nb_pixel_total : 15393 time to create 1 rle with old method : 0.02153468132019043 time for calcul the mask position with numpy : 0.010497570037841797 nb_pixel_total : 36 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.007906913757324219 nb_pixel_total : 1214 time to create 1 rle with old method : 0.0014209747314453125 time for calcul the mask position with numpy : 0.007740497589111328 nb_pixel_total : 5910 time to create 1 rle with old method : 0.006807088851928711 time for calcul the mask position with numpy : 0.007293701171875 nb_pixel_total : 1420 time to create 1 rle with old method : 0.0016376972198486328 time for calcul the mask position with numpy : 0.00738072395324707 nb_pixel_total : 30178 time to create 1 rle with old method : 0.0343632698059082 time for calcul the mask position with numpy : 0.007115602493286133 nb_pixel_total : 150 time to create 1 rle with old method : 0.00029206275939941406 time for calcul the mask position with numpy : 0.008286476135253906 nb_pixel_total : 2411 time to create 1 rle with old method : 0.0035092830657958984 time for calcul the mask position with numpy : 0.006922721862792969 nb_pixel_total : 2200 time to create 1 rle with old method : 0.002490520477294922 time for calcul the mask position with numpy : 0.006518363952636719 nb_pixel_total : 1910 time to create 1 rle with old method : 0.0023894309997558594 time for calcul the mask position with numpy : 0.006459712982177734 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010991096496582031 time for calcul the mask position with numpy : 0.006931304931640625 nb_pixel_total : 326 time to create 1 rle with old method : 0.00040030479431152344 time for calcul the mask position with numpy : 0.006389617919921875 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.007019996643066406 nb_pixel_total : 750 time to create 1 rle with old method : 0.0008652210235595703 time for calcul the mask position with numpy : 0.007658481597900391 nb_pixel_total : 104 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.00762176513671875 nb_pixel_total : 1877 time to create 1 rle with old method : 0.0021626949310302734 time for calcul the mask position with numpy : 0.00756525993347168 nb_pixel_total : 18 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.007447719573974609 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.0073394775390625 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.007761240005493164 nb_pixel_total : 1168 time to create 1 rle with old method : 0.0013818740844726562 time for calcul the mask position with numpy : 0.0075495243072509766 nb_pixel_total : 807 time to create 1 rle with old method : 0.0009305477142333984 time for calcul the mask position with numpy : 0.00741124153137207 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006933212280273438 time for calcul the mask position with numpy : 0.0074994564056396484 nb_pixel_total : 476 time to create 1 rle with old method : 0.0005550384521484375 time for calcul the mask position with numpy : 0.007389545440673828 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.007508039474487305 nb_pixel_total : 123 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.007688760757446289 nb_pixel_total : 202 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.007716178894042969 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002613067626953125 time for calcul the mask position with numpy : 0.007872343063354492 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007326602935791016 time for calcul the mask position with numpy : 0.0075953006744384766 nb_pixel_total : 550 time to create 1 rle with old method : 0.0006697177886962891 time for calcul the mask position with numpy : 0.007790565490722656 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.007570743560791016 nb_pixel_total : 94 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.008349180221557617 nb_pixel_total : 105787 time to create 1 rle with old method : 0.12065339088439941 time for calcul the mask position with numpy : 0.006552696228027344 nb_pixel_total : 37753 time to create 1 rle with old method : 0.043670654296875 time for calcul the mask position with numpy : 0.00667119026184082 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.006276845932006836 nb_pixel_total : 348 time to create 1 rle with old method : 0.000438690185546875 time for calcul the mask position with numpy : 0.006319522857666016 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003452301025390625 time for calcul the mask position with numpy : 0.0063457489013671875 nb_pixel_total : 679 time to create 1 rle with old method : 0.0008311271667480469 time for calcul the mask position with numpy : 0.00706934928894043 nb_pixel_total : 148 time to create 1 rle with old method : 0.00019598007202148438 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 202 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.0063571929931640625 nb_pixel_total : 129 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.006656646728515625 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018024444580078125 time for calcul the mask position with numpy : 0.006195545196533203 nb_pixel_total : 40 time to create 1 rle with old method : 9.393692016601562e-05 time for calcul the mask position with numpy : 0.00627899169921875 nb_pixel_total : 862 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.006479978561401367 nb_pixel_total : 277 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.006160736083984375 nb_pixel_total : 248 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.0062236785888671875 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005099773406982422 time for calcul the mask position with numpy : 0.006349086761474609 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003228187561035156 time for calcul the mask position with numpy : 0.006574153900146484 nb_pixel_total : 82 time to create 1 rle with old method : 0.00016498565673828125 time for calcul the mask position with numpy : 0.0065157413482666016 nb_pixel_total : 44 time to create 1 rle with old method : 9.5367431640625e-05 time for calcul the mask position with numpy : 0.00722503662109375 nb_pixel_total : 38275 time to create 1 rle with old method : 0.05328869819641113 time for calcul the mask position with numpy : 0.006516456604003906 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.006886959075927734 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006475448608398438 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006010532379150391 time for calcul the mask position with numpy : 0.007915019989013672 nb_pixel_total : 879 time to create 1 rle with old method : 0.0010178089141845703 time for calcul the mask position with numpy : 0.0064280033111572266 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004100799560546875 time for calcul the mask position with numpy : 0.006981611251831055 nb_pixel_total : 608 time to create 1 rle with old method : 0.0009677410125732422 time for calcul the mask position with numpy : 0.0077478885650634766 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.007673025131225586 nb_pixel_total : 74 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.007925033569335938 nb_pixel_total : 8198 time to create 1 rle with old method : 0.009794235229492188 time for calcul the mask position with numpy : 0.006746768951416016 nb_pixel_total : 2544 time to create 1 rle with old method : 0.002900838851928711 time for calcul the mask position with numpy : 0.006810188293457031 nb_pixel_total : 99 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.006709098815917969 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.0065462589263916016 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010895729064941406 time for calcul the mask position with numpy : 0.007566928863525391 nb_pixel_total : 774 time to create 1 rle with old method : 0.0011496543884277344 time for calcul the mask position with numpy : 0.006399869918823242 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003218650817871094 time for calcul the mask position with numpy : 0.0067598819732666016 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.006297111511230469 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0015306472778320312 time for calcul the mask position with numpy : 0.006623744964599609 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007600784301757812 time for calcul the mask position with numpy : 0.006202220916748047 nb_pixel_total : 1052 time to create 1 rle with old method : 0.0012390613555908203 time for calcul the mask position with numpy : 0.00629878044128418 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003209114074707031 time for calcul the mask position with numpy : 0.0062673091888427734 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004665851593017578 time for calcul the mask position with numpy : 0.0063745975494384766 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.006334543228149414 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003046989440917969 time for calcul the mask position with numpy : 0.006433248519897461 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008251667022705078 time for calcul the mask position with numpy : 0.006351470947265625 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0019412040710449219 time for calcul the mask position with numpy : 0.0063323974609375 nb_pixel_total : 188 time to create 1 rle with old method : 0.00028443336486816406 time for calcul the mask position with numpy : 0.006728649139404297 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007340908050537109 time for calcul the mask position with numpy : 0.006490230560302734 nb_pixel_total : 928 time to create 1 rle with old method : 0.001058816909790039 time for calcul the mask position with numpy : 0.00637054443359375 nb_pixel_total : 39 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.006373405456542969 nb_pixel_total : 114 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.006579399108886719 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001862049102783203 time for calcul the mask position with numpy : 0.006725788116455078 nb_pixel_total : 103 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.006590843200683594 nb_pixel_total : 44 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.0067596435546875 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.00656890869140625 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005729198455810547 time for calcul the mask position with numpy : 0.0066525936126708984 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.006745338439941406 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003142356872558594 time for calcul the mask position with numpy : 0.006594657897949219 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.006464242935180664 nb_pixel_total : 415 time to create 1 rle with old method : 0.00049591064453125 time for calcul the mask position with numpy : 0.006784915924072266 nb_pixel_total : 47 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.00853586196899414 nb_pixel_total : 177 time to create 1 rle with old method : 0.00021719932556152344 time for calcul the mask position with numpy : 0.008521795272827148 nb_pixel_total : 59 time to create 1 rle with old method : 9.107589721679688e-05 create new chi : 1.8790435791015625 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0025560855865478516 batch 1 Loaded 136 chid ids of type : 4230 Number RLEs to save : 14034 TO DO : save crop sub photo not yet done ! save time : 0.916841983795166 map_output_result : {1341011060: (0.0, 'Should be the crop_list due to order', 0.0), 1341011055: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 2 /1341011060.Didn't retrieve data . /1341011055.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015042304992675781 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.306756734848022 time spend to save output : 0.015323877334594727 total time spend for step 4 : 10.322080612182617 step5:crop_condition Wed Mar 5 14:21:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 271 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 91 About to insert : list_path_to_insert length 91 new photo from crops ! About to upload 91 photos upload in portfolio : 4869462 init cache_photo without model_param we have 91 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741180871_1302450 we have uploaded 91 photos in the portfolio 4869462 time of upload the photos Elapsed time : 43.98625087738037 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 4869462 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741180916_1302450 we have uploaded 49 photos in the portfolio 4869462 time of upload the photos Elapsed time : 14.40599274635315 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741180931_1302450 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7455277442932129 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 4869462 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741180932_1302450 we have uploaded 21 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.186144828796387 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741180939_1302450 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.08219599723816 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 189 /1341026357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341026593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 569 time used for this insertion : 0.03856945037841797 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.67630052566528 time spend to save output : 0.06381726264953613 total time spend for step 5 : 77.74011778831482 step6:thcl Wed Mar 5 14:22:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.012521982192993164 time to convert the images to numpy array : 0.051941871643066406 time to import caffe and check if the image exist : 0.016210079193115234 time to convert the images to numpy array : 0.04991960525512695 time to import caffe and check if the image exist : 0.022331953048706055 time to convert the images to numpy array : 0.04900646209716797 time to import caffe and check if the image exist : 0.007491588592529297 time to convert the images to numpy array : 0.0647726058959961 time to import caffe and check if the image exist : 0.01749110221862793 time to convert the images to numpy array : 0.054268598556518555 time to import caffe and check if the image exist : 0.018841266632080078 time to convert the images to numpy array : 0.05523538589477539 time to import caffe and check if the image exist : 0.012482404708862305 time to convert the images to numpy array : 0.06305432319641113 time to import caffe and check if the image exist : 0.019500255584716797 time to convert the images to numpy array : 0.057543039321899414 time to import caffe and check if the image exist : 0.01521444320678711 time to convert the images to numpy array : 0.06263875961303711 time to import caffe and check if the image exist : 0.013129234313964844 time to convert the images to numpy array : 0.06737303733825684 total time to convert the images to numpy array : 0.30572509765625 list photo_ids error: [] list photo_ids correct : [1341026420, 1341026421, 1341026423, 1341026424, 1341026425, 1341026426, 1341026427, 1341026428, 1341026429, 1341026430, 1341026431, 1341026432, 1341026433, 1341026434, 1341026435, 1341026436, 1341026437, 1341026438, 1341026440, 1341026507, 1341026508, 1341026509, 1341026510, 1341026511, 1341026512, 1341026513, 1341026514, 1341026515, 1341026516, 1341026517, 1341026518, 1341026519, 1341026520, 1341026521, 1341026522, 1341026523, 1341026524, 1341026525, 1341026379, 1341026381, 1341026382, 1341026383, 1341026384, 1341026385, 1341026386, 1341026387, 1341026388, 1341026389, 1341026390, 1341026392, 1341026393, 1341026394, 1341026395, 1341026396, 1341026397, 1341026398, 1341026399, 1341026357, 1341026358, 1341026359, 1341026360, 1341026361, 1341026363, 1341026364, 1341026365, 1341026366, 1341026367, 1341026368, 1341026369, 1341026370, 1341026371, 1341026373, 1341026374, 1341026375, 1341026376, 1341026378, 1341026488, 1341026489, 1341026490, 1341026491, 1341026492, 1341026493, 1341026494, 1341026495, 1341026496, 1341026497, 1341026498, 1341026499, 1341026500, 1341026501, 1341026502, 1341026503, 1341026504, 1341026505, 1341026506, 1341026550, 1341026551, 1341026552, 1341026553, 1341026554, 1341026555, 1341026556, 1341026557, 1341026558, 1341026559, 1341026561, 1341026568, 1341026569, 1341026570, 1341026571, 1341026572, 1341026573, 1341026574, 1341026575, 1341026576, 1341026577, 1341026578, 1341026579, 1341026580, 1341026581, 1341026582, 1341026583, 1341026584, 1341026585, 1341026586, 1341026587, 1341026588, 1341026589, 1341026590, 1341026591, 1341026592, 1341026593, 1341026526, 1341026527, 1341026528, 1341026529, 1341026530, 1341026531, 1341026532, 1341026535, 1341026536, 1341026539, 1341026540, 1341026541, 1341026542, 1341026543, 1341026544, 1341026545, 1341026547, 1341026548, 1341026549, 1341026441, 1341026442, 1341026443, 1341026444, 1341026445, 1341026446, 1341026447, 1341026448, 1341026449, 1341026450, 1341026451, 1341026452, 1341026453, 1341026454, 1341026455, 1341026484, 1341026485, 1341026486, 1341026487, 1341026400, 1341026401, 1341026402, 1341026403, 1341026404, 1341026405, 1341026406, 1341026407, 1341026408, 1341026409, 1341026410, 1341026411, 1341026412, 1341026413, 1341026414, 1341026415, 1341026416, 1341026418, 1341026419] number of photos to traite : 189 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10374 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.9610433578491211 time used to do the prediction : 0.8911440372467041 save descriptor for thcl : 3237 time to traite the descriptors : 1.3417444229125977 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341026420 To insert : 1341026421 To insert : 1341026423 To insert : 1341026424 To insert : 1341026425 To insert : 1341026426 To insert : 1341026427 To insert : 1341026428 To insert : 1341026429 To insert : 1341026430 To insert : 1341026431 To insert : 1341026432 To insert : 1341026433 To insert : 1341026434 To insert : 1341026435 To insert : 1341026436 To insert : 1341026437 To insert : 1341026438 To insert : 1341026440 To insert : 1341026507 To insert : 1341026508 To insert : 1341026509 To insert : 1341026510 To insert : 1341026511 To insert : 1341026512 To insert : 1341026513 To insert : 1341026514 To insert : 1341026515 To insert : 1341026516 To insert : 1341026517 To insert : 1341026518 To insert : 1341026519 To insert : 1341026520 To insert : 1341026521 To insert : 1341026522 To insert : 1341026523 To insert : 1341026524 To insert : 1341026525 To insert : 1341026379 To insert : 1341026381 To insert : 1341026382 To insert : 1341026383 To insert : 1341026384 To insert : 1341026385 To insert : 1341026386 To insert : 1341026387 To insert : 1341026388 To insert : 1341026389 To insert : 1341026390 To insert : 1341026392 To insert : 1341026393 To insert : 1341026394 To insert : 1341026395 To insert : 1341026396 To insert : 1341026397 To insert : 1341026398 To insert : 1341026399 To insert : 1341026357 To insert : 1341026358 To insert : 1341026359 To insert : 1341026360 To insert : 1341026361 To insert : 1341026363 To insert : 1341026364 To insert : 1341026365 To insert : 1341026366 To insert : 1341026367 To insert : 1341026368 To insert : 1341026369 To insert : 1341026370 To insert : 1341026371 To insert : 1341026373 To insert : 1341026374 To insert : 1341026375 To insert : 1341026376 To insert : 1341026378 To insert : 1341026488 To insert : 1341026489 To insert : 1341026490 To insert : 1341026491 To insert : 1341026492 To insert : 1341026493 To insert : 1341026494 To insert : 1341026495 To insert : 1341026496 To insert : 1341026497 To insert : 1341026498 To insert : 1341026499 To insert : 1341026500 To insert : 1341026501 To insert : 1341026502 To insert : 1341026503 To insert : 1341026504 To insert : 1341026505 To insert : 1341026506 To insert : 1341026550 To insert : 1341026551 To insert : 1341026552 To insert : 1341026553 To insert : 1341026554 To insert : 1341026555 To insert : 1341026556 To insert : 1341026557 To insert : 1341026558 To insert : 1341026559 To insert : 1341026561 To insert : 1341026568 To insert : 1341026569 To insert : 1341026570 To insert : 1341026571 To insert : 1341026572 To insert : 1341026573 To insert : 1341026574 To insert : 1341026575 To insert : 1341026576 To insert : 1341026577 To insert : 1341026578 To insert : 1341026579 To insert : 1341026580 To insert : 1341026581 To insert : 1341026582 To insert : 1341026583 To insert : 1341026584 To insert : 1341026585 To insert : 1341026586 To insert : 1341026587 To insert : 1341026588 To insert : 1341026589 To insert : 1341026590 To insert : 1341026591 To insert : 1341026592 To insert : 1341026593 To insert : 1341026526 To insert : 1341026527 To insert : 1341026528 To insert : 1341026529 To insert : 1341026530 To insert : 1341026531 To insert : 1341026532 To insert : 1341026535 To insert : 1341026536 To insert : 1341026539 To insert : 1341026540 To insert : 1341026541 To insert : 1341026542 To insert : 1341026543 To insert : 1341026544 To insert : 1341026545 To insert : 1341026547 To insert : 1341026548 To insert : 1341026549 To insert : 1341026441 To insert : 1341026442 To insert : 1341026443 To insert : 1341026444 To insert : 1341026445 To insert : 1341026446 To insert : 1341026447 To insert : 1341026448 To insert : 1341026449 To insert : 1341026450 To insert : 1341026451 To insert : 1341026452 To insert : 1341026453 To insert : 1341026454 To insert : 1341026455 To insert : 1341026484 To insert : 1341026485 To insert : 1341026486 To insert : 1341026487 To insert : 1341026400 To insert : 1341026401 To insert : 1341026402 To insert : 1341026403 To insert : 1341026404 To insert : 1341026405 To insert : 1341026406 To insert : 1341026407 To insert : 1341026408 To insert : 1341026409 To insert : 1341026410 To insert : 1341026411 To insert : 1341026412 To insert : 1341026413 To insert : 1341026414 To insert : 1341026415 To insert : 1341026416 To insert : 1341026418 To insert : 1341026419 time to insert the descriptors : 79.61063981056213 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 293 time used for this insertion : 0.023653745651245117 save missing photos in datou_result : time spend for datou_step_exec : 87.19082117080688 time spend to save output : 0.07576990127563477 total time spend for step 6 : 87.26659107208252 step7:ventilate_hashtags_in_portfolio Wed Mar 5 14:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21064408 get user id for portfolio 21064408 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21064408 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','Film_plastique','autre','PEHD','PET_clair','Carton','refus','mal_croppe','PET_fonce','pet_fonce','carton','metal','flou','Papier','pehd','pet_clair','Tetrapak')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21064408 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','Film_plastique','autre','PEHD','PET_clair','Carton','refus','mal_croppe','PET_fonce','pet_fonce','carton','metal','flou','Papier','pehd','pet_clair','Tetrapak')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21065057,21065042,21065050,21065044,21065045,21065046,21065049,21065048,21065051,21065055,21065053,21065056,21065058?tags=pet_clair,refus,pet_fonce,mal_croppe,flou,metal,pehd,film_plastique,tetrapak,carton,autre,papier,environnement&datou_id_consolidate=4235&port_consolidate=21064408 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 1 /21064408. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.011902809143066406 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6204817295074463 time spend to save output : 0.012148618698120117 total time spend for step 7 : 1.6326303482055664 step8:final Wed Mar 5 14:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341011060: ('0.28172099630599395',), 1341011055: ('0.28172099630599395',)} new output for save of step final : {1341011060: ('0.28172099630599395',), 1341011055: ('0.28172099630599395',)} [1341011060, 1341011055] Looping around the photos to save general results len do output : 2 /1341011060.Didn't retrieve data . /1341011055.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011693000793457031 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12002921104431152 time spend to save output : 0.011893749237060547 total time spend for step 8 : 0.13192296028137207 step9:velours_tree Wed Mar 5 14:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21065057,21065042,21065050,21065044,21065045,21065046,21065049,21065048,21065051,21065055,21065053,21065056,21065058 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065057 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065042 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065050 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065044 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065045 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065046 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065049 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065048 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065051 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065055 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065053 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065056 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21065058 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 609 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 0 3 3 0 0 3 0 5 0 5 3 2 3 1 1 2 1 3 0 1 1 1 3 2 1 2 1 1 1 5 0 2 2 1 5 0 0 0 5 2 2 1 2 0 2 2 2 2 0 0 0 3 3 5 0 0 0 3 0 3 0 5 0 3 1 1 3 1 1 2 1 1 5 0 1 0 0 0 5 2 2 1 2 0 2 2 2 0 0 0 3 5 0 2 0 2 0 0 3 0 3 0 5 0 5 2 3 1 1 1 3 3 2 0 3 2 1 2 1 1 5 0 1 1 5 0 0 5 2 2 2 0 2 2 2 0 2 0 0 3 3 5 0 3 3 0 3 5 0 3 2 3 1 1 1 5 3 3 1 1 2 1 2 1 1 5 0 2 1 0 2 2 2 0 2 2 2 0 0 0 3 0 3 3 0 0 5 0 0 5 3 3 1 1 1 3 1 1 1 2 1 1 1 0 2 5 0 5 5 2 2 1 5 2 0 2 2 2 0 0 0 3 0 3 2 3 1 0 1 2 3 1 4 2 1 2 1 2 5 5 5 5 5 2 3 1 1 2 3 0 4 1 1 2 2 5 5 1 0 5 5 2 2 1 1 2 3 1 3 4 2 1 1 2 2 5 5 5 5 0 2 1 1 2 3 1 1 4 2 1 2 1 1 2 2 5 0 0 0 5 5 3 5 2 5 1 2 1 2 1 1 3 4 1 1 0 1 2 2 5 1 0 0 0 5 1 3 0 0 2 0 2 0 0 0 0 2 0 2 0 0 2 0 0 0 2 3 0 0 5 2 1 2 1 0 0 5 2 0 0 0 5 0 0 0 5 0 1 1 5 2 0 5 2 1 0 0 0 0 5 0 0 5 1 5 0 0 5 1 2 1 0 0 0 0 5 0 0 2 0 5 1 1 0 0 0 5 0 5 5 0 0 0 5 1 0 0 0 5 5 3 3 3 3 0 5 0 5 3 1 1 1 3 1 3 1 1 1 1 2 1 1 5 0 2 2 2 1 5 2 0 5 2 2 2 1 2 2 2 2 2 0 0 0 3 5 0 3 3 0 3 5 0 5 3 3 2 1 1 3 0 3 1 2 1 2 1 2 1 1 0 0 5 2 2 2 0 2 2 2 2 0 0 2 0 0 0 0 3 3 2 2 1 5 2 1 2 1 1 1 4 2 2 1 2 0 1 2 2 5 5 0 5 3 3 0 2 1 3 1 2 1 2 3 1 5 4 1 1 1 2 2 5 0 0 5 3 3 5 0 0 0 2 2 5 5 0 0 0 2 0 0 3 3 0 2 2 5 0 0 2 0 0 5 2 0 2 2 0 5 1 1 0 0 0 0 0 0 5 2 2 0 0 1 2 0 0 0] Elapsed time: 0.23010993003845215 graph_id used : 81565 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21065057,21065042,21065050,21065044,21065045,21065046,21065049,21065048,21065051,21065055,21065053,21065056,21065058?tags=pet_clair,refus,pet_fonce,mal_croppe,flou,metal,pehd,film_plastique,tetrapak,carton,autre,papier,environnement&datou_id_consolidate=4235&port_consolidate=21064408&tree_id=81565 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 1 /21064408Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.011790990829467773 save_final save missing photos in datou_result : time spend for datou_step_exec : 66.32531642913818 time spend to save output : 0.012261629104614258 total time spend for step 9 : 66.3375780582428 step10:send_mail_cod Wed Mar 5 14:25:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf 21065039 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210650391741181102 21065024 imagette210650241741181103 21065032 imagette210650321741181103 21065026 imagette210650261741181103 21065027 imagette210650271741181103 21065028 change filename to text .change filename to text .change filename to text .imagette210650281741181103 21065031 imagette210650311741181103 21065030 imagette210650301741181103 21065033 imagette210650331741181103 21065037 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210650371741181103 21065035 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210650351741181105 21065038 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210650381741181107 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21064408 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21065057,21065042,21065050,21065044,21065045,21065046,21065049,21065048,21065051,21065055,21065053,21065056,21065058?tags=pet_clair,refus,pet_fonce,mal_croppe,flou,metal,pehd,film_plastique,tetrapak,carton,autre,papier,environnement&datou_id_consolidate=4235&port_consolidate=21064408&tree_id=81565 your option no_mail is active, we will not send the real mail to your client args[1341011060] : ((1341011060, -7.430566466997633, 492609224), (1341011060, -0.4993669141586599, 501862349), '0.28172099630599395') We are sending mail with results at cod@fotonower.com args[1341011055] : ((1341011055, -7.410886639672483, 492609224), (1341011055, -0.47220465085596053, 496442774), '0.28172099630599395') We are sending mail with results at cod@fotonower.com refus_total : 0.28172099630599395 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21064408 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21064408','results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf','pdf','','0.16','0.28172099630599395') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012020111083984375 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.896951913833618 time spend to save output : 0.01219797134399414 total time spend for step 10 : 6.909149885177612 step11:split_time_score Wed Mar 5 14:25:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05032025 21064408 Nombre de photos uploadées : 7 / 23040 (0%) 05032025 21064408 Nombre de photos taguées (types de déchets): 7 / 7 (100%) 05032025 21064408 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0006284713745117188 elapsed_time : insert_dashboard_record_day_entry 0.02306079864501953 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2117995964934903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21058682_05-03-2025_11_24_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21058682 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21058682 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21060336 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21060337 order by id desc limit 1 Qualite : 0.22149324968961573 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21060339_05-03-2025_12_34_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21060339 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21060339 AND mptpi.`type`=4230 To do Qualite : 0.22102507300372576 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21060340_05-03-2025_11_47_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21060340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21060340 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21063282 order by id desc limit 1 Qualite : 0.2554765588104601 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21063283_05-03-2025_12_36_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21063283 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21063283 AND mptpi.`type`=4230 To do Qualite : 0.25375216037072906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21063284_05-03-2025_12_50_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21063284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21063284 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21063285 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064393 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064395 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064399 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064401 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064404 order by id desc limit 1 Qualite : 0.26979787373791964 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21064406_05-03-2025_13_36_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064406 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21064406 AND mptpi.`type`=4230 To do Qualite : 0.2715017404146662 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21064408_05-03-2025_14_25_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21064408 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21064408 AND mptpi.`type`=4230 To do Qualite : 0.26181248586867645 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21065177_05-03-2025_14_21_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21065177 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21065177 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05032025': {'nb_upload': 7, 'nb_taggue_class': 7, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341011060, 1341011055] Looping around the photos to save general results len do output : 1 /21064408Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011060', None, None, None, None, None, '2637956') ('4234', None, None, None, None, None, None, None, '2637956') ('4234', None, '1341011055', None, None, None, None, None, '2637956') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01218414306640625 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.430969476699829 time spend to save output : 0.012408018112182617 total time spend for step 11 : 8.443377494812012 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 39.57user 23.73system 4:51.30elapsed 21%CPU (0avgtext+0avgdata 2668408maxresident)k 713752inputs+18000outputs (1156major+2479326minor)pagefaults 0swaps