python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1796960 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 10>5 please execute split_portfolio.py -i 20370953 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2569664'] with mtr_portfolio_ids : ['20370953'] and first list_photo_ids : [] new path : /proc/1796960/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.6639001369476318 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sun Feb 9 04:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-09 04:20:31.647657: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-09 04:20:31.675044: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-09 04:20:31.677054: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7feb04000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-09 04:20:31.677098: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-09 04:20:31.681117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-09 04:20:31.962353: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3aa9f660 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-09 04:20:31.962397: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-09 04:20:31.963751: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-09 04:20:31.964137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-09 04:20:31.966962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-09 04:20:31.969457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-09 04:20:31.969917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-09 04:20:31.972670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-09 04:20:31.973661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-09 04:20:31.977445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-09 04:20:31.978910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-09 04:20:31.978973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-09 04:20:31.979753: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-09 04:20:31.979768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-09 04:20:31.979777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-09 04:20:31.981105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-09 04:20:32.273126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-09 04:20:32.273218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-09 04:20:32.273245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-09 04:20:32.273270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-09 04:20:32.273294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-09 04:20:32.273317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-09 04:20:32.273341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-09 04:20:32.273364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-09 04:20:32.275542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-09 04:20:32.277136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-09 04:20:32.277166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-09 04:20:32.277182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-09 04:20:32.277196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-09 04:20:32.277210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-09 04:20:32.277225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-09 04:20:32.277238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-09 04:20:32.277252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-09 04:20:32.278468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-09 04:20:32.278500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-09 04:20:32.278509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-09 04:20:32.278516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-09 04:20:32.279895: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-09 04:20:39.681588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-09 04:20:39.887807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.63750 max: 145.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0008141994476318359 length of segment : 28 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.006428241729736328 length of segment : 38 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0018317699432373047 length of segment : 35 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 861 time to create 1 rle with old method : 0.0011513233184814453 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.82109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.0002465248107910156 nb_pixel_total : 10241 time to create 1 rle with old method : 0.011800765991210938 length of segment : 396 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00025200843811035156 length of segment : 21 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 41 time to create 1 rle with old method : 7.915496826171875e-05 length of segment : 6 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007216930389404297 length of segment : 28 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2577 time to create 1 rle with old method : 0.003083944320678711 length of segment : 52 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 2910 time to create 1 rle with old method : 0.003396749496459961 length of segment : 53 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0012803077697753906 length of segment : 42 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 2441 time to create 1 rle with old method : 0.0027337074279785156 length of segment : 45 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.87188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 6247 time to create 1 rle with old method : 0.008014440536499023 length of segment : 125 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.00072479248046875 length of segment : 15 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 3955 time to create 1 rle with old method : 0.004716157913208008 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.07500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00040411949157714844 nb_pixel_total : 29906 time to create 1 rle with old method : 0.03312802314758301 length of segment : 331 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002999305725097656 length of segment : 21 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.000957489013671875 length of segment : 50 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 21 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 12 time for calcul the mask position with numpy : 0.0006110668182373047 nb_pixel_total : 56414 time to create 1 rle with old method : 0.06235337257385254 length of segment : 294 Processing 1 images image shape: (400, 400, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -74.59453 max: 139.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001291513442993164 nb_pixel_total : 153410 time to create 1 rle with new method : 0.002114534378051758 length of segment : 402 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.98906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003666877746582031 length of segment : 22 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006461143493652344 length of segment : 25 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004923343658447266 length of segment : 25 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.001268625259399414 length of segment : 41 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.001096963882446289 length of segment : 29 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 12 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1478 time to create 1 rle with old method : 0.002304553985595703 length of segment : 42 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 8 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0003612041473388672 length of segment : 17 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.001132965087890625 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.37969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 19 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0004374980926513672 length of segment : 20 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0019435882568359375 length of segment : 68 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002167224884033203 length of segment : 12 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0006823539733886719 length of segment : 40 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006453990936279297 length of segment : 21 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 19 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003917217254638672 length of segment : 19 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.00092315673828125 length of segment : 30 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0016689300537109375 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.25859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1983 time to create 1 rle with old method : 0.002414703369140625 length of segment : 140 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001392364501953125 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 35 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 658 time to create 1 rle with old method : 0.0011670589447021484 length of segment : 60 time for calcul the mask position with numpy : 0.0008497238159179688 nb_pixel_total : 76186 time to create 1 rle with old method : 0.08323907852172852 length of segment : 351 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 738 time to create 1 rle with old method : 0.0009248256683349609 length of segment : 41 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.0009074211120605469 length of segment : 32 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 75298 time to create 1 rle with old method : 0.08205533027648926 length of segment : 457 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 120.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 36 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 1490 time to create 1 rle with old method : 0.001806020736694336 length of segment : 121 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.00046563148498535156 length of segment : 45 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1519 time to create 1 rle with old method : 0.001903533935546875 length of segment : 138 time for calcul the mask position with numpy : 0.000171661376953125 nb_pixel_total : 4681 time to create 1 rle with old method : 0.005361318588256836 length of segment : 266 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 4102 time to create 1 rle with old method : 0.004893064498901367 length of segment : 224 Processing 1 images image shape: (280, 400, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008924007415771484 nb_pixel_total : 105149 time to create 1 rle with old method : 0.11385869979858398 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.57656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003571510314941406 length of segment : 19 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0011146068572998047 length of segment : 31 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014271736145019531 length of segment : 57 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 8620 time to create 1 rle with old method : 0.01027989387512207 length of segment : 84 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00032830238342285156 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004792213439941406 length of segment : 44 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.00036025047302246094 length of segment : 14 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0016374588012695312 length of segment : 45 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002846717834472656 length of segment : 18 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 42 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0007224082946777344 length of segment : 19 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008988380432128906 length of segment : 24 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 24 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0008084774017333984 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007143020629882812 length of segment : 39 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014543533325195312 length of segment : 13 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00017642974853515625 length of segment : 10 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00035691261291503906 length of segment : 15 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 17 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.000186920166015625 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00022292137145996094 length of segment : 14 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 18 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004107952117919922 length of segment : 51 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.00019860267639160156 length of segment : 13 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00028443336486816406 length of segment : 24 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004324913024902344 length of segment : 32 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.00045228004455566406 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0004973411560058594 length of segment : 33 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0024361610412597656 length of segment : 51 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0007197856903076172 length of segment : 29 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0022058486938476562 length of segment : 24 time for calcul the mask position with numpy : 0.0004878044128417969 nb_pixel_total : 41419 time to create 1 rle with old method : 0.043730974197387695 length of segment : 244 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008411407470703125 length of segment : 50 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0017554759979248047 length of segment : 67 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.32500 max: 145.30703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00038909912109375 length of segment : 29 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 985 time to create 1 rle with old method : 0.0019130706787109375 length of segment : 36 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0009388923645019531 length of segment : 27 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 917 time to create 1 rle with old method : 0.002167224884033203 length of segment : 38 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1981 time to create 1 rle with old method : 0.0026657581329345703 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.81719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00037980079650878906 length of segment : 25 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 884 time to create 1 rle with old method : 0.0011899471282958984 length of segment : 40 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 2611 time to create 1 rle with old method : 0.0034613609313964844 length of segment : 55 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 37 time to create 1 rle with old method : 7.891654968261719e-05 length of segment : 6 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 2889 time to create 1 rle with old method : 0.0033257007598876953 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.17656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1404 time to create 1 rle with old method : 0.0021576881408691406 length of segment : 26 length of segment : 0 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0006580352783203125 length of segment : 13 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00029778480529785156 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.95781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004794597625732422 nb_pixel_total : 26437 time to create 1 rle with old method : 0.030686378479003906 length of segment : 304 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.40469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002186298370361328 length of segment : 12 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 3538 time to create 1 rle with old method : 0.004716157913208008 length of segment : 67 time for calcul the mask position with numpy : 0.000568389892578125 nb_pixel_total : 50974 time to create 1 rle with old method : 0.056371212005615234 length of segment : 278 Processing 1 images image shape: (400, 400, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -75.55938 max: 142.60391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013964176177978516 nb_pixel_total : 153992 time to create 1 rle with new method : 0.0022013187408447266 length of segment : 406 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.29766 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0006225109100341797 length of segment : 21 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0013697147369384766 length of segment : 31 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0012350082397460938 length of segment : 45 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00017976760864257812 length of segment : 8 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006818771362304688 length of segment : 51 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0003058910369873047 length of segment : 11 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00023245811462402344 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.84844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00027251243591308594 length of segment : 13 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0007307529449462891 length of segment : 37 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0020837783813476562 length of segment : 69 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020694732666015625 length of segment : 11 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00034999847412109375 length of segment : 20 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0014989376068115234 length of segment : 51 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009658336639404297 length of segment : 36 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0014357566833496094 length of segment : 29 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.001346588134765625 length of segment : 24 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.000965118408203125 length of segment : 29 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0017616748809814453 length of segment : 42 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1720 time to create 1 rle with old method : 0.0022749900817871094 length of segment : 67 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0011053085327148438 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0017235279083251953 length of segment : 147 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00015091896057128906 length of segment : 23 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0010325908660888672 length of segment : 38 time for calcul the mask position with numpy : 0.0009832382202148438 nb_pixel_total : 79095 time to create 1 rle with old method : 0.08924651145935059 length of segment : 416 time for calcul the mask position with numpy : 0.0007238388061523438 nb_pixel_total : 54603 time to create 1 rle with old method : 0.06609439849853516 length of segment : 338 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 101.34219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.000705718994140625 length of segment : 47 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 1606 time to create 1 rle with old method : 0.0019617080688476562 length of segment : 137 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1613 time to create 1 rle with old method : 0.001984119415283203 length of segment : 80 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0008478164672851562 length of segment : 63 time for calcul the mask position with numpy : 0.0001971721649169922 nb_pixel_total : 4127 time to create 1 rle with old method : 0.0051212310791015625 length of segment : 223 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007255077362060547 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009253025054931641 nb_pixel_total : 103486 time to create 1 rle with old method : 0.12420487403869629 length of segment : 288 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 8110 time to create 1 rle with old method : 0.009119987487792969 length of segment : 83 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 901 time to create 1 rle with old method : 0.0011203289031982422 length of segment : 32 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 19 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0010459423065185547 length of segment : 42 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020837783813476562 length of segment : 22 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002880096435546875 length of segment : 20 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008001327514648438 length of segment : 24 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 16 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005273818969726562 length of segment : 30 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00036787986755371094 length of segment : 35 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1127 time to create 1 rle with old method : 0.001348257064819336 length of segment : 51 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00035643577575683594 length of segment : 22 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004918575286865234 length of segment : 43 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008230209350585938 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.63906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 33 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00020694732666015625 length of segment : 12 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 16 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009567737579345703 length of segment : 74 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.000156402587890625 length of segment : 15 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00019741058349609375 length of segment : 12 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00034236907958984375 length of segment : 15 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00028014183044433594 length of segment : 23 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003619194030761719 length of segment : 17 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00039267539978027344 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 14 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.000225067138671875 length of segment : 9 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015497207641601562 length of segment : 10 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.00048232078552246094 length of segment : 31 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.00046944618225097656 length of segment : 31 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0015978813171386719 length of segment : 65 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 27 time for calcul the mask position with numpy : 0.0005354881286621094 nb_pixel_total : 43322 time to create 1 rle with old method : 0.047896623611450195 length of segment : 283 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 15 time to create 1 rle with old method : 5.030632019042969e-05 length of segment : 3 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005772113800048828 length of segment : 30 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006465911865234375 length of segment : 31 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 16 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 34131 time to create 1 rle with old method : 0.03817391395568848 length of segment : 405 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.31328 max: 149.26016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005061626434326172 length of segment : 27 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003044605255126953 length of segment : 35 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 965 time to create 1 rle with old method : 0.0012056827545166016 length of segment : 39 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 953 time to create 1 rle with old method : 0.0012357234954833984 length of segment : 39 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 55 time to create 1 rle with old method : 8.821487426757812e-05 length of segment : 19 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 30 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1738 time to create 1 rle with old method : 0.0021772384643554688 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.78984 max: 151.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0002288818359375 length of segment : 28 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0013933181762695312 length of segment : 56 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 5662 time to create 1 rle with old method : 0.007103919982910156 length of segment : 86 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 5896 time to create 1 rle with old method : 0.0066986083984375 length of segment : 288 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 40 time to create 1 rle with old method : 7.271766662597656e-05 length of segment : 7 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001361370086669922 length of segment : 23 time for calcul the mask position with numpy : 2.5987625122070312e-05 nb_pixel_total : 40 time to create 1 rle with old method : 7.486343383789062e-05 length of segment : 6 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.15703 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 5352 time to create 1 rle with old method : 0.0060503482818603516 length of segment : 122 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 2565 time to create 1 rle with old method : 0.0031595230102539062 length of segment : 46 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.00043201446533203125 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006008148193359375 length of segment : 24 time for calcul the mask position with numpy : 0.00031566619873046875 nb_pixel_total : 22199 time to create 1 rle with old method : 0.023439407348632812 length of segment : 322 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 127.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00037360191345214844 length of segment : 22 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.000972747802734375 length of segment : 50 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0010175704956054688 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -77.23516 max: 143.63906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0015914440155029297 nb_pixel_total : 154778 time to create 1 rle with new method : 0.0024025440216064453 length of segment : 406 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.37188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.0012044906616210938 length of segment : 39 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.002212047576904297 length of segment : 52 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0021355152130126953 length of segment : 53 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 946 time to create 1 rle with old method : 0.0012803077697753906 length of segment : 41 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 19 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00018596649169921875 length of segment : 30 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00029850006103515625 length of segment : 12 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.11016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00021767616271972656 length of segment : 13 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 595 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 42 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1799 time to create 1 rle with old method : 0.0021643638610839844 length of segment : 69 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007634162902832031 length of segment : 35 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006151199340820312 length of segment : 21 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 37 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 1930 time to create 1 rle with old method : 0.002209186553955078 length of segment : 42 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007774829864501953 length of segment : 30 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00021409988403320312 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 360 time to create 1 rle with old method : 0.0004839897155761719 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.84063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0017325878143310547 length of segment : 124 time for calcul the mask position with numpy : 0.0008087158203125 nb_pixel_total : 74387 time to create 1 rle with old method : 0.08160257339477539 length of segment : 384 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 6609 time to create 1 rle with old method : 0.007875204086303711 length of segment : 389 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 223.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 97.97109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 48 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005452632904052734 length of segment : 29 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006885528564453125 length of segment : 48 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0011138916015625 length of segment : 44 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.00133514404296875 length of segment : 54 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005254745483398438 length of segment : 24 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0019505023956298828 length of segment : 84 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008265972137451172 length of segment : 64 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0012853145599365234 length of segment : 51 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 2214 time to create 1 rle with old method : 0.002618074417114258 length of segment : 156 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 1882 time to create 1 rle with old method : 0.002298116683959961 length of segment : 135 time for calcul the mask position with numpy : 0.0001971721649169922 nb_pixel_total : 3655 time to create 1 rle with old method : 0.0043222904205322266 length of segment : 193 Processing 1 images image shape: (280, 400, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009799003601074219 nb_pixel_total : 104900 time to create 1 rle with old method : 0.11444091796875 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.96719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 988 time to create 1 rle with old method : 0.0011034011840820312 length of segment : 34 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002541542053222656 length of segment : 18 time for calcul the mask position with numpy : 0.00012445449829101562 nb_pixel_total : 8161 time to create 1 rle with old method : 0.009153127670288086 length of segment : 88 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0012679100036621094 length of segment : 49 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 34 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007603168487548828 length of segment : 24 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 39 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0005404949188232422 length of segment : 10 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0010867118835449219 length of segment : 30 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00034117698669433594 length of segment : 20 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005700588226318359 length of segment : 24 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0007641315460205078 length of segment : 31 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 16 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007920265197753906 length of segment : 45 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0008344650268554688 length of segment : 32 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002961158752441406 length of segment : 15 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004658699035644531 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006926059722900391 length of segment : 36 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002071857452392578 length of segment : 12 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00017070770263671875 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.00039649009704589844 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 33 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00022459030151367188 length of segment : 17 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003750324249267578 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003311634063720703 length of segment : 14 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00025963783264160156 length of segment : 16 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001862049102783203 length of segment : 16 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021839141845703125 length of segment : 9 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018143653869628906 length of segment : 12 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022411346435546875 length of segment : 15 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.58047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1307 time to create 1 rle with old method : 0.002327442169189453 length of segment : 59 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0008573532104492188 length of segment : 29 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 25 time for calcul the mask position with numpy : 0.0005538463592529297 nb_pixel_total : 34584 time to create 1 rle with old method : 0.05594491958618164 length of segment : 221 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004489421844482422 length of segment : 29 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0020055770874023438 length of segment : 45 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 19 time to create 1 rle with old method : 7.891654968261719e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.24688 max: 149.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 24 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 906 time to create 1 rle with old method : 0.0011584758758544922 length of segment : 34 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 35 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003414154052734375 length of segment : 35 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007112026214599609 length of segment : 39 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.364418029785156e-05 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.34844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 1810 time to create 1 rle with old method : 0.0023233890533447266 length of segment : 170 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0012278556823730469 length of segment : 88 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0017514228820800781 length of segment : 41 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 2563 time to create 1 rle with old method : 0.0033669471740722656 length of segment : 40 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 38 time to create 1 rle with old method : 8.535385131835938e-05 length of segment : 7 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 804 time to create 1 rle with old method : 0.001051187515258789 length of segment : 71 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 39 time to create 1 rle with old method : 8.893013000488281e-05 length of segment : 6 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.31719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 5406 time to create 1 rle with old method : 0.007390022277832031 length of segment : 119 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.80547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0012660026550292969 length of segment : 23 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0005600452423095703 length of segment : 24 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 29161 time to create 1 rle with old method : 0.03783702850341797 length of segment : 329 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.00044846534729003906 length of segment : 22 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.0010826587677001953 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -69.66875 max: 147.05703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012500286102294922 nb_pixel_total : 154558 time to create 1 rle with new method : 0.00193023681640625 length of segment : 406 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.73906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008783340454101562 length of segment : 25 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.001153707504272461 length of segment : 42 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 10 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0010454654693603516 length of segment : 36 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.0012481212615966797 length of segment : 41 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 947 time to create 1 rle with old method : 0.0011396408081054688 length of segment : 41 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.45000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006844997406005859 length of segment : 22 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0007262229919433594 length of segment : 43 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0013270378112792969 length of segment : 62 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.000194549560546875 length of segment : 15 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 681 time to create 1 rle with old method : 0.0008394718170166016 length of segment : 29 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009987354278564453 length of segment : 17 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 726 time to create 1 rle with old method : 0.0009183883666992188 length of segment : 37 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008852481842041016 length of segment : 28 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004360675811767578 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.38359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0017864704132080078 length of segment : 131 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 9251 time to create 1 rle with old method : 0.010519266128540039 length of segment : 258 time for calcul the mask position with numpy : 0.0009186267852783203 nb_pixel_total : 77169 time to create 1 rle with old method : 0.08347964286804199 length of segment : 377 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 218.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.19766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 48 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1217 time to create 1 rle with old method : 0.0015087127685546875 length of segment : 43 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.00037598609924316406 length of segment : 29 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 47 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0019199848175048828 length of segment : 83 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004296302795410156 length of segment : 32 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 2786 time to create 1 rle with old method : 0.003306150436401367 length of segment : 177 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 4315 time to create 1 rle with old method : 0.005048036575317383 length of segment : 228 time for calcul the mask position with numpy : 0.0001800060272216797 nb_pixel_total : 3802 time to create 1 rle with old method : 0.004305601119995117 length of segment : 199 Processing 1 images image shape: (280, 400, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010962486267089844 nb_pixel_total : 106271 time to create 1 rle with old method : 0.11521291732788086 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 20 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 890 time to create 1 rle with old method : 0.0010952949523925781 length of segment : 33 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.0009467601776123047 length of segment : 43 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 9051 time to create 1 rle with old method : 0.010317325592041016 length of segment : 90 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007600784301757812 length of segment : 24 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 38 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 13 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1900 time to create 1 rle with old method : 0.002278566360473633 length of segment : 87 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002875328063964844 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.33828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006546974182128906 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016236305236816406 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 18 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 12 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 17 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0012226104736328125 length of segment : 58 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00023174285888671875 length of segment : 15 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002186298370361328 length of segment : 20 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00023508071899414062 length of segment : 19 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005319118499755859 length of segment : 34 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0008003711700439453 length of segment : 31 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 14 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00019693374633789062 length of segment : 13 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 29 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00017070770263671875 length of segment : 11 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 15 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.22109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0015342235565185547 length of segment : 66 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005097389221191406 length of segment : 27 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.00044083595275878906 length of segment : 32 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 37631 time to create 1 rle with old method : 0.04175519943237305 length of segment : 226 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.00048828125 length of segment : 30 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 15 time to create 1 rle with old method : 4.6253204345703125e-05 length of segment : 3 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0006299018859863281 length of segment : 58 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.37969 max: 145.39687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0005121231079101562 length of segment : 41 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005397796630859375 length of segment : 28 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011191368103027344 length of segment : 32 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0010943412780761719 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.94219 max: 149.67812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0016558170318603516 length of segment : 74 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 40 time to create 1 rle with old method : 7.891654968261719e-05 length of segment : 7 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006608963012695312 length of segment : 34 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006039142608642578 length of segment : 70 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002651214599609375 length of segment : 35 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001735687255859375 length of segment : 22 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 43 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 7 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 44 time to create 1 rle with old method : 8.845329284667969e-05 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.79766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 2855 time to create 1 rle with old method : 0.0035169124603271484 length of segment : 98 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3301 time to create 1 rle with old method : 0.003983020782470703 length of segment : 47 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0008473396301269531 length of segment : 46 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005996227264404297 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006504058837890625 length of segment : 14 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007665157318115234 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.00469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006139278411865234 length of segment : 22 time for calcul the mask position with numpy : 0.00044274330139160156 nb_pixel_total : 26048 time to create 1 rle with old method : 0.02906012535095215 length of segment : 310 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.62344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0004544258117675781 length of segment : 21 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0009243488311767578 length of segment : 60 Processing 1 images image shape: (400, 400, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -72.15703 max: 146.67031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012869834899902344 nb_pixel_total : 154554 time to create 1 rle with new method : 0.0019829273223876953 length of segment : 407 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0021986961364746094 length of segment : 54 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1166 time to create 1 rle with old method : 0.001438140869140625 length of segment : 35 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007338523864746094 length of segment : 26 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0020389556884765625 length of segment : 44 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 9 time for calcul the mask position with numpy : 0.0003323554992675781 nb_pixel_total : 7117 time to create 1 rle with old method : 0.009685516357421875 length of segment : 125 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0013840198516845703 length of segment : 50 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003376007080078125 length of segment : 16 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.10625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002186298370361328 length of segment : 13 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 45 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1595 time to create 1 rle with old method : 0.0018537044525146484 length of segment : 65 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00030350685119628906 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.00047707557678222656 length of segment : 28 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006527900695800781 length of segment : 22 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1176 time to create 1 rle with old method : 0.0015194416046142578 length of segment : 46 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007917881011962891 length of segment : 30 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1427 time to create 1 rle with old method : 0.001779317855834961 length of segment : 40 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003418922424316406 length of segment : 20 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.54375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 1652 time to create 1 rle with old method : 0.002026796340942383 length of segment : 130 time for calcul the mask position with numpy : 0.0007755756378173828 nb_pixel_total : 74976 time to create 1 rle with old method : 0.08177518844604492 length of segment : 387 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00019621849060058594 length of segment : 28 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 60246 time to create 1 rle with old method : 0.06194162368774414 length of segment : 334 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 233.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005896091461181641 length of segment : 47 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0016350746154785156 length of segment : 77 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.00079345703125 length of segment : 51 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 1809 time to create 1 rle with old method : 0.0021660327911376953 length of segment : 126 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 47 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009045600891113281 length of segment : 75 time for calcul the mask position with numpy : 0.00017571449279785156 nb_pixel_total : 3720 time to create 1 rle with old method : 0.004052877426147461 length of segment : 226 Processing 1 images image shape: (280, 400, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 106779 time to create 1 rle with old method : 0.1150963306427002 length of segment : 286 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.0011072158813476562 length of segment : 31 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00027370452880859375 length of segment : 19 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 8515 time to create 1 rle with old method : 0.009560108184814453 length of segment : 87 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 913 time to create 1 rle with old method : 0.0011091232299804688 length of segment : 56 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004208087921142578 length of segment : 36 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008099079132080078 length of segment : 24 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022864341735839844 length of segment : 14 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 12 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.00024390220642089844 length of segment : 18 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 31 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1792 time to create 1 rle with old method : 0.0021941661834716797 length of segment : 83 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 37 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001747608184814453 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001685619354248047 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00033211708068847656 length of segment : 15 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001614093780517578 length of segment : 11 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00019240379333496094 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004410743713378906 length of segment : 31 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 18 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005083084106445312 length of segment : 31 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.00046896934509277344 length of segment : 32 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003273487091064453 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.27969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0014717578887939453 length of segment : 48 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 29 time for calcul the mask position with numpy : 0.0005817413330078125 nb_pixel_total : 54562 time to create 1 rle with old method : 0.061653852462768555 length of segment : 259 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.000934600830078125 length of segment : 54 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 635 time to create 1 rle with old method : 0.0008280277252197266 length of segment : 66 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 17858 time to create 1 rle with old method : 0.0206756591796875 length of segment : 440 Detection mask done ! Trying to reset tf kernel 1797372 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 447 len(list_Values) 447 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 447 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 447 chid ids of type : 4228 Number RLEs to save : 28405 save missing photos in datou_result : time spend for datou_step_exec : 32.00736856460571 time spend to save output : 9.077925682067871 total time spend for step 1 : 41.085294246673584 step2:brightness Sun Feb 9 04:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739071228_1796960_1335910338_2e3ce100f77556abf7c5de51ffc24eb8.jpg treat image : temp/1739071228_1796960_1335910315_48ebf3568079b650b0178cee4d98a0cf.jpg treat image : temp/1739071228_1796960_1335910287_31b55eb404e929c66bf15536b3e315c6.jpg treat image : temp/1739071228_1796960_1335910101_a432c208d6742445bace5545a2094daf.jpg treat image : temp/1739071228_1796960_1335910091_9e4fb637990ba01fe51cf74ce0c8aa9a.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.014777660369873047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.017263412475585938 save missing photos in datou_result : time spend for datou_step_exec : 1.3113605976104736 time spend to save output : 0.03721737861633301 total time spend for step 2 : 1.3485779762268066 step3:blur_detection Sun Feb 9 04:21:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739071228_1796960_1335910338_2e3ce100f77556abf7c5de51ffc24eb8.jpg resize: (1080, 1920) 1335910338 -7.457482949071309 treat image : temp/1739071228_1796960_1335910315_48ebf3568079b650b0178cee4d98a0cf.jpg resize: (1080, 1920) 1335910315 -7.346552941832464 treat image : temp/1739071228_1796960_1335910287_31b55eb404e929c66bf15536b3e315c6.jpg resize: (1080, 1920) 1335910287 -7.319548027113676 treat image : temp/1739071228_1796960_1335910101_a432c208d6742445bace5545a2094daf.jpg resize: (1080, 1920) 1335910101 -7.3275806666965435 treat image : temp/1739071228_1796960_1335910091_9e4fb637990ba01fe51cf74ce0c8aa9a.jpg resize: (1080, 1920) 1335910091 -7.39332867268216 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.01587653160095215 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.014612674713134766 save missing photos in datou_result : time spend for datou_step_exec : 4.241750478744507 time spend to save output : 0.03514266014099121 total time spend for step 3 : 4.276893138885498 step4:rle_unique_nms_with_priority Sun Feb 9 04:21:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 447 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 93 nb_hashtags : 8 time to prepare the origin masks : 1.1780450344085693 time for calcul the mask position with numpy : 0.040257930755615234 nb_pixel_total : 1527668 time to create 1 rle with new method : 0.1497795581817627 time for calcul the mask position with numpy : 0.007988929748535156 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.007871389389038086 nb_pixel_total : 56414 time to create 1 rle with old method : 0.057331085205078125 time for calcul the mask position with numpy : 0.007815837860107422 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0010821819305419922 time for calcul the mask position with numpy : 0.007790565490722656 nb_pixel_total : 425 time to create 1 rle with old method : 0.000484466552734375 time for calcul the mask position with numpy : 0.007836341857910156 nb_pixel_total : 252 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.0076067447662353516 nb_pixel_total : 29906 time to create 1 rle with old method : 0.03090524673461914 time for calcul the mask position with numpy : 0.007658481597900391 nb_pixel_total : 34 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.007660865783691406 nb_pixel_total : 41 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.007602691650390625 nb_pixel_total : 333 time to create 1 rle with old method : 0.00039958953857421875 time for calcul the mask position with numpy : 0.007608652114868164 nb_pixel_total : 2577 time to create 1 rle with old method : 0.002722501754760742 time for calcul the mask position with numpy : 0.007650852203369141 nb_pixel_total : 4 time to create 1 rle with old method : 1.1920928955078125e-05 time for calcul the mask position with numpy : 0.007539033889770508 nb_pixel_total : 10241 time to create 1 rle with old method : 0.010734319686889648 time for calcul the mask position with numpy : 0.007688999176025391 nb_pixel_total : 540 time to create 1 rle with old method : 0.0005700588226318359 time for calcul the mask position with numpy : 0.007634162902832031 nb_pixel_total : 1078 time to create 1 rle with old method : 0.001142263412475586 time for calcul the mask position with numpy : 0.00762629508972168 nb_pixel_total : 3955 time to create 1 rle with old method : 0.004271507263183594 time for calcul the mask position with numpy : 0.007761955261230469 nb_pixel_total : 219 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.00784444808959961 nb_pixel_total : 503 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.007918834686279297 nb_pixel_total : 6247 time to create 1 rle with old method : 0.006763458251953125 time for calcul the mask position with numpy : 0.007977724075317383 nb_pixel_total : 131 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.00808405876159668 nb_pixel_total : 763 time to create 1 rle with old method : 0.0008728504180908203 time for calcul the mask position with numpy : 0.00797128677368164 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003037452697753906 time for calcul the mask position with numpy : 0.00831747055053711 nb_pixel_total : 153410 time to create 1 rle with new method : 0.07018184661865234 time for calcul the mask position with numpy : 0.007769346237182617 nb_pixel_total : 7472 time to create 1 rle with old method : 0.008069992065429688 time for calcul the mask position with numpy : 0.007977008819580078 nb_pixel_total : 76186 time to create 1 rle with old method : 0.07815790176391602 time for calcul the mask position with numpy : 0.008096694946289062 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0016398429870605469 time for calcul the mask position with numpy : 0.007726907730102539 nb_pixel_total : 686 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.0077593326568603516 nb_pixel_total : 733 time to create 1 rle with old method : 0.0007803440093994141 time for calcul the mask position with numpy : 0.0076596736907958984 nb_pixel_total : 257 time to create 1 rle with old method : 0.00028133392333984375 time for calcul the mask position with numpy : 0.007744789123535156 nb_pixel_total : 738 time to create 1 rle with old method : 0.0007953643798828125 time for calcul the mask position with numpy : 0.007634878158569336 nb_pixel_total : 94 time to create 1 rle with old method : 0.00010728836059570312 time for calcul the mask position with numpy : 0.007641792297363281 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007729530334472656 time for calcul the mask position with numpy : 0.007659435272216797 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002205371856689453 time for calcul the mask position with numpy : 0.0076313018798828125 nb_pixel_total : 136 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.007661342620849609 nb_pixel_total : 285 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.007552385330200195 nb_pixel_total : 4681 time to create 1 rle with old method : 0.004798173904418945 time for calcul the mask position with numpy : 0.007639169692993164 nb_pixel_total : 1519 time to create 1 rle with old method : 0.0017023086547851562 time for calcul the mask position with numpy : 0.007735013961791992 nb_pixel_total : 1983 time to create 1 rle with old method : 0.002093791961669922 time for calcul the mask position with numpy : 0.007801055908203125 nb_pixel_total : 1478 time to create 1 rle with old method : 0.0015499591827392578 time for calcul the mask position with numpy : 0.007964611053466797 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004715919494628906 time for calcul the mask position with numpy : 0.008054018020629883 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.007940530776977539 nb_pixel_total : 253 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.007923603057861328 nb_pixel_total : 992 time to create 1 rle with old method : 0.0010547637939453125 time for calcul the mask position with numpy : 0.007781267166137695 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004315376281738281 time for calcul the mask position with numpy : 0.007795572280883789 nb_pixel_total : 345 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.0077702999114990234 nb_pixel_total : 54 time to create 1 rle with old method : 6.651878356933594e-05 time for calcul the mask position with numpy : 0.0076754093170166016 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0017132759094238281 time for calcul the mask position with numpy : 0.007674694061279297 nb_pixel_total : 332 time to create 1 rle with old method : 0.00035262107849121094 time for calcul the mask position with numpy : 0.007875204086303711 nb_pixel_total : 83 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.007952213287353516 nb_pixel_total : 793 time to create 1 rle with old method : 0.0008754730224609375 time for calcul the mask position with numpy : 0.007926702499389648 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.007924795150756836 nb_pixel_total : 223 time to create 1 rle with old method : 0.00025916099548339844 time for calcul the mask position with numpy : 0.007939338684082031 nb_pixel_total : 30 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.007918596267700195 nb_pixel_total : 340 time to create 1 rle with old method : 0.0003914833068847656 time for calcul the mask position with numpy : 0.007701396942138672 nb_pixel_total : 205 time to create 1 rle with old method : 0.00022840499877929688 time for calcul the mask position with numpy : 0.007641315460205078 nb_pixel_total : 346 time to create 1 rle with old method : 0.00037026405334472656 time for calcul the mask position with numpy : 0.0078089237213134766 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0014426708221435547 time for calcul the mask position with numpy : 0.007939815521240234 nb_pixel_total : 797 time to create 1 rle with old method : 0.0008535385131835938 time for calcul the mask position with numpy : 0.007684230804443359 nb_pixel_total : 465 time to create 1 rle with old method : 0.00049591064453125 time for calcul the mask position with numpy : 0.007871866226196289 nb_pixel_total : 105149 time to create 1 rle with old method : 0.10748147964477539 time for calcul the mask position with numpy : 0.008850574493408203 nb_pixel_total : 196 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.008237838745117188 nb_pixel_total : 346 time to create 1 rle with old method : 0.00041794776916503906 time for calcul the mask position with numpy : 0.008119821548461914 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0014908313751220703 time for calcul the mask position with numpy : 0.008061647415161133 nb_pixel_total : 40790 time to create 1 rle with old method : 0.04179787635803223 time for calcul the mask position with numpy : 0.007787942886352539 nb_pixel_total : 84 time to create 1 rle with old method : 0.00010013580322265625 time for calcul the mask position with numpy : 0.007918596267700195 nb_pixel_total : 233 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.00773310661315918 nb_pixel_total : 558 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.007673978805541992 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003566741943359375 time for calcul the mask position with numpy : 0.007752656936645508 nb_pixel_total : 636 time to create 1 rle with old method : 0.0006573200225830078 time for calcul the mask position with numpy : 0.0077342987060546875 nb_pixel_total : 374 time to create 1 rle with old method : 0.0004279613494873047 time for calcul the mask position with numpy : 0.007731914520263672 nb_pixel_total : 25 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.007764339447021484 nb_pixel_total : 9 time to create 1 rle with old method : 2.956390380859375e-05 time for calcul the mask position with numpy : 0.0076847076416015625 nb_pixel_total : 367 time to create 1 rle with old method : 0.0003943443298339844 time for calcul the mask position with numpy : 0.007803678512573242 nb_pixel_total : 145 time to create 1 rle with old method : 0.00016260147094726562 time for calcul the mask position with numpy : 0.0077991485595703125 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004229545593261719 time for calcul the mask position with numpy : 0.007776021957397461 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0013437271118164062 time for calcul the mask position with numpy : 0.007805824279785156 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.007976770401000977 nb_pixel_total : 189 time to create 1 rle with old method : 0.00020170211791992188 time for calcul the mask position with numpy : 0.007877588272094727 nb_pixel_total : 165 time to create 1 rle with old method : 0.0001690387725830078 time for calcul the mask position with numpy : 0.007791280746459961 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0014579296112060547 time for calcul the mask position with numpy : 0.007670879364013672 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001442432403564453 time for calcul the mask position with numpy : 0.007630586624145508 nb_pixel_total : 402 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.007743120193481445 nb_pixel_total : 1664 time to create 1 rle with old method : 0.001775503158569336 time for calcul the mask position with numpy : 0.008007049560546875 nb_pixel_total : 265 time to create 1 rle with old method : 0.000316619873046875 time for calcul the mask position with numpy : 0.008023738861083984 nb_pixel_total : 664 time to create 1 rle with old method : 0.0007622241973876953 time for calcul the mask position with numpy : 0.008061647415161133 nb_pixel_total : 8613 time to create 1 rle with old method : 0.00917816162109375 time for calcul the mask position with numpy : 0.008039712905883789 nb_pixel_total : 1134 time to create 1 rle with old method : 0.001232147216796875 time for calcul the mask position with numpy : 0.007909536361694336 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001857280731201172 time for calcul the mask position with numpy : 0.00789785385131836 nb_pixel_total : 196 time to create 1 rle with old method : 0.00023245811462402344 time for calcul the mask position with numpy : 0.007884740829467773 nb_pixel_total : 874 time to create 1 rle with old method : 0.0009355545043945312 time for calcul the mask position with numpy : 0.007905721664428711 nb_pixel_total : 269 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.007907390594482422 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.007901668548583984 nb_pixel_total : 111 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.00793766975402832 nb_pixel_total : 234 time to create 1 rle with old method : 0.00025010108947753906 create new chi : 1.4117469787597656 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006788015365600586 batch 1 Loaded 94 chid ids of type : 4230 Number RLEs to save : 12341 TO DO : save crop sub photo not yet done ! save time : 1.9414212703704834 nb_obj : 91 nb_hashtags : 8 time to prepare the origin masks : 1.9930217266082764 time for calcul the mask position with numpy : 0.026234865188598633 nb_pixel_total : 1530803 time to create 1 rle with new method : 0.0741872787475586 time for calcul the mask position with numpy : 0.005889892578125 nb_pixel_total : 183 time to create 1 rle with old method : 0.00022029876708984375 time for calcul the mask position with numpy : 0.009965181350708008 nb_pixel_total : 48089 time to create 1 rle with old method : 0.05037379264831543 time for calcul the mask position with numpy : 0.01004934310913086 nb_pixel_total : 985 time to create 1 rle with old method : 0.0011775493621826172 time for calcul the mask position with numpy : 0.009692192077636719 nb_pixel_total : 17 time to create 1 rle with old method : 6.103515625e-05 time for calcul the mask position with numpy : 0.009583234786987305 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004737377166748047 time for calcul the mask position with numpy : 0.00957798957824707 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.009743452072143555 nb_pixel_total : 1981 time to create 1 rle with old method : 0.0022618770599365234 time for calcul the mask position with numpy : 0.009474992752075195 nb_pixel_total : 37 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.009356021881103516 nb_pixel_total : 202 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.00953364372253418 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003948211669921875 time for calcul the mask position with numpy : 0.008016824722290039 nb_pixel_total : 2611 time to create 1 rle with old method : 0.002857685089111328 time for calcul the mask position with numpy : 0.006036281585693359 nb_pixel_total : 26437 time to create 1 rle with old method : 0.02809739112854004 time for calcul the mask position with numpy : 0.005813121795654297 nb_pixel_total : 311 time to create 1 rle with old method : 0.00042438507080078125 time for calcul the mask position with numpy : 0.0057756900787353516 nb_pixel_total : 884 time to create 1 rle with old method : 0.001028299331665039 time for calcul the mask position with numpy : 0.005773067474365234 nb_pixel_total : 3538 time to create 1 rle with old method : 0.003755331039428711 time for calcul the mask position with numpy : 0.0055429935455322266 nb_pixel_total : 1404 time to create 1 rle with old method : 0.0014941692352294922 time for calcul the mask position with numpy : 0.005774259567260742 nb_pixel_total : 401 time to create 1 rle with old method : 0.0004525184631347656 time for calcul the mask position with numpy : 0.0056934356689453125 nb_pixel_total : 130 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.0057332515716552734 nb_pixel_total : 261 time to create 1 rle with old method : 0.00029659271240234375 time for calcul the mask position with numpy : 0.006937980651855469 nb_pixel_total : 153992 time to create 1 rle with new method : 0.39177966117858887 time for calcul the mask position with numpy : 0.005807161331176758 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0012826919555664062 time for calcul the mask position with numpy : 0.006139039993286133 nb_pixel_total : 79095 time to create 1 rle with old method : 0.0819699764251709 time for calcul the mask position with numpy : 0.005896568298339844 nb_pixel_total : 1606 time to create 1 rle with old method : 0.0017375946044921875 time for calcul the mask position with numpy : 0.005597114562988281 nb_pixel_total : 53 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.0058629512786865234 nb_pixel_total : 692 time to create 1 rle with old method : 0.0006923675537109375 time for calcul the mask position with numpy : 0.005666494369506836 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003902912139892578 time for calcul the mask position with numpy : 0.005867958068847656 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008144378662109375 time for calcul the mask position with numpy : 0.005577802658081055 nb_pixel_total : 86 time to create 1 rle with old method : 0.00010800361633300781 time for calcul the mask position with numpy : 0.005686283111572266 nb_pixel_total : 206 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.005831718444824219 nb_pixel_total : 4127 time to create 1 rle with old method : 0.004461765289306641 time for calcul the mask position with numpy : 0.0058650970458984375 nb_pixel_total : 636 time to create 1 rle with old method : 0.0006978511810302734 time for calcul the mask position with numpy : 0.005702018737792969 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0014722347259521484 time for calcul the mask position with numpy : 0.005594730377197266 nb_pixel_total : 124 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.009303092956542969 nb_pixel_total : 1019 time to create 1 rle with old method : 0.0011532306671142578 time for calcul the mask position with numpy : 0.005696535110473633 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0011148452758789062 time for calcul the mask position with numpy : 0.005899906158447266 nb_pixel_total : 542 time to create 1 rle with old method : 0.0005793571472167969 time for calcul the mask position with numpy : 0.00628972053527832 nb_pixel_total : 59 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.005898714065551758 nb_pixel_total : 1706 time to create 1 rle with old method : 0.0018773078918457031 time for calcul the mask position with numpy : 0.005893230438232422 nb_pixel_total : 43 time to create 1 rle with old method : 9.131431579589844e-05 time for calcul the mask position with numpy : 0.0055599212646484375 nb_pixel_total : 19 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.005639791488647461 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005388259887695312 time for calcul the mask position with numpy : 0.005580425262451172 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0017859935760498047 time for calcul the mask position with numpy : 0.005728960037231445 nb_pixel_total : 680 time to create 1 rle with old method : 0.00074005126953125 time for calcul the mask position with numpy : 0.005754709243774414 nb_pixel_total : 150 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.0056836605072021484 nb_pixel_total : 383 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.005774259567260742 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005133152008056641 time for calcul the mask position with numpy : 0.005608797073364258 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.005843400955200195 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.006108760833740234 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005109310150146484 time for calcul the mask position with numpy : 0.005673885345458984 nb_pixel_total : 198 time to create 1 rle with old method : 0.00021648406982421875 time for calcul the mask position with numpy : 0.006145477294921875 nb_pixel_total : 1118 time to create 1 rle with old method : 0.0011873245239257812 time for calcul the mask position with numpy : 0.006055593490600586 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0014202594757080078 time for calcul the mask position with numpy : 0.006380558013916016 nb_pixel_total : 197 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.006419658660888672 nb_pixel_total : 103486 time to create 1 rle with old method : 0.1368544101715088 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 768 time to create 1 rle with old method : 0.0008494853973388672 time for calcul the mask position with numpy : 0.006112813949584961 nb_pixel_total : 42558 time to create 1 rle with old method : 0.04416513442993164 time for calcul the mask position with numpy : 0.006025075912475586 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018310546875 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012087821960449219 time for calcul the mask position with numpy : 0.006103038787841797 nb_pixel_total : 33875 time to create 1 rle with old method : 0.034958839416503906 time for calcul the mask position with numpy : 0.00596165657043457 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.005681753158569336 nb_pixel_total : 454 time to create 1 rle with old method : 0.0004734992980957031 time for calcul the mask position with numpy : 0.005914211273193359 nb_pixel_total : 23 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.00647735595703125 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007178783416748047 time for calcul the mask position with numpy : 0.006212472915649414 nb_pixel_total : 150 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.005944490432739258 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004367828369140625 time for calcul the mask position with numpy : 0.005872488021850586 nb_pixel_total : 31 time to create 1 rle with old method : 5.507469177246094e-05 time for calcul the mask position with numpy : 0.006112337112426758 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003228187561035156 time for calcul the mask position with numpy : 0.006026268005371094 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.005657196044921875 nb_pixel_total : 355 time to create 1 rle with old method : 0.0003826618194580078 time for calcul the mask position with numpy : 0.005818605422973633 nb_pixel_total : 55 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.005820274353027344 nb_pixel_total : 771 time to create 1 rle with old method : 0.0007913112640380859 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 1267 time to create 1 rle with old method : 0.0014116764068603516 time for calcul the mask position with numpy : 0.005879878997802734 nb_pixel_total : 201 time to create 1 rle with old method : 0.00024962425231933594 time for calcul the mask position with numpy : 0.005892515182495117 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005350112915039062 time for calcul the mask position with numpy : 0.006318092346191406 nb_pixel_total : 149 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 159 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.0060579776763916016 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004336833953857422 time for calcul the mask position with numpy : 0.005820512771606445 nb_pixel_total : 245 time to create 1 rle with old method : 0.00030422210693359375 time for calcul the mask position with numpy : 0.005898714065551758 nb_pixel_total : 8110 time to create 1 rle with old method : 0.008305549621582031 time for calcul the mask position with numpy : 0.0058896541595458984 nb_pixel_total : 54 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.005774736404418945 nb_pixel_total : 457 time to create 1 rle with old method : 0.0004944801330566406 time for calcul the mask position with numpy : 0.005733966827392578 nb_pixel_total : 15 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.0058743953704833984 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0013091564178466797 time for calcul the mask position with numpy : 0.005966901779174805 nb_pixel_total : 196 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.0057485103607177734 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.005863189697265625 nb_pixel_total : 891 time to create 1 rle with old method : 0.0009520053863525391 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 20 time to create 1 rle with old method : 5.1975250244140625e-05 time for calcul the mask position with numpy : 0.005895376205444336 nb_pixel_total : 244 time to create 1 rle with old method : 0.0002689361572265625 time for calcul the mask position with numpy : 0.005880117416381836 nb_pixel_total : 115 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.005789279937744141 nb_pixel_total : 182 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.005743265151977539 nb_pixel_total : 144 time to create 1 rle with old method : 0.00017499923706054688 create new chi : 1.514561414718628 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001394510269165039 batch 1 Loaded 92 chid ids of type : 4230 Number RLEs to save : 11370 TO DO : save crop sub photo not yet done ! save time : 0.8074460029602051 nb_obj : 96 nb_hashtags : 5 time to prepare the origin masks : 1.7254183292388916 time for calcul the mask position with numpy : 0.43672680854797363 nb_pixel_total : 1603063 time to create 1 rle with new method : 0.0835578441619873 time for calcul the mask position with numpy : 0.009609460830688477 nb_pixel_total : 5662 time to create 1 rle with old method : 0.006553173065185547 time for calcul the mask position with numpy : 0.010458707809448242 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001163482666015625 time for calcul the mask position with numpy : 0.010587215423583984 nb_pixel_total : 965 time to create 1 rle with old method : 0.0011990070343017578 time for calcul the mask position with numpy : 0.010681867599487305 nb_pixel_total : 55 time to create 1 rle with old method : 9.036064147949219e-05 time for calcul the mask position with numpy : 0.009925603866577148 nb_pixel_total : 31 time to create 1 rle with old method : 9.369850158691406e-05 time for calcul the mask position with numpy : 0.010584592819213867 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005037784576416016 time for calcul the mask position with numpy : 0.010182380676269531 nb_pixel_total : 226 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.010110855102539062 nb_pixel_total : 1738 time to create 1 rle with old method : 0.002066373825073242 time for calcul the mask position with numpy : 0.009855270385742188 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007319450378417969 time for calcul the mask position with numpy : 0.009166955947875977 nb_pixel_total : 40 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.010099172592163086 nb_pixel_total : 22199 time to create 1 rle with old method : 0.023865222930908203 time for calcul the mask position with numpy : 0.009666204452514648 nb_pixel_total : 40 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.009791374206542969 nb_pixel_total : 5896 time to create 1 rle with old method : 0.0065155029296875 time for calcul the mask position with numpy : 0.0075910091400146484 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.009083032608032227 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004000663757324219 time for calcul the mask position with numpy : 0.008919954299926758 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0012230873107910156 time for calcul the mask position with numpy : 0.012109756469726562 nb_pixel_total : 2565 time to create 1 rle with old method : 0.002908945083618164 time for calcul the mask position with numpy : 0.008466482162475586 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005016326904296875 time for calcul the mask position with numpy : 0.009268760681152344 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005652904510498047 time for calcul the mask position with numpy : 0.009042501449584961 nb_pixel_total : 5352 time to create 1 rle with old method : 0.0060100555419921875 time for calcul the mask position with numpy : 0.009351253509521484 nb_pixel_total : 76 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.00933837890625 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009055137634277344 time for calcul the mask position with numpy : 0.00956583023071289 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.01033639907836914 nb_pixel_total : 154778 time to create 1 rle with new method : 0.3409755229949951 time for calcul the mask position with numpy : 0.010231971740722656 nb_pixel_total : 2214 time to create 1 rle with old method : 0.0025348663330078125 time for calcul the mask position with numpy : 0.009468555450439453 nb_pixel_total : 155 time to create 1 rle with old method : 0.00042057037353515625 time for calcul the mask position with numpy : 0.009467601776123047 nb_pixel_total : 74387 time to create 1 rle with old method : 0.07860851287841797 time for calcul the mask position with numpy : 0.00793910026550293 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007810592651367188 time for calcul the mask position with numpy : 0.008971691131591797 nb_pixel_total : 6609 time to create 1 rle with old method : 0.007790088653564453 time for calcul the mask position with numpy : 0.00983572006225586 nb_pixel_total : 185 time to create 1 rle with old method : 0.000255584716796875 time for calcul the mask position with numpy : 0.009469747543334961 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007207393646240234 time for calcul the mask position with numpy : 0.009821653366088867 nb_pixel_total : 93 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.009594440460205078 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011420249938964844 time for calcul the mask position with numpy : 0.009530782699584961 nb_pixel_total : 644 time to create 1 rle with old method : 0.0007741451263427734 time for calcul the mask position with numpy : 0.009521245956420898 nb_pixel_total : 3655 time to create 1 rle with old method : 0.0039539337158203125 time for calcul the mask position with numpy : 0.009772539138793945 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007560253143310547 time for calcul the mask position with numpy : 0.012277364730834961 nb_pixel_total : 398 time to create 1 rle with old method : 0.00044226646423339844 time for calcul the mask position with numpy : 0.009438276290893555 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0016753673553466797 time for calcul the mask position with numpy : 0.00944662094116211 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0020945072174072266 time for calcul the mask position with numpy : 0.00921320915222168 nb_pixel_total : 409 time to create 1 rle with old method : 0.0004937648773193359 time for calcul the mask position with numpy : 0.009413480758666992 nb_pixel_total : 905 time to create 1 rle with old method : 0.0010654926300048828 time for calcul the mask position with numpy : 0.009572029113769531 nb_pixel_total : 11 time to create 1 rle with old method : 4.458427429199219e-05 time for calcul the mask position with numpy : 0.009696722030639648 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007417201995849609 time for calcul the mask position with numpy : 0.009616613388061523 nb_pixel_total : 971 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.009644031524658203 nb_pixel_total : 570 time to create 1 rle with old method : 0.0006506443023681641 time for calcul the mask position with numpy : 0.009348869323730469 nb_pixel_total : 39 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.009531259536743164 nb_pixel_total : 1799 time to create 1 rle with old method : 0.001965761184692383 time for calcul the mask position with numpy : 0.00930476188659668 nb_pixel_total : 153 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.00952291488647461 nb_pixel_total : 360 time to create 1 rle with old method : 0.0003979206085205078 time for calcul the mask position with numpy : 0.009437799453735352 nb_pixel_total : 1613 time to create 1 rle with old method : 0.0018024444580078125 time for calcul the mask position with numpy : 0.009118080139160156 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.009004592895507812 nb_pixel_total : 139 time to create 1 rle with old method : 0.00019073486328125 time for calcul the mask position with numpy : 0.009303092956542969 nb_pixel_total : 595 time to create 1 rle with old method : 0.0006368160247802734 time for calcul the mask position with numpy : 0.009309530258178711 nb_pixel_total : 181 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.009458541870117188 nb_pixel_total : 81 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.00931549072265625 nb_pixel_total : 946 time to create 1 rle with old method : 0.0010271072387695312 time for calcul the mask position with numpy : 0.00949239730834961 nb_pixel_total : 1928 time to create 1 rle with old method : 0.002026081085205078 time for calcul the mask position with numpy : 0.009400129318237305 nb_pixel_total : 483 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.009818315505981445 nb_pixel_total : 104900 time to create 1 rle with old method : 0.10598278045654297 time for calcul the mask position with numpy : 0.009432792663574219 nb_pixel_total : 254 time to create 1 rle with old method : 0.00029277801513671875 time for calcul the mask position with numpy : 0.008525609970092773 nb_pixel_total : 191 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.008721590042114258 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006189346313476562 time for calcul the mask position with numpy : 0.006722927093505859 nb_pixel_total : 105 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.007544755935668945 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003132820129394531 time for calcul the mask position with numpy : 0.008820056915283203 nb_pixel_total : 34506 time to create 1 rle with old method : 0.03505063056945801 time for calcul the mask position with numpy : 0.009107351303100586 nb_pixel_total : 537 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.009271621704101562 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002613067626953125 time for calcul the mask position with numpy : 0.008857965469360352 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006959438323974609 time for calcul the mask position with numpy : 0.009048223495483398 nb_pixel_total : 410 time to create 1 rle with old method : 0.00043654441833496094 time for calcul the mask position with numpy : 0.009287118911743164 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005013942718505859 time for calcul the mask position with numpy : 0.010998725891113281 nb_pixel_total : 118 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.011153697967529297 nb_pixel_total : 377 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.011054277420043945 nb_pixel_total : 584 time to create 1 rle with old method : 0.0009717941284179688 time for calcul the mask position with numpy : 0.011026859283447266 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0021371841430664062 time for calcul the mask position with numpy : 0.010998010635375977 nb_pixel_total : 77 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.010929346084594727 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003132820129394531 time for calcul the mask position with numpy : 0.011250495910644531 nb_pixel_total : 53 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.009662628173828125 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004749298095703125 time for calcul the mask position with numpy : 0.008549690246582031 nb_pixel_total : 167 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.009209632873535156 nb_pixel_total : 356 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.009050369262695312 nb_pixel_total : 134 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.009377002716064453 nb_pixel_total : 467 time to create 1 rle with old method : 0.000522613525390625 time for calcul the mask position with numpy : 0.009013652801513672 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003170967102050781 time for calcul the mask position with numpy : 0.009380578994750977 nb_pixel_total : 244 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.009181737899780273 nb_pixel_total : 642 time to create 1 rle with old method : 0.0006871223449707031 time for calcul the mask position with numpy : 0.009054183959960938 nb_pixel_total : 8161 time to create 1 rle with old method : 0.008678913116455078 time for calcul the mask position with numpy : 0.008806705474853516 nb_pixel_total : 19 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.009648799896240234 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0012249946594238281 time for calcul the mask position with numpy : 0.009374380111694336 nb_pixel_total : 186 time to create 1 rle with old method : 0.00020194053649902344 time for calcul the mask position with numpy : 0.009217977523803711 nb_pixel_total : 988 time to create 1 rle with old method : 0.0010318756103515625 time for calcul the mask position with numpy : 0.008951425552368164 nb_pixel_total : 322 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.009023427963256836 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.009072303771972656 nb_pixel_total : 123 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.007845878601074219 nb_pixel_total : 8 time to create 1 rle with old method : 2.7418136596679688e-05 time for calcul the mask position with numpy : 0.007906913757324219 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.00793600082397461 nb_pixel_total : 140 time to create 1 rle with old method : 0.000186920166015625 create new chi : 2.122333288192749 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.002671957015991211 batch 1 Loaded 97 chid ids of type : 4230 Number RLEs to save : 11875 TO DO : save crop sub photo not yet done ! save time : 0.8824641704559326 nb_obj : 82 nb_hashtags : 5 time to prepare the origin masks : 1.532644271850586 time for calcul the mask position with numpy : 0.016820907592773438 nb_pixel_total : 1599899 time to create 1 rle with new method : 0.033967018127441406 time for calcul the mask position with numpy : 0.0099029541015625 nb_pixel_total : 862 time to create 1 rle with old method : 0.0010182857513427734 time for calcul the mask position with numpy : 0.0057828426361083984 nb_pixel_total : 147 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.00971221923828125 nb_pixel_total : 58 time to create 1 rle with old method : 9.1552734375e-05 time for calcul the mask position with numpy : 0.00966787338256836 nb_pixel_total : 16 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.009403705596923828 nb_pixel_total : 29161 time to create 1 rle with old method : 0.030114173889160156 time for calcul the mask position with numpy : 0.006101846694946289 nb_pixel_total : 906 time to create 1 rle with old method : 0.0010242462158203125 time for calcul the mask position with numpy : 0.0057413578033447266 nb_pixel_total : 334 time to create 1 rle with old method : 0.0003638267517089844 time for calcul the mask position with numpy : 0.005651712417602539 nb_pixel_total : 1229 time to create 1 rle with old method : 0.0012602806091308594 time for calcul the mask position with numpy : 0.005969524383544922 nb_pixel_total : 216 time to create 1 rle with old method : 0.00026702880859375 time for calcul the mask position with numpy : 0.005965471267700195 nb_pixel_total : 39 time to create 1 rle with old method : 6.222724914550781e-05 time for calcul the mask position with numpy : 0.005908012390136719 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005779266357421875 time for calcul the mask position with numpy : 0.005827426910400391 nb_pixel_total : 38 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.00565338134765625 nb_pixel_total : 1810 time to create 1 rle with old method : 0.001953601837158203 time for calcul the mask position with numpy : 0.009016752243041992 nb_pixel_total : 2563 time to create 1 rle with old method : 0.0027692317962646484 time for calcul the mask position with numpy : 0.00800466537475586 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003311634063720703 time for calcul the mask position with numpy : 0.005677700042724609 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005142688751220703 time for calcul the mask position with numpy : 0.005675315856933594 nb_pixel_total : 429 time to create 1 rle with old method : 0.000499725341796875 time for calcul the mask position with numpy : 0.005690813064575195 nb_pixel_total : 5406 time to create 1 rle with old method : 0.005646944046020508 time for calcul the mask position with numpy : 0.0055658817291259766 nb_pixel_total : 886 time to create 1 rle with old method : 0.0009183883666992188 time for calcul the mask position with numpy : 0.0058002471923828125 nb_pixel_total : 244 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.006896495819091797 nb_pixel_total : 154558 time to create 1 rle with new method : 0.027069568634033203 time for calcul the mask position with numpy : 0.006979942321777344 nb_pixel_total : 2786 time to create 1 rle with old method : 0.0029370784759521484 time for calcul the mask position with numpy : 0.00976109504699707 nb_pixel_total : 77169 time to create 1 rle with old method : 0.08002495765686035 time for calcul the mask position with numpy : 0.009537458419799805 nb_pixel_total : 681 time to create 1 rle with old method : 0.0007493495941162109 time for calcul the mask position with numpy : 0.009553909301757812 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007355213165283203 time for calcul the mask position with numpy : 0.009463071823120117 nb_pixel_total : 692 time to create 1 rle with old method : 0.0007901191711425781 time for calcul the mask position with numpy : 0.009131193161010742 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003173351287841797 time for calcul the mask position with numpy : 0.009133338928222656 nb_pixel_total : 9251 time to create 1 rle with old method : 0.009934663772583008 time for calcul the mask position with numpy : 0.009292364120483398 nb_pixel_total : 1217 time to create 1 rle with old method : 0.0013272762298583984 time for calcul the mask position with numpy : 0.009195566177368164 nb_pixel_total : 314 time to create 1 rle with old method : 0.00039076805114746094 time for calcul the mask position with numpy : 0.009458541870117188 nb_pixel_total : 4315 time to create 1 rle with old method : 0.004667758941650391 time for calcul the mask position with numpy : 0.012463569641113281 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0015532970428466797 time for calcul the mask position with numpy : 0.009192466735839844 nb_pixel_total : 216 time to create 1 rle with old method : 0.00030612945556640625 time for calcul the mask position with numpy : 0.009320497512817383 nb_pixel_total : 822 time to create 1 rle with old method : 0.0010597705841064453 time for calcul the mask position with numpy : 0.009372949600219727 nb_pixel_total : 300 time to create 1 rle with old method : 0.00034332275390625 time for calcul the mask position with numpy : 0.009197235107421875 nb_pixel_total : 649 time to create 1 rle with old method : 0.0007851123809814453 time for calcul the mask position with numpy : 0.009465456008911133 nb_pixel_total : 726 time to create 1 rle with old method : 0.0007870197296142578 time for calcul the mask position with numpy : 0.009486675262451172 nb_pixel_total : 966 time to create 1 rle with old method : 0.0011785030364990234 time for calcul the mask position with numpy : 0.009633064270019531 nb_pixel_total : 24 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.009491920471191406 nb_pixel_total : 5 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.00928950309753418 nb_pixel_total : 615 time to create 1 rle with old method : 0.0006654262542724609 time for calcul the mask position with numpy : 0.009378194808959961 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0011293888092041016 time for calcul the mask position with numpy : 0.009515762329101562 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0018427371978759766 time for calcul the mask position with numpy : 0.009497642517089844 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001506805419921875 time for calcul the mask position with numpy : 0.009508848190307617 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006043910980224609 time for calcul the mask position with numpy : 0.009388208389282227 nb_pixel_total : 186 time to create 1 rle with old method : 0.00021576881408691406 time for calcul the mask position with numpy : 0.009322643280029297 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.009537935256958008 nb_pixel_total : 886 time to create 1 rle with old method : 0.0009722709655761719 time for calcul the mask position with numpy : 0.009440183639526367 nb_pixel_total : 535 time to create 1 rle with old method : 0.0005693435668945312 time for calcul the mask position with numpy : 0.00919961929321289 nb_pixel_total : 207 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.00957632064819336 nb_pixel_total : 106271 time to create 1 rle with old method : 0.1072697639465332 time for calcul the mask position with numpy : 0.009703636169433594 nb_pixel_total : 37550 time to create 1 rle with old method : 0.038550615310668945 time for calcul the mask position with numpy : 0.010008096694946289 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005338191986083984 time for calcul the mask position with numpy : 0.009623050689697266 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012063980102539062 time for calcul the mask position with numpy : 0.009685039520263672 nb_pixel_total : 287 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.009571313858032227 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006036758422851562 time for calcul the mask position with numpy : 0.009749174118041992 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.009609222412109375 nb_pixel_total : 165 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.009592533111572266 nb_pixel_total : 574 time to create 1 rle with old method : 0.0006785392761230469 time for calcul the mask position with numpy : 0.009575843811035156 nb_pixel_total : 408 time to create 1 rle with old method : 0.00046372413635253906 time for calcul the mask position with numpy : 0.00961160659790039 nb_pixel_total : 298 time to create 1 rle with old method : 0.00034928321838378906 time for calcul the mask position with numpy : 0.009542226791381836 nb_pixel_total : 131 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.009464502334594727 nb_pixel_total : 587 time to create 1 rle with old method : 0.0006959438323974609 time for calcul the mask position with numpy : 0.009562969207763672 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0013828277587890625 time for calcul the mask position with numpy : 0.009751319885253906 nb_pixel_total : 1900 time to create 1 rle with old method : 0.0020177364349365234 time for calcul the mask position with numpy : 0.009790897369384766 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.009455204010009766 nb_pixel_total : 1011 time to create 1 rle with old method : 0.004427909851074219 time for calcul the mask position with numpy : 0.009552478790283203 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.009702205657958984 nb_pixel_total : 212 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.009675025939941406 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002105236053466797 time for calcul the mask position with numpy : 0.009445667266845703 nb_pixel_total : 358 time to create 1 rle with old method : 0.00039005279541015625 time for calcul the mask position with numpy : 0.009646892547607422 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.009535551071166992 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.009701251983642578 nb_pixel_total : 9051 time to create 1 rle with old method : 0.00988626480102539 time for calcul the mask position with numpy : 0.00963282585144043 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004894733428955078 time for calcul the mask position with numpy : 0.009718656539916992 nb_pixel_total : 15 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.009642839431762695 nb_pixel_total : 749 time to create 1 rle with old method : 0.0008859634399414062 time for calcul the mask position with numpy : 0.009849071502685547 nb_pixel_total : 157 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.009578466415405273 nb_pixel_total : 890 time to create 1 rle with old method : 0.000997781753540039 time for calcul the mask position with numpy : 0.0095672607421875 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.009389162063598633 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.009438276290893555 nb_pixel_total : 109 time to create 1 rle with old method : 0.00013709068298339844 create new chi : 1.1465086936950684 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001497030258178711 batch 1 Loaded 83 chid ids of type : 4230 Number RLEs to save : 10950 TO DO : save crop sub photo not yet done ! save time : 2.0977444648742676 nb_obj : 84 nb_hashtags : 6 time to prepare the origin masks : 1.3618404865264893 time for calcul the mask position with numpy : 0.2757697105407715 nb_pixel_total : 1576606 time to create 1 rle with new method : 0.1100308895111084 time for calcul the mask position with numpy : 0.009594917297363281 nb_pixel_total : 202 time to create 1 rle with old method : 0.00026035308837890625 time for calcul the mask position with numpy : 0.009282112121582031 nb_pixel_total : 2855 time to create 1 rle with old method : 0.003248453140258789 time for calcul the mask position with numpy : 0.008948802947998047 nb_pixel_total : 686 time to create 1 rle with old method : 0.0007429122924804688 time for calcul the mask position with numpy : 0.00599217414855957 nb_pixel_total : 19 time to create 1 rle with old method : 5.817413330078125e-05 time for calcul the mask position with numpy : 0.005882740020751953 nb_pixel_total : 428 time to create 1 rle with old method : 0.0004508495330810547 time for calcul the mask position with numpy : 0.009255647659301758 nb_pixel_total : 96 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.008992910385131836 nb_pixel_total : 888 time to create 1 rle with old method : 0.0010406970977783203 time for calcul the mask position with numpy : 0.00923299789428711 nb_pixel_total : 296 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.009080886840820312 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006458759307861328 time for calcul the mask position with numpy : 0.009383678436279297 nb_pixel_total : 18 time to create 1 rle with old method : 7.176399230957031e-05 time for calcul the mask position with numpy : 0.0060613155364990234 nb_pixel_total : 43 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.006028890609741211 nb_pixel_total : 3 time to create 1 rle with old method : 2.6226043701171875e-05 time for calcul the mask position with numpy : 0.006074666976928711 nb_pixel_total : 26048 time to create 1 rle with old method : 0.027241230010986328 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 40 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.005606412887573242 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005216598510742188 time for calcul the mask position with numpy : 0.005644559860229492 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0015177726745605469 time for calcul the mask position with numpy : 0.005627155303955078 nb_pixel_total : 460 time to create 1 rle with old method : 0.00048804283142089844 time for calcul the mask position with numpy : 0.0057277679443359375 nb_pixel_total : 3301 time to create 1 rle with old method : 0.0036427974700927734 time for calcul the mask position with numpy : 0.005634784698486328 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.005568027496337891 nb_pixel_total : 462 time to create 1 rle with old method : 0.0004913806915283203 time for calcul the mask position with numpy : 0.005590677261352539 nb_pixel_total : 731 time to create 1 rle with old method : 0.0008072853088378906 time for calcul the mask position with numpy : 0.005873918533325195 nb_pixel_total : 243 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.00653839111328125 nb_pixel_total : 154554 time to create 1 rle with new method : 0.0665748119354248 time for calcul the mask position with numpy : 0.0057446956634521484 nb_pixel_total : 1176 time to create 1 rle with old method : 0.0013010501861572266 time for calcul the mask position with numpy : 0.005863666534423828 nb_pixel_total : 1809 time to create 1 rle with old method : 0.002068042755126953 time for calcul the mask position with numpy : 0.0058443546295166016 nb_pixel_total : 940 time to create 1 rle with old method : 0.0012989044189453125 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 74976 time to create 1 rle with old method : 0.07558488845825195 time for calcul the mask position with numpy : 0.0058476924896240234 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007205009460449219 time for calcul the mask position with numpy : 0.00589442253112793 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001609325408935547 time for calcul the mask position with numpy : 0.005719661712646484 nb_pixel_total : 168 time to create 1 rle with old method : 0.00023484230041503906 time for calcul the mask position with numpy : 0.00584721565246582 nb_pixel_total : 6956 time to create 1 rle with old method : 0.007637739181518555 time for calcul the mask position with numpy : 0.005760908126831055 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.005606174468994141 nb_pixel_total : 246 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.006125688552856445 nb_pixel_total : 3720 time to create 1 rle with old method : 0.0038251876831054688 time for calcul the mask position with numpy : 0.005751371383666992 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007998943328857422 time for calcul the mask position with numpy : 0.005745649337768555 nb_pixel_total : 1652 time to create 1 rle with old method : 0.001905202865600586 time for calcul the mask position with numpy : 0.005675554275512695 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0019307136535644531 time for calcul the mask position with numpy : 0.00568842887878418 nb_pixel_total : 241 time to create 1 rle with old method : 0.000278472900390625 time for calcul the mask position with numpy : 0.005720615386962891 nb_pixel_total : 55 time to create 1 rle with old method : 0.00016355514526367188 time for calcul the mask position with numpy : 0.0056111812591552734 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0011749267578125 time for calcul the mask position with numpy : 0.005602359771728516 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005066394805908203 time for calcul the mask position with numpy : 0.00948786735534668 nb_pixel_total : 58 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.00581669807434082 nb_pixel_total : 1595 time to create 1 rle with old method : 0.0017049312591552734 time for calcul the mask position with numpy : 0.005813121795654297 nb_pixel_total : 350 time to create 1 rle with old method : 0.00038743019104003906 time for calcul the mask position with numpy : 0.005843639373779297 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.005697011947631836 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0016274452209472656 time for calcul the mask position with numpy : 0.005995988845825195 nb_pixel_total : 128 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.005814552307128906 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006473064422607422 time for calcul the mask position with numpy : 0.005622386932373047 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.006067037582397461 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.005664825439453125 nb_pixel_total : 1166 time to create 1 rle with old method : 0.0012636184692382812 time for calcul the mask position with numpy : 0.005842924118041992 nb_pixel_total : 1427 time to create 1 rle with old method : 0.001445770263671875 time for calcul the mask position with numpy : 0.005709171295166016 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005543231964111328 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 106779 time to create 1 rle with old method : 0.10848522186279297 time for calcul the mask position with numpy : 0.006059408187866211 nb_pixel_total : 196 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 53499 time to create 1 rle with old method : 0.054016828536987305 time for calcul the mask position with numpy : 0.00582575798034668 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007004737854003906 time for calcul the mask position with numpy : 0.005664825439453125 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.0057294368743896484 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003056526184082031 time for calcul the mask position with numpy : 0.00575709342956543 nb_pixel_total : 538 time to create 1 rle with old method : 0.0005643367767333984 time for calcul the mask position with numpy : 0.005862712860107422 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004303455352783203 time for calcul the mask position with numpy : 0.005799531936645508 nb_pixel_total : 17664 time to create 1 rle with old method : 0.018726825714111328 time for calcul the mask position with numpy : 0.005714893341064453 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.005892038345336914 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007233619689941406 time for calcul the mask position with numpy : 0.0062236785888671875 nb_pixel_total : 411 time to create 1 rle with old method : 0.0004448890686035156 time for calcul the mask position with numpy : 0.005757808685302734 nb_pixel_total : 17 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.005941629409790039 nb_pixel_total : 311 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.006294965744018555 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0012733936309814453 time for calcul the mask position with numpy : 0.006487369537353516 nb_pixel_total : 1792 time to create 1 rle with old method : 0.0019578933715820312 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 92 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.005872011184692383 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002071857452392578 time for calcul the mask position with numpy : 0.005652189254760742 nb_pixel_total : 437 time to create 1 rle with old method : 0.00051116943359375 time for calcul the mask position with numpy : 0.005867481231689453 nb_pixel_total : 162 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.005766630172729492 nb_pixel_total : 127 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.0057528018951416016 nb_pixel_total : 245 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.00584101676940918 nb_pixel_total : 735 time to create 1 rle with old method : 0.0008318424224853516 time for calcul the mask position with numpy : 0.005879640579223633 nb_pixel_total : 8492 time to create 1 rle with old method : 0.008894920349121094 time for calcul the mask position with numpy : 0.007855653762817383 nb_pixel_total : 913 time to create 1 rle with old method : 0.0009713172912597656 time for calcul the mask position with numpy : 0.007850885391235352 nb_pixel_total : 883 time to create 1 rle with old method : 0.0009839534759521484 time for calcul the mask position with numpy : 0.007849693298339844 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.007884740829467773 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.00782465934753418 nb_pixel_total : 8 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.007860660552978516 nb_pixel_total : 109 time to create 1 rle with old method : 0.00013399124145507812 time for calcul the mask position with numpy : 0.007935762405395508 nb_pixel_total : 150 time to create 1 rle with old method : 0.00017595291137695312 create new chi : 1.3557982444763184 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015461444854736328 batch 1 Loaded 85 chid ids of type : 4230 Number RLEs to save : 11342 TO DO : save crop sub photo not yet done ! save time : 4.565974473953247 map_output_result : {1335910338: (0.0, 'Should be the crop_list due to order', 0.0), 1335910315: (0.0, 'Should be the crop_list due to order', 0.0), 1335910287: (0.0, 'Should be the crop_list due to order', 0.0), 1335910101: (0.0, 'Should be the crop_list due to order', 0.0), 1335910091: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 5 /1335910338.Didn't retrieve data . /1335910315.Didn't retrieve data . /1335910287.Didn't retrieve data . /1335910101.Didn't retrieve data . /1335910091.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.017451047897338867 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.84341287612915 time spend to save output : 0.01782393455505371 total time spend for step 4 : 26.861236810684204 step5:crop_condition Sun Feb 9 04:21:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 451 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 177 About to insert : list_path_to_insert length 177 new photo from crops ! About to upload 177 photos upload in portfolio : 4869462 init cache_photo without model_param we have 177 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739071306_1796960 we have uploaded 177 photos in the portfolio 4869462 time of upload the photos Elapsed time : 61.99061965942383 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 4869462 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739071371_1796960 we have uploaded 54 photos in the portfolio 4869462 time of upload the photos Elapsed time : 22.76942276954651 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739071395_1796960 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.178727388381958 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 55 About to insert : list_path_to_insert length 55 new photo from crops ! About to upload 55 photos upload in portfolio : 4869462 init cache_photo without model_param we have 55 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739071402_1796960 we have uploaded 55 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.62460970878601 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 300 /1336021380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336021750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 905 time used for this insertion : 0.05251574516296387 save_final save missing photos in datou_result : time spend for datou_step_exec : 115.6575379371643 time spend to save output : 0.0613245964050293 total time spend for step 5 : 115.71886253356934 step6:thcl Sun Feb 9 04:23:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01682424545288086 time to convert the images to numpy array : 0.08684587478637695 time to import caffe and check if the image exist : 0.02166748046875 time to convert the images to numpy array : 0.0816197395324707 time to import caffe and check if the image exist : 0.014014959335327148 time to convert the images to numpy array : 0.08961677551269531 time to import caffe and check if the image exist : 0.015487194061279297 time to convert the images to numpy array : 0.0963437557220459 time to import caffe and check if the image exist : 0.027361392974853516 time to convert the images to numpy array : 0.08683395385742188 time to import caffe and check if the image exist : 0.017165184020996094 time to convert the images to numpy array : 0.10431027412414551 time to import caffe and check if the image exist : 0.029795169830322266 time to convert the images to numpy array : 0.09251809120178223 time to import caffe and check if the image exist : 0.018857240676879883 time to convert the images to numpy array : 0.10383963584899902 time to import caffe and check if the image exist : 0.020270824432373047 time to convert the images to numpy array : 0.10317039489746094 time to import caffe and check if the image exist : 0.01631021499633789 time to convert the images to numpy array : 0.10931658744812012 total time to convert the images to numpy array : 0.333646297454834 list photo_ids error: [] list photo_ids correct : [1336021380, 1336021381, 1336021382, 1336021383, 1336021384, 1336021386, 1336021387, 1336021388, 1336021389, 1336021390, 1336021391, 1336021392, 1336021393, 1336021394, 1336021395, 1336021396, 1336021397, 1336021398, 1336021399, 1336021400, 1336021401, 1336021402, 1336021403, 1336021404, 1336021405, 1336021406, 1336021407, 1336021408, 1336021409, 1336021410, 1336021474, 1336021475, 1336021476, 1336021477, 1336021478, 1336021479, 1336021480, 1336021481, 1336021482, 1336021483, 1336021484, 1336021485, 1336021486, 1336021487, 1336021488, 1336021489, 1336021490, 1336021491, 1336021492, 1336021494, 1336021495, 1336021496, 1336021497, 1336021498, 1336021499, 1336021500, 1336021501, 1336021502, 1336021504, 1336021505, 1336021506, 1336021507, 1336021508, 1336021509, 1336021510, 1336021512, 1336021513, 1336021514, 1336021515, 1336021516, 1336021517, 1336021518, 1336021519, 1336021520, 1336021521, 1336021522, 1336021523, 1336021524, 1336021525, 1336021526, 1336021527, 1336021528, 1336021529, 1336021530, 1336021531, 1336021532, 1336021533, 1336021534, 1336021535, 1336021536, 1336021720, 1336021721, 1336021722, 1336021723, 1336021724, 1336021725, 1336021726, 1336021727, 1336021728, 1336021729, 1336021730, 1336021731, 1336021732, 1336021733, 1336021734, 1336021736, 1336021737, 1336021738, 1336021739, 1336021740, 1336021741, 1336021742, 1336021743, 1336021744, 1336021745, 1336021746, 1336021747, 1336021748, 1336021749, 1336021750, 1336021614, 1336021616, 1336021617, 1336021618, 1336021619, 1336021621, 1336021622, 1336021623, 1336021624, 1336021625, 1336021626, 1336021627, 1336021628, 1336021629, 1336021630, 1336021631, 1336021632, 1336021633, 1336021634, 1336021635, 1336021640, 1336021643, 1336021644, 1336021645, 1336021646, 1336021647, 1336021648, 1336021649, 1336021650, 1336021651, 1336021442, 1336021443, 1336021444, 1336021445, 1336021446, 1336021447, 1336021448, 1336021449, 1336021450, 1336021451, 1336021452, 1336021453, 1336021454, 1336021455, 1336021456, 1336021457, 1336021459, 1336021460, 1336021462, 1336021463, 1336021464, 1336021465, 1336021466, 1336021467, 1336021468, 1336021469, 1336021470, 1336021471, 1336021472, 1336021473, 1336021411, 1336021412, 1336021413, 1336021414, 1336021415, 1336021416, 1336021417, 1336021418, 1336021420, 1336021421, 1336021422, 1336021423, 1336021424, 1336021425, 1336021426, 1336021427, 1336021428, 1336021429, 1336021430, 1336021431, 1336021432, 1336021433, 1336021434, 1336021435, 1336021436, 1336021437, 1336021438, 1336021439, 1336021440, 1336021441, 1336021537, 1336021538, 1336021540, 1336021541, 1336021542, 1336021543, 1336021544, 1336021545, 1336021546, 1336021547, 1336021549, 1336021551, 1336021554, 1336021555, 1336021556, 1336021557, 1336021558, 1336021559, 1336021560, 1336021561, 1336021562, 1336021563, 1336021564, 1336021565, 1336021566, 1336021567, 1336021568, 1336021608, 1336021609, 1336021612, 1336021684, 1336021685, 1336021686, 1336021687, 1336021688, 1336021694, 1336021695, 1336021696, 1336021697, 1336021698, 1336021699, 1336021700, 1336021701, 1336021702, 1336021703, 1336021704, 1336021705, 1336021706, 1336021707, 1336021708, 1336021709, 1336021710, 1336021711, 1336021712, 1336021713, 1336021715, 1336021716, 1336021717, 1336021718, 1336021719, 1336021652, 1336021653, 1336021654, 1336021655, 1336021656, 1336021657, 1336021658, 1336021659, 1336021660, 1336021661, 1336021662, 1336021663, 1336021664, 1336021665, 1336021666, 1336021667, 1336021668, 1336021669, 1336021671, 1336021672, 1336021673, 1336021675, 1336021676, 1336021677, 1336021678, 1336021679, 1336021680, 1336021681, 1336021682, 1336021683] number of photos to traite : 300 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.3541274070739746 time used to do the prediction : 1.0325684547424316 save descriptor for thcl : 3237 time to traite the descriptors : 1.666558027267456 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336021380 To insert : 1336021381 To insert : 1336021382 To insert : 1336021383 To insert : 1336021384 To insert : 1336021386 To insert : 1336021387 To insert : 1336021388 To insert : 1336021389 To insert : 1336021390 To insert : 1336021391 To insert : 1336021392 To insert : 1336021393 To insert : 1336021394 To insert : 1336021395 To insert : 1336021396 To insert : 1336021397 To insert : 1336021398 To insert : 1336021399 To insert : 1336021400 To insert : 1336021401 To insert : 1336021402 To insert : 1336021403 To insert : 1336021404 To insert : 1336021405 To insert : 1336021406 To insert : 1336021407 To insert : 1336021408 To insert : 1336021409 To insert : 1336021410 To insert : 1336021474 To insert : 1336021475 To insert : 1336021476 To insert : 1336021477 To insert : 1336021478 To insert : 1336021479 To insert : 1336021480 To insert : 1336021481 To insert : 1336021482 To insert : 1336021483 To insert : 1336021484 To insert : 1336021485 To insert : 1336021486 To insert : 1336021487 To insert : 1336021488 To insert : 1336021489 To insert : 1336021490 To insert : 1336021491 To insert : 1336021492 To insert : 1336021494 To insert : 1336021495 To insert : 1336021496 To insert : 1336021497 To insert : 1336021498 To insert : 1336021499 To insert : 1336021500 To insert : 1336021501 To insert : 1336021502 To insert : 1336021504 To insert : 1336021505 To insert : 1336021506 To insert : 1336021507 To insert : 1336021508 To insert : 1336021509 To insert : 1336021510 To insert : 1336021512 To insert : 1336021513 To insert : 1336021514 To insert : 1336021515 To insert : 1336021516 To insert : 1336021517 To insert : 1336021518 To insert : 1336021519 To insert : 1336021520 To insert : 1336021521 To insert : 1336021522 To insert : 1336021523 To insert : 1336021524 To insert : 1336021525 To insert : 1336021526 To insert : 1336021527 To insert : 1336021528 To insert : 1336021529 To insert : 1336021530 To insert : 1336021531 To insert : 1336021532 To insert : 1336021533 To insert : 1336021534 To insert : 1336021535 To insert : 1336021536 To insert : 1336021720 To insert : 1336021721 To insert : 1336021722 To insert : 1336021723 To insert : 1336021724 To insert : 1336021725 To insert : 1336021726 To insert : 1336021727 To insert : 1336021728 To insert : 1336021729 To insert : 1336021730 To insert : 1336021731 To insert : 1336021732 To insert : 1336021733 To insert : 1336021734 To insert : 1336021736 To insert : 1336021737 To insert : 1336021738 To insert : 1336021739 To insert : 1336021740 To insert : 1336021741 To insert : 1336021742 To insert : 1336021743 To insert : 1336021744 To insert : 1336021745 To insert : 1336021746 To insert : 1336021747 To insert : 1336021748 To insert : 1336021749 To insert : 1336021750 To insert : 1336021614 To insert : 1336021616 To insert : 1336021617 To insert : 1336021618 To insert : 1336021619 To insert : 1336021621 To insert : 1336021622 To insert : 1336021623 To insert : 1336021624 To insert : 1336021625 To insert : 1336021626 To insert : 1336021627 To insert : 1336021628 To insert : 1336021629 To insert : 1336021630 To insert : 1336021631 To insert : 1336021632 To insert : 1336021633 To insert : 1336021634 To insert : 1336021635 To insert : 1336021640 To insert : 1336021643 To insert : 1336021644 To insert : 1336021645 To insert : 1336021646 To insert : 1336021647 To insert : 1336021648 To insert : 1336021649 To insert : 1336021650 To insert : 1336021651 To insert : 1336021442 To insert : 1336021443 To insert : 1336021444 To insert : 1336021445 To insert : 1336021446 To insert : 1336021447 To insert : 1336021448 To insert : 1336021449 To insert : 1336021450 To insert : 1336021451 To insert : 1336021452 To insert : 1336021453 To insert : 1336021454 To insert : 1336021455 To insert : 1336021456 To insert : 1336021457 To insert : 1336021459 To insert : 1336021460 To insert : 1336021462 To insert : 1336021463 To insert : 1336021464 To insert : 1336021465 To insert : 1336021466 To insert : 1336021467 To insert : 1336021468 To insert : 1336021469 To insert : 1336021470 To insert : 1336021471 To insert : 1336021472 To insert : 1336021473 To insert : 1336021411 To insert : 1336021412 To insert : 1336021413 To insert : 1336021414 To insert : 1336021415 To insert : 1336021416 To insert : 1336021417 To insert : 1336021418 To insert : 1336021420 To insert : 1336021421 To insert : 1336021422 To insert : 1336021423 To insert : 1336021424 To insert : 1336021425 To insert : 1336021426 To insert : 1336021427 To insert : 1336021428 To insert : 1336021429 To insert : 1336021430 To insert : 1336021431 To insert : 1336021432 To insert : 1336021433 To insert : 1336021434 To insert : 1336021435 To insert : 1336021436 To insert : 1336021437 To insert : 1336021438 To insert : 1336021439 To insert : 1336021440 To insert : 1336021441 To insert : 1336021537 To insert : 1336021538 To insert : 1336021540 To insert : 1336021541 To insert : 1336021542 To insert : 1336021543 To insert : 1336021544 To insert : 1336021545 To insert : 1336021546 To insert : 1336021547 To insert : 1336021549 To insert : 1336021551 To insert : 1336021554 To insert : 1336021555 To insert : 1336021556 To insert : 1336021557 To insert : 1336021558 To insert : 1336021559 To insert : 1336021560 To insert : 1336021561 To insert : 1336021562 To insert : 1336021563 To insert : 1336021564 To insert : 1336021565 To insert : 1336021566 To insert : 1336021567 To insert : 1336021568 To insert : 1336021608 To insert : 1336021609 To insert : 1336021612 To insert : 1336021684 To insert : 1336021685 To insert : 1336021686 To insert : 1336021687 To insert : 1336021688 To insert : 1336021694 To insert : 1336021695 To insert : 1336021696 To insert : 1336021697 To insert : 1336021698 To insert : 1336021699 To insert : 1336021700 To insert : 1336021701 To insert : 1336021702 To insert : 1336021703 To insert : 1336021704 To insert : 1336021705 To insert : 1336021706 To insert : 1336021707 To insert : 1336021708 To insert : 1336021709 To insert : 1336021710 To insert : 1336021711 To insert : 1336021712 To insert : 1336021713 To insert : 1336021715 To insert : 1336021716 To insert : 1336021717 To insert : 1336021718 To insert : 1336021719 To insert : 1336021652 To insert : 1336021653 To insert : 1336021654 To insert : 1336021655 To insert : 1336021656 To insert : 1336021657 To insert : 1336021658 To insert : 1336021659 To insert : 1336021660 To insert : 1336021661 To insert : 1336021662 To insert : 1336021663 To insert : 1336021664 To insert : 1336021665 To insert : 1336021666 To insert : 1336021667 To insert : 1336021668 To insert : 1336021669 To insert : 1336021671 To insert : 1336021672 To insert : 1336021673 To insert : 1336021675 To insert : 1336021676 To insert : 1336021677 To insert : 1336021678 To insert : 1336021679 To insert : 1336021680 To insert : 1336021681 To insert : 1336021682 To insert : 1336021683 time to insert the descriptors : 52.172072410583496 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 485 time used for this insertion : 0.03413677215576172 save missing photos in datou_result : time spend for datou_step_exec : 60.5504686832428 time spend to save output : 0.08457636833190918 total time spend for step 6 : 60.63504505157471 step7:ventilate_hashtags_in_portfolio Sun Feb 9 04:24:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20370953 get user id for portfolio 20370953 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370953 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','environnement','autre','mal_croppe','pet_clair','refus','flou','Carton','pehd','PEHD','PET_clair','metal','Tetrapak','PET_fonce','carton','Film_plastique','Papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370953 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','environnement','autre','mal_croppe','pet_clair','refus','flou','Carton','pehd','PEHD','PET_clair','metal','Tetrapak','PET_fonce','carton','Film_plastique','Papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370953 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','environnement','autre','mal_croppe','pet_clair','refus','flou','Carton','pehd','PEHD','PET_clair','metal','Tetrapak','PET_fonce','carton','Film_plastique','Papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370953 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','environnement','autre','mal_croppe','pet_clair','refus','flou','Carton','pehd','PEHD','PET_clair','metal','Tetrapak','PET_fonce','carton','Film_plastique','Papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20371245,20371251,20371228,20371229,20371230,20371239,20371232,20371233,20371247,20371237,20371241,20371243,20371249?tags=pet_fonce,papier,environnement,autre,mal_croppe,pet_clair,refus,flou,carton,pehd,metal,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20370953 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 1 /20370953. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013649225234985352 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4141576290130615 time spend to save output : 0.013906002044677734 total time spend for step 7 : 2.4280636310577393 step8:final Sun Feb 9 04:24:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1335910338: ('0.2483764849836668',), 1335910315: ('0.2483764849836668',), 1335910287: ('0.2483764849836668',), 1335910101: ('0.2483764849836668',), 1335910091: ('0.2483764849836668',)} new output for save of step final : {1335910338: ('0.2483764849836668',), 1335910315: ('0.2483764849836668',), 1335910287: ('0.2483764849836668',), 1335910101: ('0.2483764849836668',), 1335910091: ('0.2483764849836668',)} [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 5 /1335910338.Didn't retrieve data . /1335910315.Didn't retrieve data . /1335910287.Didn't retrieve data . /1335910101.Didn't retrieve data . /1335910091.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014148235321044922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12014031410217285 time spend to save output : 0.014488935470581055 total time spend for step 8 : 0.1346292495727539 step9:velours_tree Sun Feb 9 04:24:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20371245,20371251,20371228,20371229,20371230,20371239,20371232,20371233,20371247,20371237,20371241,20371243,20371249 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371245 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371251 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371228 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371229 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371230 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371239 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371232 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371233 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371247 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371237 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371241 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371243 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20371249 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 300 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 0 0 1 5 0 4 1 1 0 1 3 2 1 1 1 0 1 3 1 1 1 1 1 0 1 0 1 4 3 0 4 0 0 4 0 5 0 0 1 1 1 1 0 0 2 1 0 1 3 4 2 1 1 1 0 1 0 0 1 0 4 1 0 4 1 4 0 0 5 4 0 0 1 0 4 2 1 0 1 2 1 1 1 1 1 0 0 1 1 4 1 4 4 0 1 0 1 0 2 4 3 4 1 0 0 1 0 5 0 0 1 1 2 1 0 1 0 1 3 4 2 0 1 1 1 1 0 1 3 0 1 1 1 4 2 4 0 1 0 0 2 1 4 1 0 0 1 1 0 0 5 0 1 1 1 0 4 1 0 1 4 1 1 1 0 3 0 0 1 4 4 0 0 4 0 0 3 1 0 0 0 1 1 1 1 1 0 2 3 0 0 0 1 1 1 0 0 2 3 0 1 4 0 0 2 1 1 0 1 0 0 4 3 0 4 2 0 1 1 1 1 3 0 0 1 1 1 1 1 2 0 3 4 3 4 0 3 4 0 0 3 3 0 4 4 3 3 1 2 2 1 0 0 1 4 3 4 4 3 3 0 1 4 1 0 1 1 1 4 3 4 4 4 3 3 0 1 4 3 3 1 3 4 1 1 4 3 4 0 4 3 3 3 2 0 1 4 3 4] Elapsed time: 0.045069217681884766 graph_id used : 77190 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20371245,20371251,20371228,20371229,20371230,20371239,20371232,20371233,20371247,20371237,20371241,20371243,20371249?tags=pet_fonce,papier,environnement,autre,mal_croppe,pet_clair,refus,flou,carton,pehd,metal,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20370953&tree_id=77190 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 1 /20370953Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01314544677734375 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.423956871032715 time spend to save output : 0.01336669921875 total time spend for step 9 : 19.437323570251465 step10:send_mail_cod Sun Feb 9 04:25:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf 20371213 imagette203712131739071501 20371219 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203712191739071501 20371193 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203711931739071502 20371194 imagette203711941739071503 20371207 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203712071739071503 20371197 imagette203711971739071503 20371199 imagette203711991739071503 20371215 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203712151739071503 20371205 imagette203712051739071504 20371209 imagette203712091739071504 20371211 imagette203712111739071504 20371217 imagette203712171739071504 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20370953 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20371245,20371251,20371228,20371229,20371230,20371239,20371232,20371233,20371247,20371237,20371241,20371243,20371249?tags=pet_fonce,papier,environnement,autre,mal_croppe,pet_clair,refus,flou,carton,pehd,metal,tetrapak,film_plastique&datou_id_consolidate=4235&port_consolidate=20370953&tree_id=77190 your option no_mail is active, we will not send the real mail to your client args[1335910338] : ((1335910338, -7.457482949071309, 492609224), (1335910338, -0.3532171251221223, 496442774), '0.2483764849836668') apple ((1335910338, -7.457482949071309, 492609224), (1335910338, -0.3532171251221223, 496442774), '0.2483764849836668') We are sending mail with results at cod@fotonower.com args[1335910315] : ((1335910315, -7.346552941832464, 492609224), (1335910315, -0.38726937588256954, 496442774), '0.2483764849836668') apple ((1335910315, -7.346552941832464, 492609224), (1335910315, -0.38726937588256954, 496442774), '0.2483764849836668') We are sending mail with results at cod@fotonower.com args[1335910287] : ((1335910287, -7.319548027113676, 492609224), (1335910287, -0.3423452554715146, 496442774), '0.2483764849836668') apple ((1335910287, -7.319548027113676, 492609224), (1335910287, -0.3423452554715146, 496442774), '0.2483764849836668') We are sending mail with results at cod@fotonower.com args[1335910101] : ((1335910101, -7.3275806666965435, 492609224), (1335910101, -0.18317133814816697, 496442774), '0.2483764849836668') apple ((1335910101, -7.3275806666965435, 492609224), (1335910101, -0.18317133814816697, 496442774), '0.2483764849836668') We are sending mail with results at cod@fotonower.com args[1335910091] : ((1335910091, -7.39332867268216, 492609224), (1335910091, -0.14654511358479555, 496442774), '0.2483764849836668') apple ((1335910091, -7.39332867268216, 492609224), (1335910091, -0.14654511358479555, 496442774), '0.2483764849836668') We are sending mail with results at cod@fotonower.com refus_total : 0.2483764849836668 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20370953 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20370953','results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf','pdf','','0.19','0.2483764849836668') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.015355587005615234 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.454381227493286 time spend to save output : 0.0157468318939209 total time spend for step 10 : 4.470128059387207 step11:split_time_score Sun Feb 9 04:25:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08022025 20370953 Nombre de photos uploadées : 10 / 23040 (0%) 08022025 20370953 Nombre de photos taguées (types de déchets): 10 / 10 (100%) 08022025 20370953 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005145072937011719 elapsed_time : insert_dashboard_record_day_entry 0.023413419723510742 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.27818061637536023 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362227_08-02-2025_16_34_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362227 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362227 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362228 order by id desc limit 1 Qualite : 0.22223092092802155 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362229_08-02-2025_16_10_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362229 AND mptpi.`type`=4230 To do Qualite : 0.25971977410426256 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362230_08-02-2025_16_23_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362230 AND mptpi.`type`=4230 To do Qualite : 0.22386833870804138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362231_08-02-2025_16_24_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362231 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362470 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362471 order by id desc limit 1 Qualite : 0.30816875834790897 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362472_08-02-2025_17_23_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362472 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362473 order by id desc limit 1 Qualite : 0.2988485025853143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362474_08-02-2025_17_35_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362474 AND mptpi.`type`=4230 To do Qualite : 0.30213882478687565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362475_08-02-2025_16_47_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362475 AND mptpi.`type`=4230 To do Qualite : 0.2594528173100419 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362476_08-02-2025_17_17_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362476 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363408 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363409 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363410 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363411 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362961 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362962 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362963 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362964 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362965 order by id desc limit 1 Qualite : 0.31289641168099197 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362966_08-02-2025_17_47_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362966 AND mptpi.`type`=4230 To do Qualite : 0.2899477401744621 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20362967_08-02-2025_17_35_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20362967 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20362967 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363412 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363413 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363414 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363415 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363416 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363417 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363418 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363419 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363420 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363422 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363425 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363426 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363428 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363429 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363430 order by id desc limit 1 Qualite : 0.23458389361290446 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363431_08-02-2025_18_23_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363431 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363431 AND mptpi.`type`=4230 To do Qualite : 0.33019615792095425 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363432_08-02-2025_18_33_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363432 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363432 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363782 order by id desc limit 1 Qualite : 0.3050723250260371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363783_08-02-2025_20_33_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363783 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363783 AND mptpi.`type`=4230 To do Qualite : 0.284163315237253 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363784_08-02-2025_20_58_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363784 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363784 AND mptpi.`type`=4230 To do Qualite : 0.2606545044769342 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363785_08-02-2025_19_49_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363785 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363785 AND mptpi.`type`=4230 To do Qualite : 0.266668048335223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363786_08-02-2025_21_33_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363786 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363786 AND mptpi.`type`=4230 To do Qualite : 0.2395584206635648 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363787_08-02-2025_19_33_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363787 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363787 AND mptpi.`type`=4230 To do Qualite : 0.2238459498269027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20363788_08-02-2025_18_47_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20363788 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20363788 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370952 order by id desc limit 1 Qualite : 0.2483764849836668 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370953_09-02-2025_04_25_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370953 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370953 AND mptpi.`type`=4230 To do Qualite : 0.30222034476794823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370954_09-02-2025_04_13_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370954 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370954 AND mptpi.`type`=4230 To do Qualite : 0.25915799589180577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370955_09-02-2025_04_20_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370955 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370955 AND mptpi.`type`=4230 To do Qualite : 0.2558362079089241 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20370956_09-02-2025_04_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20370956 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20370956 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08022025': {'nb_upload': 10, 'nb_taggue_class': 10, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1335910338, 1335910315, 1335910287, 1335910101, 1335910091] Looping around the photos to save general results len do output : 1 /20370953Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910338', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910315', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910287', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910101', None, None, None, None, None, '2569664') ('4234', None, None, None, None, None, None, None, '2569664') ('4234', '20370953', '1335910091', None, None, None, None, None, '2569664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.04190230369567871 save_final save missing photos in datou_result : time spend for datou_step_exec : 28.262186765670776 time spend to save output : 0.04211115837097168 total time spend for step 11 : 28.304297924041748 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 58.29user 36.62system 5:08.57elapsed 30%CPU (0avgtext+0avgdata 2544932maxresident)k 2168inputs+23864outputs (22major+3485435minor)pagefaults 0swaps