python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3237071 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 62>5 please execute split_portfolio.py -i 20940738 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2625050'] with mtr_portfolio_ids : ['20940738'] and first list_photo_ids : [] new path : /proc/3237071/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.6818766593933105 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 28 22:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-28 22:20:32.384795: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-28 22:20:32.411254: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-28 22:20:32.413323: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f68bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-28 22:20:32.413387: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-28 22:20:32.417411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-28 22:20:32.708679: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x38249f40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-28 22:20:32.708727: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-28 22:20:32.709399: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 22:20:32.709766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 22:20:32.711927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 22:20:32.714250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 22:20:32.714687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 22:20:32.717069: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 22:20:32.718313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 22:20:32.723418: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 22:20:32.724777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 22:20:32.724893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 22:20:32.725568: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 22:20:32.725592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 22:20:32.725603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 22:20:32.727278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4478 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-28 22:20:33.141293: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 22:20:33.141393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 22:20:33.141415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 22:20:33.141433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 22:20:33.141452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 22:20:33.141470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 22:20:33.141488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 22:20:33.141506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 22:20:33.142737: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 22:20:33.144151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 22:20:33.144218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 22:20:33.144249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 22:20:33.144277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 22:20:33.144304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 22:20:33.144330: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 22:20:33.144356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 22:20:33.144386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 22:20:33.145574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 22:20:33.145612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 22:20:33.145621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 22:20:33.145629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 22:20:33.146654: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4478 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-28 22:20:42.053585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 22:20:42.277982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 22:20:44.052254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.052849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.49G (3744556544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.053328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.14G (3370100736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.053791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.82G (3033090560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.054261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.54G (2729781504 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.054727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.29G (2456803328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.054760: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.055287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.055307: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.062339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.062362: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.062871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.062887: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.069391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.069416: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.069940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.069957: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.101906: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.101962: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.102474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.102491: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.108313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.108347: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.108855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.108871: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-28 22:20:44.142286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.142845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.144702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.145222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.187942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.188483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.190585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.191137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.220461: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.221026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.222645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.223201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.230128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.230668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.232469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.232984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.239792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.240342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.242022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.242555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.273644: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.274201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.274926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.275455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.279538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.280079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.298631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.299238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.299756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.300266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.315988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.316557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.317096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.317616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.322613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.323196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.328436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.329020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.342035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.342600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.346844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.347419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.347954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.348487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.349313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.349846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.360800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.361348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.361896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.362414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.362974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.363500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.364029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.364560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.374164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.374759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.381155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.381711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.417547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.417623: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-28 22:20:44.418407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.419263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.426745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.427593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.428401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.429173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.438326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.439173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.459647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.460222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.460776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.461286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.465279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.465768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.466273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.466759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.468751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.477809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.478304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.487292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.487814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.488299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.488774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.489257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-28 22:20:44.489781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.87G (4160618496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.62188 max: 144.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 797 time to create 1 rle with old method : 0.001661539077758789 length of segment : 37 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.019143104553222656 length of segment : 41 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0017292499542236328 length of segment : 33 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0018038749694824219 length of segment : 37 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0017788410186767578 length of segment : 32 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 938 time to create 1 rle with old method : 0.0018565654754638672 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.21563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 1880 time to create 1 rle with old method : 0.003625154495239258 length of segment : 38 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0021343231201171875 length of segment : 58 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00027871131896972656 length of segment : 23 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0009212493896484375 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 59.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -60.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 552 time to create 1 rle with old method : 0.0008389949798583984 length of segment : 25 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005567073822021484 length of segment : 28 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 959 time to create 1 rle with old method : 0.00133514404296875 length of segment : 48 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 934 time to create 1 rle with old method : 0.0012774467468261719 length of segment : 34 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 962 time to create 1 rle with old method : 0.0013818740844726562 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0006399154663085938 length of segment : 16 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 1992 time to create 1 rle with old method : 0.0040471553802490234 length of segment : 92 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 1850 time to create 1 rle with old method : 0.003401041030883789 length of segment : 86 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0022361278533935547 length of segment : 83 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0009915828704833984 length of segment : 19 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0019447803497314453 length of segment : 79 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0009415149688720703 length of segment : 74 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.00104522705078125 length of segment : 20 time for calcul the mask position with numpy : 0.0005266666412353516 nb_pixel_total : 46628 time to create 1 rle with old method : 0.06123208999633789 length of segment : 237 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -93.94219 max: 86.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.85469 max: 141.15078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0003917217254638672 nb_pixel_total : 32289 time to create 1 rle with old method : 0.039273738861083984 length of segment : 244 Processing 1 images image shape: (400, 400, 3) min: 66.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -51.08281 max: 150.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0006289482116699219 length of segment : 17 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 27095 time to create 1 rle with old method : 0.03330111503601074 length of segment : 228 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 26056 time to create 1 rle with old method : 0.03739047050476074 length of segment : 230 Processing 1 images image shape: (400, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2032 time to create 1 rle with old method : 0.0026483535766601562 length of segment : 122 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 2456 time to create 1 rle with old method : 0.003407716751098633 length of segment : 34 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 8286 time to create 1 rle with old method : 0.010749340057373047 length of segment : 75 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 23 time for calcul the mask position with numpy : 0.0004825592041015625 nb_pixel_total : 28799 time to create 1 rle with old method : 0.03542447090148926 length of segment : 253 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 1534 time to create 1 rle with old method : 0.0031876564025878906 length of segment : 77 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0007236003875732422 length of segment : 30 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 1463 time to create 1 rle with old method : 0.0031309127807617188 length of segment : 173 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0007278919219970703 length of segment : 30 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 4025 time to create 1 rle with old method : 0.008022785186767578 length of segment : 194 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008900165557861328 length of segment : 71 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.63906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 2748 time to create 1 rle with old method : 0.005551338195800781 length of segment : 97 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0033750534057617188 length of segment : 43 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 2110 time to create 1 rle with old method : 0.004095792770385742 length of segment : 74 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 21740 time to create 1 rle with old method : 0.02729630470275879 length of segment : 168 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2544 time to create 1 rle with old method : 0.0034673213958740234 length of segment : 47 time for calcul the mask position with numpy : 0.0003902912139892578 nb_pixel_total : 21625 time to create 1 rle with old method : 0.029552459716796875 length of segment : 168 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 1677 time to create 1 rle with old method : 0.002275228500366211 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 96.00000 max: 186.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 76.81094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00039005279541015625 length of segment : 17 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 18 time to create 1 rle with old method : 6.723403930664062e-05 length of segment : 15 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.34844 max: 149.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.001186370849609375 length of segment : 27 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.0011162757873535156 length of segment : 27 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0012254714965820312 length of segment : 34 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0016570091247558594 length of segment : 38 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0014386177062988281 length of segment : 31 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1026 time to create 1 rle with old method : 0.001482248306274414 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.96172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2265 time to create 1 rle with old method : 0.0038073062896728516 length of segment : 45 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.00087738037109375 length of segment : 48 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.001355886459350586 length of segment : 25 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0013430118560791016 length of segment : 25 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 3742 time to create 1 rle with old method : 0.005039691925048828 length of segment : 81 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.0012183189392089844 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -74.42656 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0007154941558837891 length of segment : 24 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.001033782958984375 length of segment : 26 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 3437 time to create 1 rle with old method : 0.004705190658569336 length of segment : 88 length of segment : 0 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.00128936767578125 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.62578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003688335418701172 length of segment : 16 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1120 time to create 1 rle with old method : 0.001491546630859375 length of segment : 58 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 722 time to create 1 rle with old method : 0.0012927055358886719 length of segment : 56 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1174 time to create 1 rle with old method : 0.001482248306274414 length of segment : 77 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0009133815765380859 length of segment : 17 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.001081228256225586 length of segment : 18 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.001592874526977539 length of segment : 91 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 58834 time to create 1 rle with old method : 0.07583403587341309 length of segment : 294 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.00045013427734375 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -97.00078 max: 86.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -98.34687 max: 135.68594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 32632 time to create 1 rle with old method : 0.03878450393676758 length of segment : 255 Processing 1 images image shape: (400, 400, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -65.50469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0007126331329345703 length of segment : 18 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 11 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 24054 time to create 1 rle with old method : 0.028594017028808594 length of segment : 232 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 13095 time to create 1 rle with old method : 0.01586604118347168 length of segment : 202 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.91875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 2301 time to create 1 rle with old method : 0.003070831298828125 length of segment : 35 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 2075 time to create 1 rle with old method : 0.0026547908782958984 length of segment : 131 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 24896 time to create 1 rle with old method : 0.03009033203125 length of segment : 378 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1258 time to create 1 rle with old method : 0.0017178058624267578 length of segment : 50 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 7045 time to create 1 rle with old method : 0.008747577667236328 length of segment : 72 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 30906 time to create 1 rle with old method : 0.0369873046875 length of segment : 310 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0019237995147705078 length of segment : 74 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004856586456298828 length of segment : 29 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 29 time for calcul the mask position with numpy : 0.00015497207641601562 nb_pixel_total : 3527 time to create 1 rle with old method : 0.004510641098022461 length of segment : 174 time for calcul the mask position with numpy : 0.00020551681518554688 nb_pixel_total : 3940 time to create 1 rle with old method : 0.005032062530517578 length of segment : 200 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00033164024353027344 length of segment : 16 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0005517005920410156 length of segment : 56 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 1741 time to create 1 rle with old method : 0.003378152847290039 length of segment : 41 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 2467 time to create 1 rle with old method : 0.009303092956542969 length of segment : 93 time for calcul the mask position with numpy : 0.0005013942718505859 nb_pixel_total : 15632 time to create 1 rle with old method : 0.029139995574951172 length of segment : 259 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 2995 time to create 1 rle with old method : 0.003834962844848633 length of segment : 88 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 2886 time to create 1 rle with old method : 0.0037903785705566406 length of segment : 50 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1976 time to create 1 rle with old method : 0.0027604103088378906 length of segment : 90 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004296302795410156 length of segment : 18 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005583763122558594 length of segment : 35 Processing 1 images image shape: (280, 400, 3) min: 103.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 80.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.95937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0004222393035888672 length of segment : 59 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003879070281982422 length of segment : 17 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 17 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 28 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.34844 max: 145.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0012524127960205078 length of segment : 34 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0011031627655029297 length of segment : 38 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0010635852813720703 length of segment : 32 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 932 time to create 1 rle with old method : 0.0012059211730957031 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.77422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 2128 time to create 1 rle with old method : 0.0038406848907470703 length of segment : 43 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 672 time to create 1 rle with old method : 0.0014815330505371094 length of segment : 16 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0029964447021484375 length of segment : 33 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.0026497840881347656 length of segment : 28 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0008037090301513672 length of segment : 33 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0016787052154541016 length of segment : 23 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.002011537551879883 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -79.86797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0011243820190429688 length of segment : 23 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0006053447723388672 length of segment : 23 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008299350738525391 length of segment : 26 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005567073822021484 length of segment : 27 length of segment : 0 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.001249074935913086 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.94609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00038242340087890625 length of segment : 17 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 25 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007317066192626953 length of segment : 39 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1235 time to create 1 rle with old method : 0.0016884803771972656 length of segment : 52 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.65469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0014872550964355469 length of segment : 79 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007543563842773438 length of segment : 20 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.00072479248046875 length of segment : 19 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00043511390686035156 length of segment : 31 time for calcul the mask position with numpy : 0.0006506443023681641 nb_pixel_total : 60833 time to create 1 rle with old method : 0.07091331481933594 length of segment : 290 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -93.13359 max: 83.39687 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -80.78984 max: 133.09219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 11203 time to create 1 rle with old method : 0.013454914093017578 length of segment : 172 time for calcul the mask position with numpy : 0.00034236907958984375 nb_pixel_total : 27107 time to create 1 rle with old method : 0.031804561614990234 length of segment : 198 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1476 time to create 1 rle with old method : 0.002046823501586914 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 60.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -57.37969 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0008766651153564453 length of segment : 18 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 26208 time to create 1 rle with old method : 0.03160977363586426 length of segment : 248 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2013 time to create 1 rle with old method : 0.00255584716796875 length of segment : 123 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0042133331298828125 length of segment : 36 time for calcul the mask position with numpy : 0.00015163421630859375 nb_pixel_total : 3202 time to create 1 rle with old method : 0.0051805973052978516 length of segment : 99 time for calcul the mask position with numpy : 0.0010781288146972656 nb_pixel_total : 55513 time to create 1 rle with old method : 0.07379794120788574 length of segment : 631 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0016453266143798828 length of segment : 48 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 717 time to create 1 rle with old method : 0.0010540485382080078 length of segment : 44 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 30 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00037670135498046875 length of segment : 24 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0018768310546875 length of segment : 72 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 1284 time to create 1 rle with old method : 0.0021371841430664062 length of segment : 178 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005171298980712891 length of segment : 30 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 4021 time to create 1 rle with old method : 0.00494074821472168 length of segment : 201 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 3683 time to create 1 rle with old method : 0.004527568817138672 length of segment : 180 time for calcul the mask position with numpy : 0.00019168853759765625 nb_pixel_total : 3274 time to create 1 rle with old method : 0.004210233688354492 length of segment : 175 Processing 1 images image shape: (280, 400, 3) min: 7.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.63516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1769 time to create 1 rle with old method : 0.0023941993713378906 length of segment : 42 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 2109 time to create 1 rle with old method : 0.0029304027557373047 length of segment : 90 time for calcul the mask position with numpy : 0.0003542900085449219 nb_pixel_total : 24580 time to create 1 rle with old method : 0.031538963317871094 length of segment : 195 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2183 time to create 1 rle with old method : 0.002865314483642578 length of segment : 99 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 2842 time to create 1 rle with old method : 0.003563404083251953 length of segment : 47 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00019788742065429688 length of segment : 26 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0020711421966552734 length of segment : 83 Processing 1 images image shape: (280, 400, 3) min: 71.00000 max: 205.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 91.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002110004425048828 length of segment : 13 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00030231475830078125 length of segment : 17 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.00017380714416503906 length of segment : 30 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.90703 max: 149.19375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.0010132789611816406 length of segment : 31 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.0011377334594726562 length of segment : 38 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.001260995864868164 length of segment : 34 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 999 time to create 1 rle with old method : 0.0013856887817382812 length of segment : 32 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0010974407196044922 length of segment : 33 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.001294851303100586 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.70391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1055 time to create 1 rle with old method : 0.001482248306274414 length of segment : 52 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1824 time to create 1 rle with old method : 0.0024285316467285156 length of segment : 40 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0008013248443603516 length of segment : 29 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.00057220458984375 length of segment : 26 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0009856224060058594 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 2 time to create 1 rle with old method : 1.8835067749023438e-05 length of segment : 2 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0009722709655761719 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -73.78594 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0007140636444091797 length of segment : 23 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0012753009796142578 length of segment : 50 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 700 time to create 1 rle with old method : 0.0009667873382568359 length of segment : 51 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1002 time to create 1 rle with old method : 0.0013341903686523438 length of segment : 45 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.001982450485229492 length of segment : 35 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00048470497131347656 length of segment : 27 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.001425027847290039 length of segment : 27 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0004265308380126953 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.27031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 15 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0008132457733154297 length of segment : 27 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0010712146759033203 length of segment : 41 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007174015045166016 length of segment : 40 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006918907165527344 length of segment : 27 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 4417 time to create 1 rle with old method : 0.0058057308197021484 length of segment : 71 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0017547607421875 length of segment : 109 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 3309 time to create 1 rle with old method : 0.004378557205200195 length of segment : 70 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 749 time to create 1 rle with old method : 0.0011067390441894531 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.26016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0011086463928222656 length of segment : 19 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0023393630981445312 length of segment : 78 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0006515979766845703 length of segment : 31 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.003725290298461914 length of segment : 45 time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 50289 time to create 1 rle with old method : 0.06920504570007324 length of segment : 242 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -95.00859 max: 86.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.67109 max: 136.37734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 8905 time to create 1 rle with old method : 0.011776447296142578 length of segment : 147 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 28054 time to create 1 rle with old method : 0.03472733497619629 length of segment : 256 time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 27293 time to create 1 rle with old method : 0.03393840789794922 length of segment : 189 Processing 1 images image shape: (400, 400, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -55.41484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0007033348083496094 length of segment : 18 time for calcul the mask position with numpy : 0.0003294944763183594 nb_pixel_total : 23488 time to create 1 rle with old method : 0.029193639755249023 length of segment : 222 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 1165 time to create 1 rle with old method : 0.002017974853515625 length of segment : 69 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0002579689025878906 length of segment : 11 time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 25428 time to create 1 rle with old method : 0.03654217720031738 length of segment : 224 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 2245 time to create 1 rle with old method : 0.004026889801025391 length of segment : 134 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 2518 time to create 1 rle with old method : 0.004726409912109375 length of segment : 33 time for calcul the mask position with numpy : 0.0005247592926025391 nb_pixel_total : 25936 time to create 1 rle with old method : 0.04119539260864258 length of segment : 301 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0024917125701904297 length of segment : 149 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.19766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0004324913024902344 length of segment : 24 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.002518177032470703 length of segment : 81 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005400180816650391 length of segment : 29 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0022974014282226562 length of segment : 150 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008082389831542969 length of segment : 36 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 29 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0008671283721923828 length of segment : 43 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 5276 time to create 1 rle with old method : 0.006766796112060547 length of segment : 271 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0021800994873046875 length of segment : 145 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 3659 time to create 1 rle with old method : 0.004545927047729492 length of segment : 186 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1736 time to create 1 rle with old method : 0.002245664596557617 length of segment : 91 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 79.68984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0001442432403564453 nb_pixel_total : 2557 time to create 1 rle with old method : 0.003814220428466797 length of segment : 98 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0019276142120361328 length of segment : 45 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 2688 time to create 1 rle with old method : 0.003507852554321289 length of segment : 106 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 19909 time to create 1 rle with old method : 0.02622222900390625 length of segment : 192 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006129741668701172 length of segment : 27 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 37 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1948 time to create 1 rle with old method : 0.0025780200958251953 length of segment : 89 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 28 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2476 time to create 1 rle with old method : 0.0034880638122558594 length of segment : 93 time for calcul the mask position with numpy : 0.0002732276916503906 nb_pixel_total : 17876 time to create 1 rle with old method : 0.02145552635192871 length of segment : 187 Processing 1 images image shape: (280, 400, 3) min: 80.00000 max: 209.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 87.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0003180503845214844 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.92422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.0010271072387695312 length of segment : 84 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0004401206970214844 length of segment : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0006816387176513672 length of segment : 43 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.00043010711669921875 length of segment : 18 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.0003044605255126953 length of segment : 40 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.63359 max: 149.06094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.0011386871337890625 length of segment : 30 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0009613037109375 length of segment : 33 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0013778209686279297 length of segment : 33 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 957 time to create 1 rle with old method : 0.0012774467468261719 length of segment : 30 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.001317739486694336 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.15313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2177 time to create 1 rle with old method : 0.0028133392333984375 length of segment : 45 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.0010085105895996094 length of segment : 33 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0019059181213378906 length of segment : 32 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 782 time to create 1 rle with old method : 0.0011568069458007812 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.65313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006299018859863281 length of segment : 28 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007214546203613281 length of segment : 25 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0010793209075927734 length of segment : 26 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1094 time to create 1 rle with old method : 0.001589059829711914 length of segment : 23 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 6802 time to create 1 rle with old method : 0.008960723876953125 length of segment : 72 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.19219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00038123130798339844 length of segment : 17 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0007920265197753906 length of segment : 28 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.000720977783203125 length of segment : 26 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 39 time for calcul the mask position with numpy : 0.0001609325408935547 nb_pixel_total : 5723 time to create 1 rle with old method : 0.0073964595794677734 length of segment : 65 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 989 time to create 1 rle with old method : 0.001312255859375 length of segment : 41 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1242 time to create 1 rle with old method : 0.0015981197357177734 length of segment : 50 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 4672 time to create 1 rle with old method : 0.006112575531005859 length of segment : 63 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.32656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0008103847503662109 length of segment : 19 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1190 time to create 1 rle with old method : 0.001561880111694336 length of segment : 85 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0006189346313476562 length of segment : 34 time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 58227 time to create 1 rle with old method : 0.06692814826965332 length of segment : 295 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -97.39531 max: 88.08437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -95.78828 max: 137.29531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 32565 time to create 1 rle with old method : 0.03691363334655762 length of segment : 255 Processing 1 images image shape: (400, 400, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -78.09844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005772113800048828 length of segment : 16 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002391338348388672 length of segment : 20 time for calcul the mask position with numpy : 0.00029778480529785156 nb_pixel_total : 20072 time to create 1 rle with old method : 0.023712635040283203 length of segment : 232 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.83672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 2040 time to create 1 rle with old method : 0.002688884735107422 length of segment : 122 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0017499923706054688 length of segment : 57 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 7749 time to create 1 rle with old method : 0.009917020797729492 length of segment : 70 time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 27014 time to create 1 rle with old method : 0.03513336181640625 length of segment : 296 time for calcul the mask position with numpy : 0.00013375282287597656 nb_pixel_total : 2259 time to create 1 rle with old method : 0.003220796585083008 length of segment : 33 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 211 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 17 time for calcul the mask position with numpy : 0.00025343894958496094 nb_pixel_total : 7264 time to create 1 rle with old method : 0.01072239875793457 length of segment : 71 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 5834 time to create 1 rle with old method : 0.007205009460449219 length of segment : 166 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003390312194824219 length of segment : 25 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1648 time to create 1 rle with old method : 0.0020904541015625 length of segment : 79 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 4100 time to create 1 rle with old method : 0.005064487457275391 length of segment : 195 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004203319549560547 length of segment : 29 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004858970642089844 length of segment : 31 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0016651153564453125 length of segment : 142 Processing 1 images image shape: (280, 400, 3) min: 9.00000 max: 206.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.17422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007061958312988281 length of segment : 63 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1652 time to create 1 rle with old method : 0.002169370651245117 length of segment : 66 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 3229 time to create 1 rle with old method : 0.004321575164794922 length of segment : 99 time for calcul the mask position with numpy : 0.0004801750183105469 nb_pixel_total : 21554 time to create 1 rle with old method : 0.030115842819213867 length of segment : 208 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 3785 time to create 1 rle with old method : 0.007674455642700195 length of segment : 91 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2731 time to create 1 rle with old method : 0.0035066604614257812 length of segment : 92 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 2504 time to create 1 rle with old method : 0.003228902816772461 length of segment : 89 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0016238689422607422 length of segment : 44 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 13 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2724 time to create 1 rle with old method : 0.0035979747772216797 length of segment : 46 Processing 1 images image shape: (280, 400, 3) min: 89.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 86.32266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.50625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 17 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004622936248779297 length of segment : 36 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.000606536865234375 length of segment : 67 Detection mask done ! Trying to reset tf kernel 3237802 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 113 tf kernel not reseted sub process len(results) : 292 len(list_Values) 292 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 292 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1306 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 292 chid ids of type : 4228 Number RLEs to save : 21814 save missing photos in datou_result : time spend for datou_step_exec : 33.39190936088562 time spend to save output : 1.537907600402832 total time spend for step 1 : 34.92981696128845 step2:brightness Fri Feb 28 22:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740777628_3237071_1340207408_2910b95a5b984970b5a4fa34dd98cfda.jpg treat image : temp/1740777628_3237071_1340207406_d7ff97dfec2ad1285fa77918a7a5f167.jpg treat image : temp/1740777628_3237071_1340207403_ab28df211abcf20b2f5c71cc3bc600b8.jpg treat image : temp/1740777628_3237071_1340207401_e457c9ad6cc4d41579ebcf37d1567095.jpg treat image : temp/1740777628_3237071_1340207397_2374f23cf66bd6bab2ab0ac5b40abf5f.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.010654449462890625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011015176773071289 save missing photos in datou_result : time spend for datou_step_exec : 1.1818625926971436 time spend to save output : 0.026393890380859375 total time spend for step 2 : 1.208256483078003 step3:blur_detection Fri Feb 28 22:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740777628_3237071_1340207408_2910b95a5b984970b5a4fa34dd98cfda.jpg resize: (1080, 1920) 1340207408 -6.84732993039094 treat image : temp/1740777628_3237071_1340207406_d7ff97dfec2ad1285fa77918a7a5f167.jpg resize: (1080, 1920) 1340207406 -6.984107571774768 treat image : temp/1740777628_3237071_1340207403_ab28df211abcf20b2f5c71cc3bc600b8.jpg resize: (1080, 1920) 1340207403 -6.8810656943448745 treat image : temp/1740777628_3237071_1340207401_e457c9ad6cc4d41579ebcf37d1567095.jpg resize: (1080, 1920) 1340207401 -7.002170636348977 treat image : temp/1740777628_3237071_1340207397_2374f23cf66bd6bab2ab0ac5b40abf5f.jpg resize: (1080, 1920) 1340207397 -7.087618838386815 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.015788793563842773 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.017444610595703125 save missing photos in datou_result : time spend for datou_step_exec : 4.960818529129028 time spend to save output : 0.037786245346069336 total time spend for step 3 : 4.998604774475098 step4:rle_unique_nms_with_priority Fri Feb 28 22:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 292 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 48 nb_hashtags : 4 time to prepare the origin masks : 1.118523120880127 time for calcul the mask position with numpy : 0.16554999351501465 nb_pixel_total : 1874787 time to create 1 rle with new method : 0.4670255184173584 time for calcul the mask position with numpy : 0.008840799331665039 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006101131439208984 time for calcul the mask position with numpy : 0.010510921478271484 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011262893676757812 time for calcul the mask position with numpy : 0.008703470230102539 nb_pixel_total : 47 time to create 1 rle with old method : 0.00011515617370605469 time for calcul the mask position with numpy : 0.008727073669433594 nb_pixel_total : 18 time to create 1 rle with old method : 9.751319885253906e-05 time for calcul the mask position with numpy : 0.011280298233032227 nb_pixel_total : 44 time to create 1 rle with old method : 0.00024819374084472656 time for calcul the mask position with numpy : 0.009451627731323242 nb_pixel_total : 871 time to create 1 rle with old method : 0.0011112689971923828 time for calcul the mask position with numpy : 0.008985280990600586 nb_pixel_total : 124 time to create 1 rle with old method : 0.00021219253540039062 time for calcul the mask position with numpy : 0.00874471664428711 nb_pixel_total : 3 time to create 1 rle with old method : 3.123283386230469e-05 time for calcul the mask position with numpy : 0.009078264236450195 nb_pixel_total : 797 time to create 1 rle with old method : 0.0010159015655517578 time for calcul the mask position with numpy : 0.008877277374267578 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015997886657714844 time for calcul the mask position with numpy : 0.010389089584350586 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0017969608306884766 time for calcul the mask position with numpy : 0.009410619735717773 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.008914470672607422 nb_pixel_total : 46628 time to create 1 rle with old method : 0.055368661880493164 time for calcul the mask position with numpy : 0.00876474380493164 nb_pixel_total : 1880 time to create 1 rle with old method : 0.002346038818359375 time for calcul the mask position with numpy : 0.008727550506591797 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0015690326690673828 time for calcul the mask position with numpy : 0.008736133575439453 nb_pixel_total : 959 time to create 1 rle with old method : 0.0013303756713867188 time for calcul the mask position with numpy : 0.008831262588500977 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007069110870361328 time for calcul the mask position with numpy : 0.010074377059936523 nb_pixel_total : 179 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.008774995803833008 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.00864410400390625 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0013320446014404297 time for calcul the mask position with numpy : 0.00851130485534668 nb_pixel_total : 1992 time to create 1 rle with old method : 0.0024518966674804688 time for calcul the mask position with numpy : 0.008646011352539062 nb_pixel_total : 26 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.008626461029052734 nb_pixel_total : 58 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.008638143539428711 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006077289581298828 time for calcul the mask position with numpy : 0.008591175079345703 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005102157592773438 time for calcul the mask position with numpy : 0.008510828018188477 nb_pixel_total : 2456 time to create 1 rle with old method : 0.0031516551971435547 time for calcul the mask position with numpy : 0.008631229400634766 nb_pixel_total : 28799 time to create 1 rle with old method : 0.03522038459777832 time for calcul the mask position with numpy : 0.008888006210327148 nb_pixel_total : 78 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.008730411529541016 nb_pixel_total : 27095 time to create 1 rle with old method : 0.0318753719329834 time for calcul the mask position with numpy : 0.00863027572631836 nb_pixel_total : 167 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.008705377578735352 nb_pixel_total : 32289 time to create 1 rle with old method : 0.0373997688293457 time for calcul the mask position with numpy : 0.008639812469482422 nb_pixel_total : 15 time to create 1 rle with old method : 5.269050598144531e-05 time for calcul the mask position with numpy : 0.008483648300170898 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004124641418457031 time for calcul the mask position with numpy : 0.008584260940551758 nb_pixel_total : 1463 time to create 1 rle with old method : 0.001827239990234375 time for calcul the mask position with numpy : 0.008462667465209961 nb_pixel_total : 4025 time to create 1 rle with old method : 0.004803657531738281 time for calcul the mask position with numpy : 0.008569478988647461 nb_pixel_total : 2032 time to create 1 rle with old method : 0.0024373531341552734 time for calcul the mask position with numpy : 0.008585453033447266 nb_pixel_total : 1534 time to create 1 rle with old method : 0.0018808841705322266 time for calcul the mask position with numpy : 0.008612394332885742 nb_pixel_total : 8286 time to create 1 rle with old method : 0.010035037994384766 time for calcul the mask position with numpy : 0.008601665496826172 nb_pixel_total : 21740 time to create 1 rle with old method : 0.02556014060974121 time for calcul the mask position with numpy : 0.008578300476074219 nb_pixel_total : 351 time to create 1 rle with old method : 0.0006947517395019531 time for calcul the mask position with numpy : 0.008548736572265625 nb_pixel_total : 18 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.008495330810546875 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002682209014892578 time for calcul the mask position with numpy : 0.008669614791870117 nb_pixel_total : 18 time to create 1 rle with old method : 0.00020241737365722656 time for calcul the mask position with numpy : 0.008644819259643555 nb_pixel_total : 2110 time to create 1 rle with old method : 0.0026433467864990234 time for calcul the mask position with numpy : 0.008539438247680664 nb_pixel_total : 1714 time to create 1 rle with old method : 0.002130746841430664 time for calcul the mask position with numpy : 0.00858759880065918 nb_pixel_total : 32 time to create 1 rle with old method : 0.00010919570922851562 time for calcul the mask position with numpy : 0.008584022521972656 nb_pixel_total : 2748 time to create 1 rle with old method : 0.0033185482025146484 time for calcul the mask position with numpy : 0.00867009162902832 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007894039154052734 create new chi : 1.311112880706787 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01404118537902832 batch 1 Loaded 49 chid ids of type : 4230 Number RLEs to save : 7311 TO DO : save crop sub photo not yet done ! save time : 0.6742274761199951 nb_obj : 55 nb_hashtags : 5 time to prepare the origin masks : 1.6980998516082764 time for calcul the mask position with numpy : 0.5230042934417725 nb_pixel_total : 1860685 time to create 1 rle with new method : 0.24219775199890137 time for calcul the mask position with numpy : 0.006858348846435547 nb_pixel_total : 1111 time to create 1 rle with old method : 0.002060413360595703 time for calcul the mask position with numpy : 0.011855840682983398 nb_pixel_total : 135 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.010219573974609375 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009655952453613281 time for calcul the mask position with numpy : 0.011005401611328125 nb_pixel_total : 935 time to create 1 rle with old method : 0.0011963844299316406 time for calcul the mask position with numpy : 0.015174388885498047 nb_pixel_total : 4 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.010457038879394531 nb_pixel_total : 58834 time to create 1 rle with old method : 0.06974911689758301 time for calcul the mask position with numpy : 0.007695198059082031 nb_pixel_total : 80 time to create 1 rle with old method : 0.00015783309936523438 time for calcul the mask position with numpy : 0.00861978530883789 nb_pixel_total : 242 time to create 1 rle with old method : 0.00044918060302734375 time for calcul the mask position with numpy : 0.007403373718261719 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.007327079772949219 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007450580596923828 time for calcul the mask position with numpy : 0.0072154998779296875 nb_pixel_total : 741 time to create 1 rle with old method : 0.0009522438049316406 time for calcul the mask position with numpy : 0.007230043411254883 nb_pixel_total : 883 time to create 1 rle with old method : 0.0010950565338134766 time for calcul the mask position with numpy : 0.007514476776123047 nb_pixel_total : 2265 time to create 1 rle with old method : 0.0027468204498291016 time for calcul the mask position with numpy : 0.007098674774169922 nb_pixel_total : 9 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.0066225528717041016 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0014002323150634766 time for calcul the mask position with numpy : 0.006981372833251953 nb_pixel_total : 898 time to create 1 rle with old method : 0.0011241436004638672 time for calcul the mask position with numpy : 0.006419181823730469 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.006395578384399414 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.0064165592193603516 nb_pixel_total : 3437 time to create 1 rle with old method : 0.004146575927734375 time for calcul the mask position with numpy : 0.0067119598388671875 nb_pixel_total : 722 time to create 1 rle with old method : 0.000881195068359375 time for calcul the mask position with numpy : 0.006448507308959961 nb_pixel_total : 308 time to create 1 rle with old method : 0.00037980079650878906 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0013582706451416016 time for calcul the mask position with numpy : 0.006363868713378906 nb_pixel_total : 3742 time to create 1 rle with old method : 0.0044252872467041016 time for calcul the mask position with numpy : 0.007064104080200195 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006120204925537109 time for calcul the mask position with numpy : 0.006503582000732422 nb_pixel_total : 83 time to create 1 rle with old method : 0.00014710426330566406 time for calcul the mask position with numpy : 0.006581783294677734 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005505084991455078 time for calcul the mask position with numpy : 0.010437726974487305 nb_pixel_total : 1258 time to create 1 rle with old method : 0.0015108585357666016 time for calcul the mask position with numpy : 0.010657787322998047 nb_pixel_total : 140 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.010457992553710938 nb_pixel_total : 2301 time to create 1 rle with old method : 0.002772092819213867 time for calcul the mask position with numpy : 0.01038980484008789 nb_pixel_total : 6548 time to create 1 rle with old method : 0.007812738418579102 time for calcul the mask position with numpy : 0.009874343872070312 nb_pixel_total : 24896 time to create 1 rle with old method : 0.03340339660644531 time for calcul the mask position with numpy : 0.010378599166870117 nb_pixel_total : 24054 time to create 1 rle with old method : 0.029148340225219727 time for calcul the mask position with numpy : 0.010649919509887695 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0013718605041503906 time for calcul the mask position with numpy : 0.010592222213745117 nb_pixel_total : 32632 time to create 1 rle with old method : 0.039563894271850586 time for calcul the mask position with numpy : 0.011718988418579102 nb_pixel_total : 346 time to create 1 rle with old method : 0.0007543563842773438 time for calcul the mask position with numpy : 0.013830184936523438 nb_pixel_total : 4 time to create 1 rle with old method : 3.457069396972656e-05 time for calcul the mask position with numpy : 0.011469364166259766 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.010760784149169922 nb_pixel_total : 3527 time to create 1 rle with old method : 0.004182338714599609 time for calcul the mask position with numpy : 0.009546756744384766 nb_pixel_total : 2075 time to create 1 rle with old method : 0.002525806427001953 time for calcul the mask position with numpy : 0.008176803588867188 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0018804073333740234 time for calcul the mask position with numpy : 0.006916999816894531 nb_pixel_total : 7045 time to create 1 rle with old method : 0.008723735809326172 time for calcul the mask position with numpy : 0.007331132888793945 nb_pixel_total : 15632 time to create 1 rle with old method : 0.019722700119018555 time for calcul the mask position with numpy : 0.008006572723388672 nb_pixel_total : 48 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.006934165954589844 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.007257938385009766 nb_pixel_total : 10 time to create 1 rle with old method : 0.00011348724365234375 time for calcul the mask position with numpy : 0.0068514347076416016 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007672309875488281 time for calcul the mask position with numpy : 0.006653785705566406 nb_pixel_total : 2995 time to create 1 rle with old method : 0.003548145294189453 time for calcul the mask position with numpy : 0.008714914321899414 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0020868778228759766 time for calcul the mask position with numpy : 0.008893013000488281 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003228187561035156 time for calcul the mask position with numpy : 0.013457536697387695 nb_pixel_total : 2467 time to create 1 rle with old method : 0.003120899200439453 time for calcul the mask position with numpy : 0.009048700332641602 nb_pixel_total : 127 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.008802175521850586 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005357265472412109 time for calcul the mask position with numpy : 0.009145975112915039 nb_pixel_total : 391 time to create 1 rle with old method : 0.000507354736328125 time for calcul the mask position with numpy : 0.008872509002685547 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.00919032096862793 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004036426544189453 create new chi : 1.520923137664795 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014193058013916016 batch 1 Loaded 56 chid ids of type : 4230 Number RLEs to save : 8475 TO DO : save crop sub photo not yet done ! save time : 0.5051760673522949 nb_obj : 52 nb_hashtags : 5 time to prepare the origin masks : 1.5204873085021973 time for calcul the mask position with numpy : 0.029622554779052734 nb_pixel_total : 1834172 time to create 1 rle with new method : 0.1082613468170166 time for calcul the mask position with numpy : 0.012691497802734375 nb_pixel_total : 368 time to create 1 rle with old method : 0.0006883144378662109 time for calcul the mask position with numpy : 0.011595726013183594 nb_pixel_total : 615 time to create 1 rle with old method : 0.0011098384857177734 time for calcul the mask position with numpy : 0.011720895767211914 nb_pixel_total : 856 time to create 1 rle with old method : 0.0015048980712890625 time for calcul the mask position with numpy : 0.013650894165039062 nb_pixel_total : 60833 time to create 1 rle with old method : 0.08220720291137695 time for calcul the mask position with numpy : 0.014156103134155273 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0020716190338134766 time for calcul the mask position with numpy : 0.01582932472229004 nb_pixel_total : 819 time to create 1 rle with old method : 0.0013251304626464844 time for calcul the mask position with numpy : 0.012729644775390625 nb_pixel_total : 31 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.011540412902832031 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.011243343353271484 nb_pixel_total : 919 time to create 1 rle with old method : 0.0011322498321533203 time for calcul the mask position with numpy : 0.011339664459228516 nb_pixel_total : 354 time to create 1 rle with old method : 0.00048804283142089844 time for calcul the mask position with numpy : 0.010751724243164062 nb_pixel_total : 2128 time to create 1 rle with old method : 0.0026831626892089844 time for calcul the mask position with numpy : 0.010770320892333984 nb_pixel_total : 3 time to create 1 rle with old method : 4.172325134277344e-05 time for calcul the mask position with numpy : 0.010728836059570312 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0013859272003173828 time for calcul the mask position with numpy : 0.01059865951538086 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008702278137207031 time for calcul the mask position with numpy : 0.0064351558685302734 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.007567882537841797 nb_pixel_total : 560 time to create 1 rle with old method : 0.0006849765777587891 time for calcul the mask position with numpy : 0.006558895111083984 nb_pixel_total : 26 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.006714820861816406 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.006318569183349609 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009608268737792969 time for calcul the mask position with numpy : 0.006805419921875 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011208057403564453 time for calcul the mask position with numpy : 0.007051944732666016 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006384849548339844 time for calcul the mask position with numpy : 0.006638765335083008 nb_pixel_total : 1235 time to create 1 rle with old method : 0.0014941692352294922 time for calcul the mask position with numpy : 0.01082301139831543 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006208419799804688 time for calcul the mask position with numpy : 0.006394624710083008 nb_pixel_total : 23 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.010551691055297852 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005750656127929688 time for calcul the mask position with numpy : 0.010265111923217773 nb_pixel_total : 1240 time to create 1 rle with old method : 0.001550436019897461 time for calcul the mask position with numpy : 0.010459184646606445 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0029129981994628906 time for calcul the mask position with numpy : 0.01099848747253418 nb_pixel_total : 53106 time to create 1 rle with old method : 0.06492042541503906 time for calcul the mask position with numpy : 0.010433197021484375 nb_pixel_total : 26208 time to create 1 rle with old method : 0.030462980270385742 time for calcul the mask position with numpy : 0.010285615921020508 nb_pixel_total : 717 time to create 1 rle with old method : 0.0008921623229980469 time for calcul the mask position with numpy : 0.010139942169189453 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003056526184082031 time for calcul the mask position with numpy : 0.010164260864257812 nb_pixel_total : 11203 time to create 1 rle with old method : 0.01315450668334961 time for calcul the mask position with numpy : 0.010317325592041016 nb_pixel_total : 352 time to create 1 rle with old method : 0.00043463706970214844 time for calcul the mask position with numpy : 0.010060548782348633 nb_pixel_total : 19 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.010161876678466797 nb_pixel_total : 243 time to create 1 rle with old method : 0.00038909912109375 time for calcul the mask position with numpy : 0.010158061981201172 nb_pixel_total : 4021 time to create 1 rle with old method : 0.004897356033325195 time for calcul the mask position with numpy : 0.010162353515625 nb_pixel_total : 68 time to create 1 rle with old method : 0.00017523765563964844 time for calcul the mask position with numpy : 0.010314226150512695 nb_pixel_total : 2013 time to create 1 rle with old method : 0.002410888671875 time for calcul the mask position with numpy : 0.01062321662902832 nb_pixel_total : 23998 time to create 1 rle with old method : 0.027610063552856445 time for calcul the mask position with numpy : 0.010642528533935547 nb_pixel_total : 1284 time to create 1 rle with old method : 0.0017621517181396484 time for calcul the mask position with numpy : 0.015453577041625977 nb_pixel_total : 3202 time to create 1 rle with old method : 0.003950357437133789 time for calcul the mask position with numpy : 0.010996580123901367 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0017802715301513672 time for calcul the mask position with numpy : 0.011055231094360352 nb_pixel_total : 24580 time to create 1 rle with old method : 0.028618335723876953 time for calcul the mask position with numpy : 0.012725830078125 nb_pixel_total : 61 time to create 1 rle with old method : 0.00012731552124023438 time for calcul the mask position with numpy : 0.010903358459472656 nb_pixel_total : 200 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.01049947738647461 nb_pixel_total : 177 time to create 1 rle with old method : 0.00026679039001464844 time for calcul the mask position with numpy : 0.010738611221313477 nb_pixel_total : 130 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.010237932205200195 nb_pixel_total : 2183 time to create 1 rle with old method : 0.002645730972290039 time for calcul the mask position with numpy : 0.010362386703491211 nb_pixel_total : 1769 time to create 1 rle with old method : 0.002126455307006836 time for calcul the mask position with numpy : 0.010540962219238281 nb_pixel_total : 2109 time to create 1 rle with old method : 0.0026645660400390625 time for calcul the mask position with numpy : 0.010151147842407227 nb_pixel_total : 105 time to create 1 rle with old method : 0.00022292137145996094 time for calcul the mask position with numpy : 0.01022481918334961 nb_pixel_total : 128 time to create 1 rle with old method : 0.00017261505126953125 create new chi : 0.9858095645904541 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013833045959472656 batch 1 Loaded 53 chid ids of type : 4230 Number RLEs to save : 8384 TO DO : save crop sub photo not yet done ! save time : 0.5050115585327148 nb_obj : 72 nb_hashtags : 6 time to prepare the origin masks : 1.4158387184143066 time for calcul the mask position with numpy : 0.13123250007629395 nb_pixel_total : 1860723 time to create 1 rle with new method : 0.11225557327270508 time for calcul the mask position with numpy : 0.010788202285766602 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.012029170989990234 nb_pixel_total : 647 time to create 1 rle with old method : 0.0011289119720458984 time for calcul the mask position with numpy : 0.006727457046508789 nb_pixel_total : 642 time to create 1 rle with old method : 0.0011138916015625 time for calcul the mask position with numpy : 0.0066683292388916016 nb_pixel_total : 19 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.006713390350341797 nb_pixel_total : 843 time to create 1 rle with old method : 0.0014727115631103516 time for calcul the mask position with numpy : 0.006890535354614258 nb_pixel_total : 39 time to create 1 rle with old method : 0.0001437664031982422 time for calcul the mask position with numpy : 0.006871461868286133 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.006989002227783203 nb_pixel_total : 555 time to create 1 rle with old method : 0.0009708404541015625 time for calcul the mask position with numpy : 0.006670951843261719 nb_pixel_total : 103 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.011865854263305664 nb_pixel_total : 1055 time to create 1 rle with old method : 0.0018739700317382812 time for calcul the mask position with numpy : 0.011448860168457031 nb_pixel_total : 775 time to create 1 rle with old method : 0.0009629726409912109 time for calcul the mask position with numpy : 0.010962247848510742 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001838207244873047 time for calcul the mask position with numpy : 0.011441230773925781 nb_pixel_total : 50289 time to create 1 rle with old method : 0.05990338325500488 time for calcul the mask position with numpy : 0.012826919555664062 nb_pixel_total : 1824 time to create 1 rle with old method : 0.002299785614013672 time for calcul the mask position with numpy : 0.010588407516479492 nb_pixel_total : 2 time to create 1 rle with old method : 2.2172927856445312e-05 time for calcul the mask position with numpy : 0.010314702987670898 nb_pixel_total : 1002 time to create 1 rle with old method : 0.0012242794036865234 time for calcul the mask position with numpy : 0.010272741317749023 nb_pixel_total : 1200 time to create 1 rle with old method : 0.001455068588256836 time for calcul the mask position with numpy : 0.014915704727172852 nb_pixel_total : 700 time to create 1 rle with old method : 0.0008895397186279297 time for calcul the mask position with numpy : 0.01168370246887207 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006201267242431641 time for calcul the mask position with numpy : 0.010306596755981445 nb_pixel_total : 6 time to create 1 rle with old method : 3.3855438232421875e-05 time for calcul the mask position with numpy : 0.010171890258789062 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006539821624755859 time for calcul the mask position with numpy : 0.010299205780029297 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003132820129394531 time for calcul the mask position with numpy : 0.010136604309082031 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003056526184082031 time for calcul the mask position with numpy : 0.010203361511230469 nb_pixel_total : 992 time to create 1 rle with old method : 0.001196146011352539 time for calcul the mask position with numpy : 0.010099649429321289 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0012552738189697266 time for calcul the mask position with numpy : 0.010153770446777344 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006551742553710938 time for calcul the mask position with numpy : 0.010091304779052734 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016753673553466797 time for calcul the mask position with numpy : 0.01291799545288086 nb_pixel_total : 476 time to create 1 rle with old method : 0.0006129741668701172 time for calcul the mask position with numpy : 0.010323524475097656 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009644031524658203 time for calcul the mask position with numpy : 0.010337591171264648 nb_pixel_total : 68 time to create 1 rle with old method : 0.00013303756713867188 time for calcul the mask position with numpy : 0.010342836380004883 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002221345901489258 time for calcul the mask position with numpy : 0.010376453399658203 nb_pixel_total : 4417 time to create 1 rle with old method : 0.0053462982177734375 time for calcul the mask position with numpy : 0.010210037231445312 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.010157585144042969 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006175041198730469 time for calcul the mask position with numpy : 0.011108875274658203 nb_pixel_total : 441 time to create 1 rle with old method : 0.0007085800170898438 time for calcul the mask position with numpy : 0.011664390563964844 nb_pixel_total : 148 time to create 1 rle with old method : 0.0001990795135498047 time for calcul the mask position with numpy : 0.01070857048034668 nb_pixel_total : 2518 time to create 1 rle with old method : 0.0030519962310791016 time for calcul the mask position with numpy : 0.010418891906738281 nb_pixel_total : 5198 time to create 1 rle with old method : 0.008230447769165039 time for calcul the mask position with numpy : 0.01224374771118164 nb_pixel_total : 25936 time to create 1 rle with old method : 0.036741018295288086 time for calcul the mask position with numpy : 0.011023283004760742 nb_pixel_total : 23488 time to create 1 rle with old method : 0.031702518463134766 time for calcul the mask position with numpy : 0.010304450988769531 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0021593570709228516 time for calcul the mask position with numpy : 0.010590314865112305 nb_pixel_total : 3338 time to create 1 rle with old method : 0.004023313522338867 time for calcul the mask position with numpy : 0.010146379470825195 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007414817810058594 time for calcul the mask position with numpy : 0.008430242538452148 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003001689910888672 time for calcul the mask position with numpy : 0.008500337600708008 nb_pixel_total : 8905 time to create 1 rle with old method : 0.010532379150390625 time for calcul the mask position with numpy : 0.008469820022583008 nb_pixel_total : 361 time to create 1 rle with old method : 0.00044417381286621094 time for calcul the mask position with numpy : 0.00840306282043457 nb_pixel_total : 11 time to create 1 rle with old method : 2.6226043701171875e-05 time for calcul the mask position with numpy : 0.00840139389038086 nb_pixel_total : 25655 time to create 1 rle with old method : 0.03147482872009277 time for calcul the mask position with numpy : 0.008427143096923828 nb_pixel_total : 588 time to create 1 rle with old method : 0.0007266998291015625 time for calcul the mask position with numpy : 0.008366584777832031 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006246566772460938 time for calcul the mask position with numpy : 0.008811473846435547 nb_pixel_total : 1664 time to create 1 rle with old method : 0.0021932125091552734 time for calcul the mask position with numpy : 0.00844120979309082 nb_pixel_total : 2245 time to create 1 rle with old method : 0.002677440643310547 time for calcul the mask position with numpy : 0.00835108757019043 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007588863372802734 time for calcul the mask position with numpy : 0.008374452590942383 nb_pixel_total : 1165 time to create 1 rle with old method : 0.0014138221740722656 time for calcul the mask position with numpy : 0.008355379104614258 nb_pixel_total : 2933 time to create 1 rle with old method : 0.0035212039947509766 time for calcul the mask position with numpy : 0.009063482284545898 nb_pixel_total : 130 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.008435487747192383 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0020339488983154297 time for calcul the mask position with numpy : 0.008589029312133789 nb_pixel_total : 19909 time to create 1 rle with old method : 0.023097991943359375 time for calcul the mask position with numpy : 0.008433341979980469 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016260147094726562 time for calcul the mask position with numpy : 0.00843954086303711 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.008412599563598633 nb_pixel_total : 14 time to create 1 rle with old method : 2.8848648071289062e-05 time for calcul the mask position with numpy : 0.008370399475097656 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002503395080566406 time for calcul the mask position with numpy : 0.008372068405151367 nb_pixel_total : 129 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 2688 time to create 1 rle with old method : 0.003180265426635742 time for calcul the mask position with numpy : 0.008348226547241211 nb_pixel_total : 74 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.008310317993164062 nb_pixel_total : 708 time to create 1 rle with old method : 0.0008461475372314453 time for calcul the mask position with numpy : 0.008365869522094727 nb_pixel_total : 1396 time to create 1 rle with old method : 0.0016987323760986328 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 158 time to create 1 rle with old method : 0.00018978118896484375 time for calcul the mask position with numpy : 0.008330345153808594 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002956390380859375 time for calcul the mask position with numpy : 0.008376121520996094 nb_pixel_total : 2557 time to create 1 rle with old method : 0.0030672550201416016 time for calcul the mask position with numpy : 0.008380889892578125 nb_pixel_total : 383 time to create 1 rle with old method : 0.00045228004455566406 time for calcul the mask position with numpy : 0.00837397575378418 nb_pixel_total : 164 time to create 1 rle with old method : 0.00020265579223632812 create new chi : 1.2123162746429443 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001583099365234375 batch 1 Loaded 73 chid ids of type : 4230 Number RLEs to save : 9874 TO DO : save crop sub photo not yet done ! save time : 0.5921947956085205 nb_obj : 59 nb_hashtags : 4 time to prepare the origin masks : 1.5126502513885498 time for calcul the mask position with numpy : 0.039576053619384766 nb_pixel_total : 1852262 time to create 1 rle with new method : 0.07419300079345703 time for calcul the mask position with numpy : 0.01484227180480957 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006864070892333984 time for calcul the mask position with numpy : 0.007605552673339844 nb_pixel_total : 777 time to create 1 rle with old method : 0.0014820098876953125 time for calcul the mask position with numpy : 0.008221864700317383 nb_pixel_total : 782 time to create 1 rle with old method : 0.0017147064208984375 time for calcul the mask position with numpy : 0.009354114532470703 nb_pixel_total : 58227 time to create 1 rle with old method : 0.08829140663146973 time for calcul the mask position with numpy : 0.009542703628540039 nb_pixel_total : 708 time to create 1 rle with old method : 0.0015337467193603516 time for calcul the mask position with numpy : 0.009289264678955078 nb_pixel_total : 1441 time to create 1 rle with old method : 0.002988100051879883 time for calcul the mask position with numpy : 0.008616209030151367 nb_pixel_total : 667 time to create 1 rle with old method : 0.0013957023620605469 time for calcul the mask position with numpy : 0.007920503616333008 nb_pixel_total : 71 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.015472888946533203 nb_pixel_total : 209 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.020185470581054688 nb_pixel_total : 280 time to create 1 rle with old method : 0.0006902217864990234 time for calcul the mask position with numpy : 0.015529870986938477 nb_pixel_total : 837 time to create 1 rle with old method : 0.0054247379302978516 time for calcul the mask position with numpy : 0.05436205863952637 nb_pixel_total : 2177 time to create 1 rle with old method : 0.004435062408447266 time for calcul the mask position with numpy : 0.01964569091796875 nb_pixel_total : 1190 time to create 1 rle with old method : 0.0016002655029296875 time for calcul the mask position with numpy : 0.013528823852539062 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006461143493652344 time for calcul the mask position with numpy : 0.007635593414306641 nb_pixel_total : 9 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.008131027221679688 nb_pixel_total : 556 time to create 1 rle with old method : 0.0008442401885986328 time for calcul the mask position with numpy : 0.013406515121459961 nb_pixel_total : 254 time to create 1 rle with old method : 0.000354766845703125 time for calcul the mask position with numpy : 0.014059782028198242 nb_pixel_total : 5744 time to create 1 rle with old method : 0.007043600082397461 time for calcul the mask position with numpy : 0.012110233306884766 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0014178752899169922 time for calcul the mask position with numpy : 0.012237310409545898 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006499290466308594 time for calcul the mask position with numpy : 0.012630939483642578 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006597042083740234 time for calcul the mask position with numpy : 0.013427972793579102 nb_pixel_total : 289 time to create 1 rle with old method : 0.0005509853363037109 time for calcul the mask position with numpy : 0.01312112808227539 nb_pixel_total : 989 time to create 1 rle with old method : 0.0013854503631591797 time for calcul the mask position with numpy : 0.011168241500854492 nb_pixel_total : 114 time to create 1 rle with old method : 0.00024390220642089844 time for calcul the mask position with numpy : 0.010764837265014648 nb_pixel_total : 5723 time to create 1 rle with old method : 0.0067861080169677734 time for calcul the mask position with numpy : 0.011538267135620117 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006430149078369141 time for calcul the mask position with numpy : 0.011008739471435547 nb_pixel_total : 362 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.011170625686645508 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0015633106231689453 time for calcul the mask position with numpy : 0.010864734649658203 nb_pixel_total : 2259 time to create 1 rle with old method : 0.002732515335083008 time for calcul the mask position with numpy : 0.011242151260375977 nb_pixel_total : 27014 time to create 1 rle with old method : 0.03170037269592285 time for calcul the mask position with numpy : 0.011415958404541016 nb_pixel_total : 20037 time to create 1 rle with old method : 0.023047685623168945 time for calcul the mask position with numpy : 0.011414051055908203 nb_pixel_total : 195 time to create 1 rle with old method : 0.00027823448181152344 time for calcul the mask position with numpy : 0.011362552642822266 nb_pixel_total : 231 time to create 1 rle with old method : 0.000293731689453125 time for calcul the mask position with numpy : 0.01149892807006836 nb_pixel_total : 32565 time to create 1 rle with old method : 0.03989052772521973 time for calcul the mask position with numpy : 0.008006095886230469 nb_pixel_total : 1820 time to create 1 rle with old method : 0.002880096435546875 time for calcul the mask position with numpy : 0.011802196502685547 nb_pixel_total : 16 time to create 1 rle with old method : 4.410743713378906e-05 time for calcul the mask position with numpy : 0.011114120483398438 nb_pixel_total : 340 time to create 1 rle with old method : 0.00041413307189941406 time for calcul the mask position with numpy : 0.011023521423339844 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0015676021575927734 time for calcul the mask position with numpy : 0.010514259338378906 nb_pixel_total : 4100 time to create 1 rle with old method : 0.004936695098876953 time for calcul the mask position with numpy : 0.010902881622314453 nb_pixel_total : 2040 time to create 1 rle with old method : 0.0024261474609375 time for calcul the mask position with numpy : 0.007041215896606445 nb_pixel_total : 112 time to create 1 rle with old method : 0.00017833709716796875 time for calcul the mask position with numpy : 0.007113218307495117 nb_pixel_total : 1648 time to create 1 rle with old method : 0.0020198822021484375 time for calcul the mask position with numpy : 0.00690770149230957 nb_pixel_total : 71 time to create 1 rle with old method : 0.00018858909606933594 time for calcul the mask position with numpy : 0.006848573684692383 nb_pixel_total : 7749 time to create 1 rle with old method : 0.009068727493286133 time for calcul the mask position with numpy : 0.0074310302734375 nb_pixel_total : 21554 time to create 1 rle with old method : 0.028547048568725586 time for calcul the mask position with numpy : 0.006787538528442383 nb_pixel_total : 353 time to create 1 rle with old method : 0.0006830692291259766 time for calcul the mask position with numpy : 0.017557859420776367 nb_pixel_total : 114 time to create 1 rle with old method : 0.00019216537475585938 time for calcul the mask position with numpy : 0.011389732360839844 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002639293670654297 time for calcul the mask position with numpy : 0.010599613189697266 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003101825714111328 time for calcul the mask position with numpy : 0.010916709899902344 nb_pixel_total : 2731 time to create 1 rle with old method : 0.0034554004669189453 time for calcul the mask position with numpy : 0.01107931137084961 nb_pixel_total : 99 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.011019229888916016 nb_pixel_total : 1255 time to create 1 rle with old method : 0.001538991928100586 time for calcul the mask position with numpy : 0.01238250732421875 nb_pixel_total : 333 time to create 1 rle with old method : 0.000431060791015625 time for calcul the mask position with numpy : 0.012159347534179688 nb_pixel_total : 1652 time to create 1 rle with old method : 0.001983165740966797 time for calcul the mask position with numpy : 0.011364936828613281 nb_pixel_total : 3229 time to create 1 rle with old method : 0.0038673877716064453 time for calcul the mask position with numpy : 0.011891365051269531 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007483959197998047 time for calcul the mask position with numpy : 0.012345552444458008 nb_pixel_total : 994 time to create 1 rle with old method : 0.0012896060943603516 time for calcul the mask position with numpy : 0.011841058731079102 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.014006376266479492 nb_pixel_total : 244 time to create 1 rle with old method : 0.0004532337188720703 create new chi : 1.1386053562164307 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0035409927368164062 batch 1 Loaded 60 chid ids of type : 4230 Number RLEs to save : 8336 TO DO : save crop sub photo not yet done ! save time : 0.5483407974243164 map_output_result : {1340207408: (0.0, 'Should be the crop_list due to order', 0.0), 1340207406: (0.0, 'Should be the crop_list due to order', 0.0), 1340207403: (0.0, 'Should be the crop_list due to order', 0.0), 1340207401: (0.0, 'Should be the crop_list due to order', 0.0), 1340207397: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 5 /1340207408.Didn't retrieve data . /1340207406.Didn't retrieve data . /1340207403.Didn't retrieve data . /1340207401.Didn't retrieve data . /1340207397.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012103796005249023 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.79823088645935 time spend to save output : 0.012619733810424805 total time spend for step 4 : 16.810850620269775 step5:crop_condition Fri Feb 28 22:21:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 291 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 4869462 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740777690_3237071 we have uploaded 73 photos in the portfolio 4869462 time of upload the photos Elapsed time : 18.256202697753906 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 4869462 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740777709_3237071 we have uploaded 30 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.337010145187378 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740777716_3237071 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5450561046600342 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 4869462 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740777718_3237071 we have uploaded 18 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.5371034145355225 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 58 About to insert : list_path_to_insert length 58 new photo from crops ! About to upload 58 photos upload in portfolio : 4869462 init cache_photo without model_param we have 58 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740777723_3237071 we have uploaded 58 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.359591960906982 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 180 /1340230433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340230631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 545 time used for this insertion : 0.03802633285522461 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.809431314468384 time spend to save output : 0.07228541374206543 total time spend for step 5 : 51.88171672821045 step6:thcl Fri Feb 28 22:22:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.012349843978881836 time to convert the images to numpy array : 0.07982373237609863 time to import caffe and check if the image exist : 0.017902135848999023 time to convert the images to numpy array : 0.0800008773803711 time to import caffe and check if the image exist : 0.010350942611694336 time to convert the images to numpy array : 0.0867459774017334 time to import caffe and check if the image exist : 0.024588584899902344 time to convert the images to numpy array : 0.07767009735107422 time to import caffe and check if the image exist : 0.03606700897216797 time to convert the images to numpy array : 0.06758570671081543 time to import caffe and check if the image exist : 0.023688554763793945 time to convert the images to numpy array : 0.08303618431091309 time to import caffe and check if the image exist : 0.02144169807434082 time to convert the images to numpy array : 0.09185576438903809 time to import caffe and check if the image exist : 0.026096582412719727 time to convert the images to numpy array : 0.08955717086791992 time to import caffe and check if the image exist : 0.010323286056518555 time to convert the images to numpy array : 0.10781669616699219 time to import caffe and check if the image exist : 0.031501054763793945 time to convert the images to numpy array : 0.08615326881408691 total time to convert the images to numpy array : 0.43033528327941895 list photo_ids error: [] list photo_ids correct : [1340230594, 1340230595, 1340230596, 1340230597, 1340230598, 1340230599, 1340230600, 1340230601, 1340230602, 1340230603, 1340230605, 1340230606, 1340230607, 1340230608, 1340230609, 1340230610, 1340230611, 1340230612, 1340230553, 1340230554, 1340230555, 1340230556, 1340230557, 1340230558, 1340230559, 1340230560, 1340230561, 1340230562, 1340230563, 1340230564, 1340230565, 1340230566, 1340230571, 1340230572, 1340230573, 1340230574, 1340230613, 1340230615, 1340230616, 1340230617, 1340230618, 1340230619, 1340230620, 1340230621, 1340230622, 1340230623, 1340230624, 1340230625, 1340230626, 1340230627, 1340230628, 1340230629, 1340230630, 1340230631, 1340230575, 1340230576, 1340230577, 1340230578, 1340230579, 1340230580, 1340230581, 1340230582, 1340230583, 1340230584, 1340230586, 1340230587, 1340230588, 1340230589, 1340230590, 1340230591, 1340230592, 1340230593, 1340230509, 1340230517, 1340230518, 1340230519, 1340230520, 1340230521, 1340230522, 1340230523, 1340230524, 1340230525, 1340230526, 1340230527, 1340230528, 1340230529, 1340230530, 1340230531, 1340230532, 1340230533, 1340230534, 1340230535, 1340230536, 1340230537, 1340230538, 1340230539, 1340230540, 1340230541, 1340230542, 1340230543, 1340230544, 1340230545, 1340230546, 1340230547, 1340230549, 1340230550, 1340230551, 1340230552, 1340230471, 1340230472, 1340230473, 1340230474, 1340230475, 1340230476, 1340230477, 1340230478, 1340230479, 1340230480, 1340230481, 1340230483, 1340230484, 1340230485, 1340230486, 1340230487, 1340230488, 1340230489, 1340230452, 1340230453, 1340230454, 1340230455, 1340230456, 1340230457, 1340230458, 1340230459, 1340230460, 1340230461, 1340230462, 1340230463, 1340230464, 1340230465, 1340230467, 1340230468, 1340230469, 1340230470, 1340230433, 1340230434, 1340230435, 1340230436, 1340230437, 1340230439, 1340230440, 1340230441, 1340230442, 1340230443, 1340230444, 1340230445, 1340230446, 1340230447, 1340230448, 1340230449, 1340230450, 1340230451, 1340230490, 1340230491, 1340230492, 1340230493, 1340230494, 1340230495, 1340230497, 1340230498, 1340230499, 1340230500, 1340230501, 1340230502, 1340230503, 1340230504, 1340230505, 1340230506, 1340230507, 1340230508] number of photos to traite : 180 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3249 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3030 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.1175732612609863 time used to do the prediction : 0.7295253276824951 save descriptor for thcl : 3237 time to traite the descriptors : 1.4526824951171875 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340230594 To insert : 1340230595 To insert : 1340230596 To insert : 1340230597 To insert : 1340230598 To insert : 1340230599 To insert : 1340230600 To insert : 1340230601 To insert : 1340230602 To insert : 1340230603 To insert : 1340230605 To insert : 1340230606 To insert : 1340230607 To insert : 1340230608 To insert : 1340230609 To insert : 1340230610 To insert : 1340230611 To insert : 1340230612 To insert : 1340230553 To insert : 1340230554 To insert : 1340230555 To insert : 1340230556 To insert : 1340230557 To insert : 1340230558 To insert : 1340230559 To insert : 1340230560 To insert : 1340230561 To insert : 1340230562 To insert : 1340230563 To insert : 1340230564 To insert : 1340230565 To insert : 1340230566 To insert : 1340230571 To insert : 1340230572 To insert : 1340230573 To insert : 1340230574 To insert : 1340230613 To insert : 1340230615 To insert : 1340230616 To insert : 1340230617 To insert : 1340230618 To insert : 1340230619 To insert : 1340230620 To insert : 1340230621 To insert : 1340230622 To insert : 1340230623 To insert : 1340230624 To insert : 1340230625 To insert : 1340230626 To insert : 1340230627 To insert : 1340230628 To insert : 1340230629 To insert : 1340230630 To insert : 1340230631 To insert : 1340230575 To insert : 1340230576 To insert : 1340230577 To insert : 1340230578 To insert : 1340230579 To insert : 1340230580 To insert : 1340230581 To insert : 1340230582 To insert : 1340230583 To insert : 1340230584 To insert : 1340230586 To insert : 1340230587 To insert : 1340230588 To insert : 1340230589 To insert : 1340230590 To insert : 1340230591 To insert : 1340230592 To insert : 1340230593 To insert : 1340230509 To insert : 1340230517 To insert : 1340230518 To insert : 1340230519 To insert : 1340230520 To insert : 1340230521 To insert : 1340230522 To insert : 1340230523 To insert : 1340230524 To insert : 1340230525 To insert : 1340230526 To insert : 1340230527 To insert : 1340230528 To insert : 1340230529 To insert : 1340230530 To insert : 1340230531 To insert : 1340230532 To insert : 1340230533 To insert : 1340230534 To insert : 1340230535 To insert : 1340230536 To insert : 1340230537 To insert : 1340230538 To insert : 1340230539 To insert : 1340230540 To insert : 1340230541 To insert : 1340230542 To insert : 1340230543 To insert : 1340230544 To insert : 1340230545 To insert : 1340230546 To insert : 1340230547 To insert : 1340230549 To insert : 1340230550 To insert : 1340230551 To insert : 1340230552 To insert : 1340230471 To insert : 1340230472 To insert : 1340230473 To insert : 1340230474 To insert : 1340230475 To insert : 1340230476 To insert : 1340230477 To insert : 1340230478 To insert : 1340230479 To insert : 1340230480 To insert : 1340230481 To insert : 1340230483 To insert : 1340230484 To insert : 1340230485 To insert : 1340230486 To insert : 1340230487 To insert : 1340230488 To insert : 1340230489 To insert : 1340230452 To insert : 1340230453 To insert : 1340230454 To insert : 1340230455 To insert : 1340230456 To insert : 1340230457 To insert : 1340230458 To insert : 1340230459 To insert : 1340230460 To insert : 1340230461 To insert : 1340230462 To insert : 1340230463 To insert : 1340230464 To insert : 1340230465 To insert : 1340230467 To insert : 1340230468 To insert : 1340230469 To insert : 1340230470 To insert : 1340230433 To insert : 1340230434 To insert : 1340230435 To insert : 1340230436 To insert : 1340230437 To insert : 1340230439 To insert : 1340230440 To insert : 1340230441 To insert : 1340230442 To insert : 1340230443 To insert : 1340230444 To insert : 1340230445 To insert : 1340230446 To insert : 1340230447 To insert : 1340230448 To insert : 1340230449 To insert : 1340230450 To insert : 1340230451 To insert : 1340230490 To insert : 1340230491 To insert : 1340230492 To insert : 1340230493 To insert : 1340230494 To insert : 1340230495 To insert : 1340230497 To insert : 1340230498 To insert : 1340230499 To insert : 1340230500 To insert : 1340230501 To insert : 1340230502 To insert : 1340230503 To insert : 1340230504 To insert : 1340230505 To insert : 1340230506 To insert : 1340230507 To insert : 1340230508 time to insert the descriptors : 37.802266359329224 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 273 time used for this insertion : 0.02395009994506836 save missing photos in datou_result : time spend for datou_step_exec : 45.617186546325684 time spend to save output : 0.07717204093933105 total time spend for step 6 : 45.694358587265015 step7:ventilate_hashtags_in_portfolio Fri Feb 28 22:23:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20940738 get user id for portfolio 20940738 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','metal','pet_clair','autre','carton','PEHD','PET_clair','Carton','Papier','papier','refus','PET_fonce','Tetrapak','environnement','flou','pehd','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','metal','pet_clair','autre','carton','PEHD','PET_clair','Carton','Papier','papier','refus','PET_fonce','Tetrapak','environnement','flou','pehd','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 1 /20940738. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012546062469482422 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.066960334777832 time spend to save output : 0.01280975341796875 total time spend for step 7 : 2.079770088195801 step8:final Fri Feb 28 22:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340207408: ('0.23373790443568715',), 1340207406: ('0.23373790443568715',), 1340207403: ('0.23373790443568715',), 1340207401: ('0.23373790443568715',), 1340207397: ('0.23373790443568715',)} new output for save of step final : {1340207408: ('0.23373790443568715',), 1340207406: ('0.23373790443568715',), 1340207403: ('0.23373790443568715',), 1340207401: ('0.23373790443568715',), 1340207397: ('0.23373790443568715',)} [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 5 /1340207408.Didn't retrieve data . /1340207406.Didn't retrieve data . /1340207403.Didn't retrieve data . /1340207401.Didn't retrieve data . /1340207397.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 2.9012293815612793 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14432096481323242 time spend to save output : 2.9015719890594482 total time spend for step 8 : 3.0458929538726807 step9:velours_tree Fri Feb 28 22:23:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942001 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20941998 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20941999 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942000 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942003 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942008 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942005 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942006 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942012 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942009 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942010 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942011 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20942013 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 2653 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 0 5 ... 2 2 2] Elapsed time: 6.460984706878662 graph_id used : 80727 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738&tree_id=80727 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 1 /20940738Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012282848358154297 save_final save missing photos in datou_result : time spend for datou_step_exec : 214.2011022567749 time spend to save output : 0.04366898536682129 total time spend for step 9 : 214.24477124214172 step10:send_mail_cod Fri Feb 28 22:26:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf 20941983 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419831740778004 20941980 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419801740778005 20941981 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419811740778006 20941982 imagette209419821740778007 20941985 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419851740778007 20941990 change filename to text .imagette209419901740778008 20941988 imagette209419881740778009 20941994 change filename to text .change filename to text .change filename to text .change filename to text .imagette209419941740778009 20941991 imagette209419911740778009 20941992 imagette209419921740778009 20941993 imagette209419931740778009 20941995 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209419951740778009 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20940738 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20942001,20941998,20941999,20942000,20942003,20942008,20942005,20942006,20942012,20942009,20942010,20942011,20942013?tags=carton,papier,metal,film_plastique,pet_clair,pet_fonce,environnement,mal_croppe,pehd,flou,refus,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20940738&tree_id=80727 your option no_mail is active, we will not send the real mail to your client args[1340207408] : ((1340207408, -6.84732993039094, 492609224), (1340207408, -0.2174906037123486, 496442774), '0.23373790443568715') We are sending mail with results at cod@fotonower.com args[1340207406] : ((1340207406, -6.984107571774768, 492609224), (1340207406, -0.3059803046854537, 496442774), '0.23373790443568715') We are sending mail with results at cod@fotonower.com args[1340207403] : ((1340207403, -6.8810656943448745, 492609224), (1340207403, -0.2793786596369898, 496442774), '0.23373790443568715') We are sending mail with results at cod@fotonower.com args[1340207401] : ((1340207401, -7.002170636348977, 492609224), (1340207401, -0.28096376712938775, 496442774), '0.23373790443568715') We are sending mail with results at cod@fotonower.com args[1340207397] : ((1340207397, -7.087618838386815, 492609224), (1340207397, -0.358970894466605, 496442774), '0.23373790443568715') We are sending mail with results at cod@fotonower.com refus_total : 0.23373790443568715 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20940738 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20940738','results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf','pdf','','0.2','0.23373790443568715') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.01266622543334961 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.9875054359436035 time spend to save output : 0.012946128845214844 total time spend for step 10 : 8.000451564788818 step11:split_time_score Fri Feb 28 22:26:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 62),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28022025 20940738 Nombre de photos uploadées : 62 / 23040 (0%) 28022025 20940738 Nombre de photos taguées (types de déchets): 62 / 62 (100%) 28022025 20940738 Nombre de photos taguées (volume) : 0 / 62 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ?????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002656698226928711 elapsed_time : insert_dashboard_record_day_entry 0.02342081069946289 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925313 order by id desc limit 1 Qualite : 0.2389124139495338 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925314_28-02-2025_16_27_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925314 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925314 AND mptpi.`type`=4230 To do Qualite : 0.20097250357084048 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925315_28-02-2025_16_33_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925315 AND mptpi.`type`=4230 To do Qualite : 0.17175854819984712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925316_28-02-2025_16_37_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925316 AND mptpi.`type`=4230 To do Qualite : 0.14603092887147903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925317_28-02-2025_16_48_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925317 AND mptpi.`type`=4230 To do Qualite : 0.14537379123310024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925318_28-02-2025_16_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925318 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925318 AND mptpi.`type`=4230 To do Qualite : 0.13834991985174483 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925319_28-02-2025_16_53_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925319 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925319 AND mptpi.`type`=4230 To do Qualite : 0.20701680283651394 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925320_28-02-2025_12_19_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925320 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925320 AND mptpi.`type`=4230 To do Qualite : 0.20965568130120157 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20925322_28-02-2025_12_35_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20925322 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20925322 AND mptpi.`type`=4230 To do Qualite : 0.19136356371699506 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926288_28-02-2025_17_55_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926288 AND mptpi.`type`=4230 To do Qualite : 0.18230722131056523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926289_28-02-2025_17_49_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926289 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926289 AND mptpi.`type`=4230 To do Qualite : 0.28319271719456496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926290_28-02-2025_17_52_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926290 AND mptpi.`type`=4230 To do Qualite : 0.20152453678282414 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926291_28-02-2025_18_00_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926291 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926292 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926299 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926300 order by id desc limit 1 Qualite : 0.20301090126642068 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926680_28-02-2025_19_49_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926680 AND mptpi.`type`=4230 To do Qualite : 0.1907352174406225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926681_28-02-2025_19_41_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926681 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926682 order by id desc limit 1 Qualite : 0.19471567274044788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926683_28-02-2025_19_48_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926683 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926683 AND mptpi.`type`=4230 To do Qualite : 0.1738227302063754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926684_28-02-2025_19_53_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926684 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926684 AND mptpi.`type`=4230 To do Qualite : 0.20471644430980254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926685_28-02-2025_20_03_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926685 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926685 AND mptpi.`type`=4230 To do Qualite : 0.19885090886216725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926686_28-02-2025_20_12_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926686 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926686 AND mptpi.`type`=4230 To do Qualite : 0.18519467081681223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926687_28-02-2025_20_07_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926687 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926687 AND mptpi.`type`=4230 To do Qualite : 0.15869362550655408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926688_28-02-2025_20_41_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926688 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926688 AND mptpi.`type`=4230 To do Qualite : 0.195875078609268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926689_28-02-2025_21_46_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926689 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926689 AND mptpi.`type`=4230 To do Qualite : 0.20091742580903377 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926959_28-02-2025_15_57_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926959 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926959 AND mptpi.`type`=4230 To do Qualite : 0.19808442389049616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926960_28-02-2025_13_47_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926960 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926960 AND mptpi.`type`=4230 To do Qualite : 0.1789930776371666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926961_28-02-2025_14_35_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926961 AND mptpi.`type`=4230 To do Qualite : 0.23665664333760855 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20926962_28-02-2025_14_58_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20926962 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20926962 AND mptpi.`type`=4230 To do Qualite : 0.2286496649991992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20931435_28-02-2025_16_31_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20931435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20931435 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932896 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932897 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932898 order by id desc limit 1 Qualite : 0.13881388279873863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20932899_28-02-2025_16_46_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932899 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20932899 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20932900 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934012 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934013 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934014 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934015 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934016 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934017 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934018 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934019 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934020 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934021 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934022 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934023 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934024 order by id desc limit 1 Qualite : 0.0970633201854936 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934025_28-02-2025_17_32_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934025 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934026 order by id desc limit 1 Qualite : 0.16967650816069063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934027_28-02-2025_17_24_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934027 AND mptpi.`type`=4230 To do Qualite : 0.1639586909166268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20934028_28-02-2025_17_26_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20934028 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20934028 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935530 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935531 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20935532 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936067 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936068 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936069 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936070 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936071 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936072 order by id desc limit 1 Qualite : 0.15966075121649642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20936073_28-02-2025_18_37_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20936073 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936074 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936075 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936076 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936469 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936470 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936471 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936472 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936473 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936474 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936475 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936476 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936477 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936478 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936479 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936480 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20936481 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937371 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937372 order by id desc limit 1 Qualite : 0.24449189314433856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20937373_28-02-2025_19_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20937373 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20937373 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938277 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20938279 order by id desc limit 1 Qualite : 0.20431565272239982 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20939698_28-02-2025_22_01_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20939698 AND mptpi.`type`=4230 To do Qualite : 0.1722945259380154 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20939699_28-02-2025_20_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20939699 AND mptpi.`type`=4230 To do Qualite : 0.2252823435782075 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20939724_28-02-2025_20_11_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20939724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20939724 AND mptpi.`type`=4230 To do Qualite : 0.23319763533426088 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940738_28-02-2025_22_26_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20940738 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940738 AND mptpi.`type`=4230 To do Qualite : 0.23788780239766558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20940739_28-02-2025_20_48_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20940739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20940739 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28022025': {'nb_upload': 62, 'nb_taggue_class': 62, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340207408, 1340207406, 1340207403, 1340207401, 1340207397] Looping around the photos to save general results len do output : 1 /20940738Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207408', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207406', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207403', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207401', None, None, None, None, None, '2625050') ('4234', None, None, None, None, None, None, None, '2625050') ('4234', None, '1340207397', None, None, None, None, None, '2625050') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012490510940551758 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.19374966621399 time spend to save output : 0.012799978256225586 total time spend for step 11 : 56.206549644470215 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 71.83user 38.20system 7:23.03elapsed 24%CPU (0avgtext+0avgdata 2370100maxresident)k 968760inputs+39368outputs (10161major+3110776minor)pagefaults 0swaps