python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1232377 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2646433'] with mtr_portfolio_ids : ['21130828'] and first list_photo_ids : [] new path : /proc/1232377/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.5169320106506348 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Mar 8 16:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2721 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-08 16:20:32.624282: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-08 16:20:32.651398: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-08 16:20:32.653386: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8abc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-08 16:20:32.653441: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-08 16:20:32.657162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-08 16:20:32.814574: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3f9bad50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-08 16:20:32.814625: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-08 16:20:32.815666: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 16:20:32.816052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 16:20:32.818948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 16:20:32.821642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 16:20:32.822128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 16:20:32.825693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 16:20:32.827139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 16:20:32.833526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 16:20:32.834739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 16:20:32.834823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 16:20:32.835479: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-08 16:20:32.835500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-08 16:20:32.835510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-08 16:20:32.836628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2269 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-08 16:20:33.151978: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 16:20:33.152072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 16:20:33.152092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 16:20:33.152111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 16:20:33.152128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 16:20:33.152146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 16:20:33.152163: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 16:20:33.152182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 16:20:33.153235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 16:20:33.154572: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 16:20:33.154620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 16:20:33.154640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 16:20:33.154657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 16:20:33.154674: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 16:20:33.154691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 16:20:33.154708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 16:20:33.154726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 16:20:33.155900: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 16:20:33.155963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-08 16:20:33.155981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-08 16:20:33.155995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-08 16:20:33.157341: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2269 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-08 16:20:43.025255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 16:20:43.238842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 16:20:45.020845: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.020975: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.028218: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.028252: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.082712: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.082788: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.125217: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.125253: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.175330: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.175386: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 16:20:45.177388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.22G (1307443200 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.177842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.10G (1176698880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.177880: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-08 16:20:45.191763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.192347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.218394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.218912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.220397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.220942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.226233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.226778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.228353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.228859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.234324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.234832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.236289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.236793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.262683: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.263344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.264246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.264897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.269018: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.269636: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.285435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.286022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.286563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.287114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.299970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.300590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.301134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.301676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.306214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.306770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.311505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.312055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.324498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.325053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.329241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.329791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.330538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.331107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.341815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.342347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.342877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.343440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.343986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.344554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.436111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.436705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.453077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.453863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.454585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.455321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.459654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.460225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.460798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.461380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.462383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.462405: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-08 16:20:45.472792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.473342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.482489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.483090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.483680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.484238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.484801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 16:20:45.485374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.72G (1844314112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.87969 max: 145.73672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0006282329559326172 length of segment : 39 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 22 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 28 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00040435791015625 length of segment : 14 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 34 time to create 1 rle with old method : 0.00010371208190917969 length of segment : 10 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0012772083282470703 length of segment : 61 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 22 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0015921592712402344 length of segment : 62 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 1825 time to create 1 rle with old method : 0.003306150436401367 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.79375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003323554992675781 length of segment : 12 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005660057067871094 length of segment : 49 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2276 time to create 1 rle with old method : 0.0030498504638671875 length of segment : 110 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2356 time to create 1 rle with old method : 0.0035181045532226562 length of segment : 80 Processing 1 images image shape: (400, 400, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -100.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 4087 time to create 1 rle with old method : 0.005306720733642578 length of segment : 63 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0010528564453125 length of segment : 20 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0012364387512207031 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.57891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0007152557373046875 length of segment : 20 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 1344 time to create 1 rle with old method : 0.002645730972290039 length of segment : 63 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00022983551025390625 length of segment : 9 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0011334419250488281 length of segment : 28 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0007104873657226562 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 20 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 8366 time to create 1 rle with old method : 0.01125478744506836 length of segment : 89 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.66250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0017940998077392578 length of segment : 80 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.00081634521484375 length of segment : 17 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0013871192932128906 length of segment : 87 time for calcul the mask position with numpy : 0.0005240440368652344 nb_pixel_total : 37717 time to create 1 rle with old method : 0.04623889923095703 length of segment : 465 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 64377 time to create 1 rle with old method : 0.07960772514343262 length of segment : 309 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -85.20781 max: 65.56484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.87188 max: 132.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006532669067382812 length of segment : 19 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0017578601837158203 length of segment : 32 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2185 time to create 1 rle with old method : 0.0030434131622314453 length of segment : 47 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0006775856018066406 length of segment : 17 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00046896934509277344 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.27422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 10 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0006074905395507812 length of segment : 16 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 1163 time to create 1 rle with old method : 0.002390146255493164 length of segment : 27 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009851455688476562 length of segment : 32 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0012967586517333984 length of segment : 52 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 4077 time to create 1 rle with old method : 0.005738258361816406 length of segment : 70 time for calcul the mask position with numpy : 0.0004773139953613281 nb_pixel_total : 96 time to create 1 rle with old method : 0.0004825592041015625 length of segment : 7 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.46172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00022363662719726562 length of segment : 14 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.0012123584747314453 length of segment : 34 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 1120 time to create 1 rle with old method : 0.001550912857055664 length of segment : 150 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0018291473388671875 length of segment : 43 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 10327 time to create 1 rle with old method : 0.013840913772583008 length of segment : 248 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2769 time to create 1 rle with old method : 0.003597259521484375 length of segment : 103 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0017242431640625 length of segment : 77 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 176 time to create 1 rle with old method : 0.00032782554626464844 length of segment : 29 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005717277526855469 length of segment : 40 time for calcul the mask position with numpy : 0.00018310546875 nb_pixel_total : 9126 time to create 1 rle with old method : 0.011503934860229492 length of segment : 154 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 3860 time to create 1 rle with old method : 0.00496983528137207 length of segment : 142 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 185.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 60.70937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000986337661743164 nb_pixel_total : 105228 time to create 1 rle with old method : 0.12772297859191895 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.61953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.000339508056640625 length of segment : 15 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 5644 time to create 1 rle with old method : 0.008311271667480469 length of segment : 83 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0012359619140625 length of segment : 41 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 2863 time to create 1 rle with old method : 0.003850698471069336 length of segment : 61 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008792877197265625 length of segment : 30 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 15 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 57 time to create 1 rle with old method : 0.000118255615234375 length of segment : 9 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00044345855712890625 length of segment : 22 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1032 time to create 1 rle with old method : 0.0014033317565917969 length of segment : 44 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 9885 time to create 1 rle with old method : 0.013475656509399414 length of segment : 272 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0008552074432373047 length of segment : 21 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 18 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0010039806365966797 length of segment : 36 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 16 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0018506050109863281 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.72109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 592 time to create 1 rle with old method : 0.0008947849273681641 length of segment : 35 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0016109943389892578 length of segment : 39 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 372 time to create 1 rle with old method : 0.0005702972412109375 length of segment : 25 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004525184631347656 length of segment : 20 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0014455318450927734 length of segment : 52 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0005707740783691406 length of segment : 29 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008993148803710938 length of segment : 31 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00016736984252929688 length of segment : 10 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1571 time to create 1 rle with old method : 0.002167224884033203 length of segment : 87 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00042438507080078125 length of segment : 16 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0008332729339599609 length of segment : 42 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0009355545043945312 length of segment : 42 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00021076202392578125 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 30 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00037741661071777344 length of segment : 31 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008561611175537109 length of segment : 27 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0008168220520019531 length of segment : 25 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 2559 time to create 1 rle with old method : 0.0033075809478759766 length of segment : 104 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0005166530609130859 length of segment : 24 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0006682872772216797 length of segment : 22 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008285045623779297 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 42 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.000576019287109375 length of segment : 30 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006797313690185547 length of segment : 27 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008950233459472656 length of segment : 43 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 290 time to create 1 rle with old method : 0.0005166530609130859 length of segment : 32 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.000453948974609375 length of segment : 20 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 23 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0010073184967041016 length of segment : 38 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004229545593261719 length of segment : 20 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006597042083740234 length of segment : 30 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 601 time to create 1 rle with old method : 0.0008893013000488281 length of segment : 33 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002903938293457031 length of segment : 16 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008931159973144531 length of segment : 96 time for calcul the mask position with numpy : 0.00014591217041015625 nb_pixel_total : 2245 time to create 1 rle with old method : 0.0032196044921875 length of segment : 143 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.80156 max: 145.12734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 40 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 15 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0010356903076171875 length of segment : 65 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016498565673828125 length of segment : 26 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0012018680572509766 length of segment : 47 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0011508464813232422 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.59453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1314 time to create 1 rle with old method : 0.0017480850219726562 length of segment : 35 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1316 time to create 1 rle with old method : 0.0018892288208007812 length of segment : 37 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 3148 time to create 1 rle with old method : 0.004135608673095703 length of segment : 58 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.0009584426879882812 length of segment : 34 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 3087 time to create 1 rle with old method : 0.004020214080810547 length of segment : 65 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.68828 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 4259 time to create 1 rle with old method : 0.0054759979248046875 length of segment : 61 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007650852203369141 length of segment : 34 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.001514434814453125 length of segment : 24 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0009098052978515625 length of segment : 21 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0016970634460449219 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005412101745605469 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 23 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0010797977447509766 length of segment : 40 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 900 time to create 1 rle with old method : 0.00140380859375 length of segment : 97 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.001056671142578125 length of segment : 41 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0008399486541748047 length of segment : 29 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.32656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0014193058013916016 length of segment : 58 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007555484771728516 length of segment : 17 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0016133785247802734 length of segment : 86 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1336 time to create 1 rle with old method : 0.0016987323760986328 length of segment : 91 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005311965942382812 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 191.00000 molded_images shape: (1, 640, 640, 3) min: -88.05156 max: 68.35781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.60625 max: 129.22109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0016281604766845703 length of segment : 33 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.001085519790649414 length of segment : 18 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2164 time to create 1 rle with old method : 0.0030851364135742188 length of segment : 46 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003848075866699219 length of segment : 17 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0008931159973144531 length of segment : 39 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 7546 time to create 1 rle with old method : 0.009471893310546875 length of segment : 135 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.60234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002384185791015625 length of segment : 11 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00041174888610839844 length of segment : 18 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 13 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0009889602661132812 length of segment : 15 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 693 time to create 1 rle with old method : 0.0009183883666992188 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.61797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0014073848724365234 length of segment : 35 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00024318695068359375 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0017538070678710938 length of segment : 43 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003604888916015625 length of segment : 22 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 955 time to create 1 rle with old method : 0.0014619827270507812 length of segment : 36 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0009760856628417969 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002810955047607422 length of segment : 29 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2498 time to create 1 rle with old method : 0.0032122135162353516 length of segment : 112 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0010161399841308594 length of segment : 50 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0009703636169433594 length of segment : 45 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0017788410186767578 length of segment : 70 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0010790824890136719 length of segment : 42 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.0012280941009521484 length of segment : 31 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009436607360839844 length of segment : 39 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 3716 time to create 1 rle with old method : 0.005129337310791016 length of segment : 212 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009698867797851562 length of segment : 48 Processing 1 images image shape: (280, 400, 3) min: 17.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 63.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009539127349853516 nb_pixel_total : 103719 time to create 1 rle with old method : 0.12130880355834961 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.32266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0006263256072998047 length of segment : 19 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 15 time for calcul the mask position with numpy : 0.0002777576446533203 nb_pixel_total : 5597 time to create 1 rle with old method : 0.024312257766723633 length of segment : 85 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.0001399517059326172 length of segment : 8 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0017859935760498047 length of segment : 44 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 3695 time to create 1 rle with old method : 0.009186744689941406 length of segment : 96 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 3628 time to create 1 rle with old method : 0.0068817138671875 length of segment : 115 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0009315013885498047 length of segment : 31 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.00045800209045410156 length of segment : 17 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00013947486877441406 length of segment : 12 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 11166 time to create 1 rle with old method : 0.016689062118530273 length of segment : 195 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1507 time to create 1 rle with old method : 0.0028390884399414062 length of segment : 37 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00019311904907226562 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008537769317626953 length of segment : 36 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1187 time to create 1 rle with old method : 0.0016369819641113281 length of segment : 39 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004754066467285156 length of segment : 20 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004284381866455078 length of segment : 17 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00020313262939453125 length of segment : 18 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0002338886260986328 length of segment : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008902549743652344 length of segment : 38 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0015478134155273438 length of segment : 47 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0008189678192138672 length of segment : 24 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 608 time to create 1 rle with old method : 0.0009238719940185547 length of segment : 49 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005450248718261719 length of segment : 25 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 16 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005636215209960938 length of segment : 33 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 582 time to create 1 rle with old method : 0.0011799335479736328 length of segment : 28 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.001074075698852539 length of segment : 39 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005855560302734375 length of segment : 47 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0005528926849365234 length of segment : 21 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0008757114410400391 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 32 time to create 1 rle with old method : 0.00010323524475097656 length of segment : 4 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00017833709716796875 length of segment : 15 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0011990070343017578 length of segment : 46 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005931854248046875 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00021696090698242188 length of segment : 9 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009450912475585938 length of segment : 40 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002319812774658203 length of segment : 25 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 1183 time to create 1 rle with old method : 0.0016338825225830078 length of segment : 139 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00030493736267089844 length of segment : 16 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0010323524475097656 length of segment : 97 Detection mask done ! Trying to reset tf kernel 1233012 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 335 tf kernel not reseted sub process len(results) : 203 len(list_Values) 203 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 203 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1528 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 203 chid ids of type : 4228 Number RLEs to save : 10061 save missing photos in datou_result : time spend for datou_step_exec : 25.425921201705933 time spend to save output : 5.266978025436401 total time spend for step 1 : 30.692899227142334 step2:brightness Sat Mar 8 16:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741447229_1232377_1341284099_fac765e6829db81de25cd1f4c2252171.jpg treat image : temp/1741447229_1232377_1341284095_593f6fd1af631fefc656cfc4b34c9813.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.12092471122741699 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.014310121536254883 save missing photos in datou_result : time spend for datou_step_exec : 0.5115110874176025 time spend to save output : 0.13993048667907715 total time spend for step 2 : 0.6514415740966797 step3:blur_detection Sat Mar 8 16:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741447229_1232377_1341284099_fac765e6829db81de25cd1f4c2252171.jpg resize: (1080, 1920) 1341284099 -7.224648649613323 treat image : temp/1741447229_1232377_1341284095_593f6fd1af631fefc656cfc4b34c9813.jpg resize: (1080, 1920) 1341284095 -7.24710712875951 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011200904846191406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.017116308212280273 save missing photos in datou_result : time spend for datou_step_exec : 1.8573005199432373 time spend to save output : 0.03288912773132324 total time spend for step 3 : 1.8901896476745605 step4:rle_unique_nms_with_priority Sat Mar 8 16:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 203 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 103 nb_hashtags : 7 time to prepare the origin masks : 1.1958186626434326 time for calcul the mask position with numpy : 0.10100293159484863 nb_pixel_total : 1791468 time to create 1 rle with new method : 0.2772378921508789 time for calcul the mask position with numpy : 0.008614540100097656 nb_pixel_total : 30806 time to create 1 rle with old method : 0.03746175765991211 time for calcul the mask position with numpy : 0.008688926696777344 nb_pixel_total : 2356 time to create 1 rle with old method : 0.002830028533935547 time for calcul the mask position with numpy : 0.008543252944946289 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007433891296386719 time for calcul the mask position with numpy : 0.008557319641113281 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003306865692138672 time for calcul the mask position with numpy : 0.00860142707824707 nb_pixel_total : 102 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.008735418319702148 nb_pixel_total : 290 time to create 1 rle with old method : 0.00037598609924316406 time for calcul the mask position with numpy : 0.008760213851928711 nb_pixel_total : 1825 time to create 1 rle with old method : 0.002197265625 time for calcul the mask position with numpy : 0.00882863998413086 nb_pixel_total : 340 time to create 1 rle with old method : 0.00043845176696777344 time for calcul the mask position with numpy : 0.008750677108764648 nb_pixel_total : 23 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.008832454681396484 nb_pixel_total : 4087 time to create 1 rle with old method : 0.004775524139404297 time for calcul the mask position with numpy : 0.008832216262817383 nb_pixel_total : 10 time to create 1 rle with old method : 5.7220458984375e-05 time for calcul the mask position with numpy : 0.008772850036621094 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.009015560150146484 nb_pixel_total : 36314 time to create 1 rle with old method : 0.04296302795410156 time for calcul the mask position with numpy : 0.008474111557006836 nb_pixel_total : 7 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.008431434631347656 nb_pixel_total : 192 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.00852656364440918 nb_pixel_total : 1067 time to create 1 rle with old method : 0.0017960071563720703 time for calcul the mask position with numpy : 0.009641885757446289 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0022351741790771484 time for calcul the mask position with numpy : 0.009783506393432617 nb_pixel_total : 213 time to create 1 rle with old method : 0.00037026405334472656 time for calcul the mask position with numpy : 0.009688615798950195 nb_pixel_total : 2276 time to create 1 rle with old method : 0.003739595413208008 time for calcul the mask position with numpy : 0.009716272354125977 nb_pixel_total : 86 time to create 1 rle with old method : 0.00016736984252929688 time for calcul the mask position with numpy : 0.00978851318359375 nb_pixel_total : 145 time to create 1 rle with old method : 0.00029659271240234375 time for calcul the mask position with numpy : 0.0097198486328125 nb_pixel_total : 707 time to create 1 rle with old method : 0.001188516616821289 time for calcul the mask position with numpy : 0.009755134582519531 nb_pixel_total : 359 time to create 1 rle with old method : 0.0006377696990966797 time for calcul the mask position with numpy : 0.009302854537963867 nb_pixel_total : 494 time to create 1 rle with old method : 0.0006017684936523438 time for calcul the mask position with numpy : 0.00839853286743164 nb_pixel_total : 1418 time to create 1 rle with old method : 0.001646280288696289 time for calcul the mask position with numpy : 0.00845026969909668 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005521774291992188 time for calcul the mask position with numpy : 0.008458852767944336 nb_pixel_total : 8366 time to create 1 rle with old method : 0.009719133377075195 time for calcul the mask position with numpy : 0.008487701416015625 nb_pixel_total : 175 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.008420705795288086 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006666183471679688 time for calcul the mask position with numpy : 0.00847625732421875 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008385181427001953 time for calcul the mask position with numpy : 0.00847482681274414 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.008449077606201172 nb_pixel_total : 1163 time to create 1 rle with old method : 0.0014431476593017578 time for calcul the mask position with numpy : 0.008603572845458984 nb_pixel_total : 4077 time to create 1 rle with old method : 0.0047359466552734375 time for calcul the mask position with numpy : 0.008444786071777344 nb_pixel_total : 88 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.010060787200927734 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0016450881958007812 time for calcul the mask position with numpy : 0.008901596069335938 nb_pixel_total : 227 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.01069331169128418 nb_pixel_total : 429 time to create 1 rle with old method : 0.0007627010345458984 time for calcul the mask position with numpy : 0.008930206298828125 nb_pixel_total : 2769 time to create 1 rle with old method : 0.003387928009033203 time for calcul the mask position with numpy : 0.008541345596313477 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003237724304199219 time for calcul the mask position with numpy : 0.008927106857299805 nb_pixel_total : 3 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.008780479431152344 nb_pixel_total : 9912 time to create 1 rle with old method : 0.01218271255493164 time for calcul the mask position with numpy : 0.00851130485534668 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005371570587158203 time for calcul the mask position with numpy : 0.008499860763549805 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001857280731201172 time for calcul the mask position with numpy : 0.008505582809448242 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.008447408676147461 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0013642311096191406 time for calcul the mask position with numpy : 0.008491277694702148 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0014972686767578125 time for calcul the mask position with numpy : 0.008550882339477539 nb_pixel_total : 8828 time to create 1 rle with old method : 0.010242938995361328 time for calcul the mask position with numpy : 0.008542299270629883 nb_pixel_total : 2185 time to create 1 rle with old method : 0.0025615692138671875 time for calcul the mask position with numpy : 0.008559703826904297 nb_pixel_total : 3860 time to create 1 rle with old method : 0.0046329498291015625 time for calcul the mask position with numpy : 0.008622884750366211 nb_pixel_total : 1320 time to create 1 rle with old method : 0.0015511512756347656 time for calcul the mask position with numpy : 0.008599042892456055 nb_pixel_total : 826 time to create 1 rle with old method : 0.001062631607055664 time for calcul the mask position with numpy : 0.008595466613769531 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001850128173828125 time for calcul the mask position with numpy : 0.009355545043945312 nb_pixel_total : 105228 time to create 1 rle with old method : 0.11952781677246094 time for calcul the mask position with numpy : 0.008594274520874023 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007245540618896484 time for calcul the mask position with numpy : 0.00854635238647461 nb_pixel_total : 90 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.008549690246582031 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004172325134277344 time for calcul the mask position with numpy : 0.008408069610595703 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007140636444091797 time for calcul the mask position with numpy : 0.008388996124267578 nb_pixel_total : 8894 time to create 1 rle with old method : 0.010419607162475586 time for calcul the mask position with numpy : 0.00847172737121582 nb_pixel_total : 2245 time to create 1 rle with old method : 0.0027146339416503906 time for calcul the mask position with numpy : 0.008392095565795898 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.008322954177856445 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.008399009704589844 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003600120544433594 time for calcul the mask position with numpy : 0.008454084396362305 nb_pixel_total : 439 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.008465051651000977 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0012950897216796875 time for calcul the mask position with numpy : 0.008474588394165039 nb_pixel_total : 2 time to create 1 rle with old method : 2.1696090698242188e-05 time for calcul the mask position with numpy : 0.008428812026977539 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015044212341308594 time for calcul the mask position with numpy : 0.00839853286743164 nb_pixel_total : 191 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.008470535278320312 nb_pixel_total : 223 time to create 1 rle with old method : 0.00029397010803222656 time for calcul the mask position with numpy : 0.008478641510009766 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.008468151092529297 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006730556488037109 time for calcul the mask position with numpy : 0.008527517318725586 nb_pixel_total : 132 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.008439779281616211 nb_pixel_total : 1571 time to create 1 rle with old method : 0.001988649368286133 time for calcul the mask position with numpy : 0.009774923324584961 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.008513927459716797 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007970333099365234 time for calcul the mask position with numpy : 0.008546590805053711 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003790855407714844 time for calcul the mask position with numpy : 0.008524656295776367 nb_pixel_total : 2863 time to create 1 rle with old method : 0.0034112930297851562 time for calcul the mask position with numpy : 0.00850987434387207 nb_pixel_total : 21 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.008515357971191406 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0013620853424072266 time for calcul the mask position with numpy : 0.00838780403137207 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003209114074707031 time for calcul the mask position with numpy : 0.008281946182250977 nb_pixel_total : 243 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.008467435836791992 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.008422136306762695 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.00838327407836914 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004684925079345703 time for calcul the mask position with numpy : 0.008439064025878906 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010085105895996094 time for calcul the mask position with numpy : 0.008385419845581055 nb_pixel_total : 420 time to create 1 rle with old method : 0.0004868507385253906 time for calcul the mask position with numpy : 0.008386611938476562 nb_pixel_total : 2371 time to create 1 rle with old method : 0.0027327537536621094 time for calcul the mask position with numpy : 0.008395671844482422 nb_pixel_total : 60 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.008382320404052734 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005908012390136719 time for calcul the mask position with numpy : 0.008371114730834961 nb_pixel_total : 235 time to create 1 rle with old method : 0.00030517578125 time for calcul the mask position with numpy : 0.008389472961425781 nb_pixel_total : 5644 time to create 1 rle with old method : 0.006865262985229492 time for calcul the mask position with numpy : 0.008446216583251953 nb_pixel_total : 592 time to create 1 rle with old method : 0.0007190704345703125 time for calcul the mask position with numpy : 0.008470296859741211 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008218288421630859 time for calcul the mask position with numpy : 0.008439064025878906 nb_pixel_total : 659 time to create 1 rle with old method : 0.0008151531219482422 time for calcul the mask position with numpy : 0.008485078811645508 nb_pixel_total : 34 time to create 1 rle with old method : 0.0001010894775390625 time for calcul the mask position with numpy : 0.008447408676147461 nb_pixel_total : 80 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.00840139389038086 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005955696105957031 time for calcul the mask position with numpy : 0.008429288864135742 nb_pixel_total : 98 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.008630037307739258 nb_pixel_total : 912 time to create 1 rle with old method : 0.0010652542114257812 time for calcul the mask position with numpy : 0.008556604385375977 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0013127326965332031 time for calcul the mask position with numpy : 0.008507728576660156 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006680488586425781 time for calcul the mask position with numpy : 0.008340120315551758 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.008476972579956055 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007259845733642578 time for calcul the mask position with numpy : 0.008496999740600586 nb_pixel_total : 7 time to create 1 rle with old method : 5.626678466796875e-05 create new chi : 1.620708703994751 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.009997844696044922 batch 1 Loaded 104 chid ids of type : 4230 Number RLEs to save : 11259 TO DO : save crop sub photo not yet done ! save time : 2.6750903129577637 nb_obj : 100 nb_hashtags : 6 time to prepare the origin masks : 2.7281742095947266 time for calcul the mask position with numpy : 0.05666303634643555 nb_pixel_total : 1884352 time to create 1 rle with new method : 0.2663097381591797 time for calcul the mask position with numpy : 0.012156963348388672 nb_pixel_total : 3148 time to create 1 rle with old method : 0.0054204463958740234 time for calcul the mask position with numpy : 0.008366584777832031 nb_pixel_total : 102 time to create 1 rle with old method : 0.0002923011779785156 time for calcul the mask position with numpy : 0.008076906204223633 nb_pixel_total : 1314 time to create 1 rle with old method : 0.0022449493408203125 time for calcul the mask position with numpy : 0.00770115852355957 nb_pixel_total : 245 time to create 1 rle with old method : 0.0004761219024658203 time for calcul the mask position with numpy : 0.00802755355834961 nb_pixel_total : 701 time to create 1 rle with old method : 0.0012335777282714844 time for calcul the mask position with numpy : 0.007861614227294922 nb_pixel_total : 28 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.007924318313598633 nb_pixel_total : 301 time to create 1 rle with old method : 0.00037741661071777344 time for calcul the mask position with numpy : 0.007717132568359375 nb_pixel_total : 56 time to create 1 rle with old method : 0.00015473365783691406 time for calcul the mask position with numpy : 0.009464263916015625 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.00947713851928711 nb_pixel_total : 4259 time to create 1 rle with old method : 0.004904031753540039 time for calcul the mask position with numpy : 0.008677005767822266 nb_pixel_total : 148 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.008056402206420898 nb_pixel_total : 47 time to create 1 rle with old method : 8.845329284667969e-05 time for calcul the mask position with numpy : 0.013271093368530273 nb_pixel_total : 777 time to create 1 rle with old method : 0.0009472370147705078 time for calcul the mask position with numpy : 0.010908842086791992 nb_pixel_total : 105 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.010134220123291016 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0015010833740234375 time for calcul the mask position with numpy : 0.010029315948486328 nb_pixel_total : 736 time to create 1 rle with old method : 0.0009734630584716797 time for calcul the mask position with numpy : 0.010112285614013672 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003108978271484375 time for calcul the mask position with numpy : 0.010373592376708984 nb_pixel_total : 900 time to create 1 rle with old method : 0.0011620521545410156 time for calcul the mask position with numpy : 0.010598897933959961 nb_pixel_total : 702 time to create 1 rle with old method : 0.0008699893951416016 time for calcul the mask position with numpy : 0.01016998291015625 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003123283386230469 time for calcul the mask position with numpy : 0.009682178497314453 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0012083053588867188 time for calcul the mask position with numpy : 0.009067296981811523 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.01032257080078125 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006563663482666016 time for calcul the mask position with numpy : 0.010525941848754883 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005986690521240234 time for calcul the mask position with numpy : 0.010453224182128906 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0012905597686767578 time for calcul the mask position with numpy : 0.011775970458984375 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004532337188720703 time for calcul the mask position with numpy : 0.01313018798828125 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016379356384277344 time for calcul the mask position with numpy : 0.013562202453613281 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006549358367919922 time for calcul the mask position with numpy : 0.012673616409301758 nb_pixel_total : 693 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.013583660125732422 nb_pixel_total : 731 time to create 1 rle with old method : 0.00087738037109375 time for calcul the mask position with numpy : 0.012900590896606445 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002357959747314453 time for calcul the mask position with numpy : 0.012857198715209961 nb_pixel_total : 188 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.011849403381347656 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007269382476806641 time for calcul the mask position with numpy : 0.011693716049194336 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0015304088592529297 time for calcul the mask position with numpy : 0.012448787689208984 nb_pixel_total : 33 time to create 1 rle with old method : 7.939338684082031e-05 time for calcul the mask position with numpy : 0.012225627899169922 nb_pixel_total : 686 time to create 1 rle with old method : 0.0008153915405273438 time for calcul the mask position with numpy : 0.011807918548583984 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003781318664550781 time for calcul the mask position with numpy : 0.011249303817749023 nb_pixel_total : 722 time to create 1 rle with old method : 0.0008847713470458984 time for calcul the mask position with numpy : 0.011433124542236328 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.010591745376586914 nb_pixel_total : 7546 time to create 1 rle with old method : 0.008781194686889648 time for calcul the mask position with numpy : 0.008702278137207031 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008990764617919922 time for calcul the mask position with numpy : 0.008611679077148438 nb_pixel_total : 2498 time to create 1 rle with old method : 0.003025531768798828 time for calcul the mask position with numpy : 0.010685443878173828 nb_pixel_total : 5 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.009310483932495117 nb_pixel_total : 143 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.009185075759887695 nb_pixel_total : 247 time to create 1 rle with old method : 0.00033593177795410156 time for calcul the mask position with numpy : 0.008939027786254883 nb_pixel_total : 12 time to create 1 rle with old method : 7.2479248046875e-05 time for calcul the mask position with numpy : 0.009465694427490234 nb_pixel_total : 3716 time to create 1 rle with old method : 0.004389524459838867 time for calcul the mask position with numpy : 0.009537220001220703 nb_pixel_total : 659 time to create 1 rle with old method : 0.0009002685546875 time for calcul the mask position with numpy : 0.008737564086914062 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.00917959213256836 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005681514739990234 time for calcul the mask position with numpy : 0.008809804916381836 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0015211105346679688 time for calcul the mask position with numpy : 0.007277011871337891 nb_pixel_total : 2164 time to create 1 rle with old method : 0.0027523040771484375 time for calcul the mask position with numpy : 0.007200956344604492 nb_pixel_total : 955 time to create 1 rle with old method : 0.0012164115905761719 time for calcul the mask position with numpy : 0.007237434387207031 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0014781951904296875 time for calcul the mask position with numpy : 0.0068509578704833984 nb_pixel_total : 955 time to create 1 rle with old method : 0.0011713504791259766 time for calcul the mask position with numpy : 0.00756382942199707 nb_pixel_total : 138 time to create 1 rle with old method : 0.0002598762512207031 time for calcul the mask position with numpy : 0.009317159652709961 nb_pixel_total : 103719 time to create 1 rle with old method : 0.1604762077331543 time for calcul the mask position with numpy : 0.00765538215637207 nb_pixel_total : 303 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.007227897644042969 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008826255798339844 time for calcul the mask position with numpy : 0.008624792098999023 nb_pixel_total : 8201 time to create 1 rle with old method : 0.009696483612060547 time for calcul the mask position with numpy : 0.007465362548828125 nb_pixel_total : 80 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.007787942886352539 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003752708435058594 time for calcul the mask position with numpy : 0.00714564323425293 nb_pixel_total : 114 time to create 1 rle with old method : 0.00016736984252929688 time for calcul the mask position with numpy : 0.007487773895263672 nb_pixel_total : 3628 time to create 1 rle with old method : 0.0053501129150390625 time for calcul the mask position with numpy : 0.007918596267700195 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.0070209503173828125 nb_pixel_total : 1145 time to create 1 rle with old method : 0.0013508796691894531 time for calcul the mask position with numpy : 0.006985664367675781 nb_pixel_total : 1040 time to create 1 rle with old method : 0.0012631416320800781 time for calcul the mask position with numpy : 0.007470846176147461 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.008105993270874023 nb_pixel_total : 127 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.008733034133911133 nb_pixel_total : 275 time to create 1 rle with old method : 0.0004062652587890625 time for calcul the mask position with numpy : 0.007882833480834961 nb_pixel_total : 582 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.007094383239746094 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002815723419189453 time for calcul the mask position with numpy : 0.007784843444824219 nb_pixel_total : 122 time to create 1 rle with old method : 0.0003409385681152344 time for calcul the mask position with numpy : 0.0077402591705322266 nb_pixel_total : 495 time to create 1 rle with old method : 0.0008561611175537109 time for calcul the mask position with numpy : 0.007037639617919922 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.007126569747924805 nb_pixel_total : 641 time to create 1 rle with old method : 0.0009131431579589844 time for calcul the mask position with numpy : 0.006992340087890625 nb_pixel_total : 608 time to create 1 rle with old method : 0.0008032321929931641 time for calcul the mask position with numpy : 0.007110595703125 nb_pixel_total : 299 time to create 1 rle with old method : 0.00039696693420410156 time for calcul the mask position with numpy : 0.007493257522583008 nb_pixel_total : 569 time to create 1 rle with old method : 0.000888824462890625 time for calcul the mask position with numpy : 0.008059978485107422 nb_pixel_total : 3695 time to create 1 rle with old method : 0.005276918411254883 time for calcul the mask position with numpy : 0.00784444808959961 nb_pixel_total : 1187 time to create 1 rle with old method : 0.0015895366668701172 time for calcul the mask position with numpy : 0.008526802062988281 nb_pixel_total : 261 time to create 1 rle with old method : 0.00034236907958984375 time for calcul the mask position with numpy : 0.008036375045776367 nb_pixel_total : 78 time to create 1 rle with old method : 0.00014257431030273438 time for calcul the mask position with numpy : 0.00809931755065918 nb_pixel_total : 50 time to create 1 rle with old method : 9.560585021972656e-05 time for calcul the mask position with numpy : 0.008365154266357422 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005342960357666016 time for calcul the mask position with numpy : 0.009171247482299805 nb_pixel_total : 374 time to create 1 rle with old method : 0.0006618499755859375 time for calcul the mask position with numpy : 0.00881052017211914 nb_pixel_total : 32 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.007990121841430664 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.007999420166015625 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006270408630371094 time for calcul the mask position with numpy : 0.00797271728515625 nb_pixel_total : 5597 time to create 1 rle with old method : 0.006452322006225586 time for calcul the mask position with numpy : 0.007571697235107422 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007565021514892578 time for calcul the mask position with numpy : 0.007466316223144531 nb_pixel_total : 732 time to create 1 rle with old method : 0.0009198188781738281 time for calcul the mask position with numpy : 0.007042884826660156 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008800029754638672 time for calcul the mask position with numpy : 0.007341623306274414 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005290508270263672 time for calcul the mask position with numpy : 0.007653236389160156 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.006636142730712891 nb_pixel_total : 971 time to create 1 rle with old method : 0.0011954307556152344 time for calcul the mask position with numpy : 0.007113218307495117 nb_pixel_total : 102 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.007306814193725586 nb_pixel_total : 567 time to create 1 rle with old method : 0.000682830810546875 time for calcul the mask position with numpy : 0.007586479187011719 nb_pixel_total : 214 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.00741267204284668 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005753040313720703 create new chi : 1.498241901397705 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0012965202331542969 batch 1 Loaded 101 chid ids of type : 4230 Number RLEs to save : 9112 TO DO : save crop sub photo not yet done ! save time : 4.272857189178467 map_output_result : {1341284099: (0.0, 'Should be the crop_list due to order', 0.0), 1341284095: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 2 /1341284099.Didn't retrieve data . /1341284095.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.016398906707763672 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.50910496711731 time spend to save output : 0.016721010208129883 total time spend for step 4 : 14.52582597732544 step5:crop_condition Sat Mar 8 16:21:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 205 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 84 About to insert : list_path_to_insert length 84 new photo from crops ! About to upload 84 photos upload in portfolio : 4869462 init cache_photo without model_param we have 84 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447279_1232377 we have uploaded 84 photos in the portfolio 4869462 time of upload the photos Elapsed time : 24.635661840438843 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 4869462 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447304_1232377 we have uploaded 22 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.144222736358643 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447312_1232377 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8892679214477539 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447313_1232377 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.6948063373565674 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 4869462 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447316_1232377 we have uploaded 27 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.228893280029297 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741447324_1232377 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6058259010314941 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 145 /1341922332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341922519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 437 time used for this insertion : 0.03097987174987793 save_final save missing photos in datou_result : time spend for datou_step_exec : 54.33803129196167 time spend to save output : 0.036542415618896484 total time spend for step 5 : 54.374573707580566 step6:thcl Sat Mar 8 16:22:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.0016210079193115234 time to convert the images to numpy array : 0.018744230270385742 time to import caffe and check if the image exist : 0.010983943939208984 time to convert the images to numpy array : 0.032692909240722656 time to import caffe and check if the image exist : 0.01041269302368164 time to convert the images to numpy array : 0.035044193267822266 time to import caffe and check if the image exist : 0.015998125076293945 time to convert the images to numpy array : 0.03622126579284668 time to import caffe and check if the image exist : 0.008744478225708008 time to convert the images to numpy array : 0.04691290855407715 time to import caffe and check if the image exist : 0.010805845260620117 time to convert the images to numpy array : 0.04638528823852539 time to import caffe and check if the image exist : 0.023018836975097656 time to convert the images to numpy array : 0.03450798988342285 time to import caffe and check if the image exist : 0.013890266418457031 time to convert the images to numpy array : 0.04653811454772949 time to import caffe and check if the image exist : 0.02062225341796875 time to convert the images to numpy array : 0.0402073860168457 time to import caffe and check if the image exist : 0.02863454818725586 time to convert the images to numpy array : 0.032483816146850586 total time to convert the images to numpy array : 0.3529360294342041 list photo_ids error: [] list photo_ids correct : [1341922381, 1341922382, 1341922384, 1341922385, 1341922386, 1341922387, 1341922388, 1341922389, 1341922390, 1341922391, 1341922392, 1341922393, 1341922394, 1341922395, 1341922396, 1341922510, 1341922511, 1341922512, 1341922513, 1341922514, 1341922515, 1341922516, 1341922517, 1341922518, 1341922519, 1341922347, 1341922349, 1341922350, 1341922351, 1341922352, 1341922353, 1341922354, 1341922356, 1341922357, 1341922358, 1341922359, 1341922360, 1341922361, 1341922362, 1341922363, 1341922397, 1341922398, 1341922399, 1341922400, 1341922401, 1341922402, 1341922404, 1341922405, 1341922407, 1341922408, 1341922409, 1341922410, 1341922411, 1341922412, 1341922415, 1341922332, 1341922333, 1341922334, 1341922335, 1341922336, 1341922337, 1341922338, 1341922339, 1341922340, 1341922341, 1341922342, 1341922343, 1341922344, 1341922345, 1341922346, 1341922495, 1341922496, 1341922497, 1341922498, 1341922499, 1341922500, 1341922501, 1341922502, 1341922503, 1341922504, 1341922505, 1341922506, 1341922507, 1341922508, 1341922509, 1341922459, 1341922460, 1341922461, 1341922462, 1341922463, 1341922464, 1341922465, 1341922466, 1341922467, 1341922468, 1341922469, 1341922470, 1341922473, 1341922474, 1341922475, 1341922476, 1341922477, 1341922478, 1341922481, 1341922482, 1341922483, 1341922484, 1341922485, 1341922486, 1341922487, 1341922488, 1341922489, 1341922492, 1341922493, 1341922494, 1341922364, 1341922365, 1341922366, 1341922367, 1341922368, 1341922369, 1341922370, 1341922371, 1341922374, 1341922375, 1341922376, 1341922377, 1341922378, 1341922379, 1341922380, 1341922418, 1341922422, 1341922425, 1341922428, 1341922431, 1341922434, 1341922437, 1341922440, 1341922443, 1341922453, 1341922454, 1341922455, 1341922456, 1341922457, 1341922458] number of photos to traite : 145 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2721 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2502 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.7638254165649414 time used to do the prediction : 0.942436933517456 save descriptor for thcl : 3237 time to traite the descriptors : 0.917917013168335 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341922381 To insert : 1341922382 To insert : 1341922384 To insert : 1341922385 To insert : 1341922386 To insert : 1341922387 To insert : 1341922388 To insert : 1341922389 To insert : 1341922390 To insert : 1341922391 To insert : 1341922392 To insert : 1341922393 To insert : 1341922394 To insert : 1341922395 To insert : 1341922396 To insert : 1341922510 To insert : 1341922511 To insert : 1341922512 To insert : 1341922513 To insert : 1341922514 To insert : 1341922515 To insert : 1341922516 To insert : 1341922517 To insert : 1341922518 To insert : 1341922519 To insert : 1341922347 To insert : 1341922349 To insert : 1341922350 To insert : 1341922351 To insert : 1341922352 To insert : 1341922353 To insert : 1341922354 To insert : 1341922356 To insert : 1341922357 To insert : 1341922358 To insert : 1341922359 To insert : 1341922360 To insert : 1341922361 To insert : 1341922362 To insert : 1341922363 To insert : 1341922397 To insert : 1341922398 To insert : 1341922399 To insert : 1341922400 To insert : 1341922401 To insert : 1341922402 To insert : 1341922404 To insert : 1341922405 To insert : 1341922407 To insert : 1341922408 To insert : 1341922409 To insert : 1341922410 To insert : 1341922411 To insert : 1341922412 To insert : 1341922415 To insert : 1341922332 To insert : 1341922333 To insert : 1341922334 To insert : 1341922335 To insert : 1341922336 To insert : 1341922337 To insert : 1341922338 To insert : 1341922339 To insert : 1341922340 To insert : 1341922341 To insert : 1341922342 To insert : 1341922343 To insert : 1341922344 To insert : 1341922345 To insert : 1341922346 To insert : 1341922495 To insert : 1341922496 To insert : 1341922497 To insert : 1341922498 To insert : 1341922499 To insert : 1341922500 To insert : 1341922501 To insert : 1341922502 To insert : 1341922503 To insert : 1341922504 To insert : 1341922505 To insert : 1341922506 To insert : 1341922507 To insert : 1341922508 To insert : 1341922509 To insert : 1341922459 To insert : 1341922460 To insert : 1341922461 To insert : 1341922462 To insert : 1341922463 To insert : 1341922464 To insert : 1341922465 To insert : 1341922466 To insert : 1341922467 To insert : 1341922468 To insert : 1341922469 To insert : 1341922470 To insert : 1341922473 To insert : 1341922474 To insert : 1341922475 To insert : 1341922476 To insert : 1341922477 To insert : 1341922478 To insert : 1341922481 To insert : 1341922482 To insert : 1341922483 To insert : 1341922484 To insert : 1341922485 To insert : 1341922486 To insert : 1341922487 To insert : 1341922488 To insert : 1341922489 To insert : 1341922492 To insert : 1341922493 To insert : 1341922494 To insert : 1341922364 To insert : 1341922365 To insert : 1341922366 To insert : 1341922367 To insert : 1341922368 To insert : 1341922369 To insert : 1341922370 To insert : 1341922371 To insert : 1341922374 To insert : 1341922375 To insert : 1341922376 To insert : 1341922377 To insert : 1341922378 To insert : 1341922379 To insert : 1341922380 To insert : 1341922418 To insert : 1341922422 To insert : 1341922425 To insert : 1341922428 To insert : 1341922431 To insert : 1341922434 To insert : 1341922437 To insert : 1341922440 To insert : 1341922443 To insert : 1341922453 To insert : 1341922454 To insert : 1341922455 To insert : 1341922456 To insert : 1341922457 To insert : 1341922458 time to insert the descriptors : 29.89313817024231 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 231 time used for this insertion : 0.023314952850341797 save missing photos in datou_result : time spend for datou_step_exec : 37.14763951301575 time spend to save output : 0.0702047348022461 total time spend for step 6 : 37.21784424781799 step7:ventilate_hashtags_in_portfolio Sat Mar 8 16:22:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21130828 get user id for portfolio 21130828 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130828 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','pet_fonce','papier','mal_croppe','flou','Film_plastique','refus','Tetrapak','pehd','autre','PET_clair','metal','Papier','Carton','carton','PEHD','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130828 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','pet_fonce','papier','mal_croppe','flou','Film_plastique','refus','Tetrapak','pehd','autre','PET_clair','metal','Papier','Carton','carton','PEHD','PET_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130828 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','pet_fonce','papier','mal_croppe','flou','Film_plastique','refus','Tetrapak','pehd','autre','PET_clair','metal','Papier','Carton','carton','PEHD','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130828 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','pet_fonce','papier','mal_croppe','flou','Film_plastique','refus','Tetrapak','pehd','autre','PET_clair','metal','Papier','Carton','carton','PEHD','PET_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21184503,21184493,21184509,21184505,21184496,21184497,21184498,21184499,21184500,21184508,21184502,21184504,21184507?tags=pet_clair,environnement,pet_fonce,papier,mal_croppe,flou,film_plastique,refus,tetrapak,pehd,autre,metal,carton&datou_id_consolidate=4235&port_consolidate=21130828 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 1 /21130828. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.014061212539672852 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.5294055938720703 time spend to save output : 0.014317512512207031 total time spend for step 7 : 2.5437231063842773 step8:final Sat Mar 8 16:22:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341284099: ('0.16142053557190564',), 1341284095: ('0.16142053557190564',)} new output for save of step final : {1341284099: ('0.16142053557190564',), 1341284095: ('0.16142053557190564',)} [1341284099, 1341284095] Looping around the photos to save general results len do output : 2 /1341284099.Didn't retrieve data . /1341284095.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014067411422729492 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11768341064453125 time spend to save output : 0.014388799667358398 total time spend for step 8 : 0.13207221031188965 step9:velours_tree Sat Mar 8 16:22:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21184503,21184493,21184509,21184505,21184496,21184497,21184498,21184499,21184500,21184508,21184502,21184504,21184507 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184503 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184493 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184509 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184505 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184496 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184497 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184498 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184499 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184500 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184508 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184502 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184504 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21184507 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 145 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 0 1 1 3 1 1 0 0 2 5 2 2 5 3 3 1 2 0 3 3 2 2 0 5 4 5 0 0 0 0 2 1 1 5 0 2 5 2 0 4 5 0 1 3 1 1 0 0 2 5 2 5 0 2 5 3 0 3 1 2 0 3 3 5 2 2 0 2 5 0 0 0 0 0 2 1 2 1 0 5 2 2 5 2 5 0 5 0 2 1 4 5 4 1 0 2 5 0 2 5 1 2 5 4 1 5 0 0 0 0 0 1 0 2 0 2 0 4 0 5 0 4 0 0 5 1 0 0 0 4 4 0 5 4 1 3 0 0 0 5 0 0 0 0] Elapsed time: 0.023894548416137695 graph_id used : 82144 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21184503,21184493,21184509,21184505,21184496,21184497,21184498,21184499,21184500,21184508,21184502,21184504,21184507?tags=pet_clair,environnement,pet_fonce,papier,mal_croppe,flou,film_plastique,refus,tetrapak,pehd,autre,metal,carton&datou_id_consolidate=4235&port_consolidate=21130828&tree_id=82144 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 1 /21130828Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015918731689453125 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.522656440734863 time spend to save output : 0.016324996948242188 total time spend for step 9 : 9.538981437683105 step10:send_mail_cod Sat Mar 8 16:23:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf 21184485 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211844851741447381 21184491 imagette211844911741447381 21184487 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211844871741447381 21184478 imagette211844781741447382 21184479 imagette211844791741447382 21184480 imagette211844801741447382 21184481 imagette211844811741447382 21184482 imagette211844821741447382 21184490 change filename to text .imagette211844901741447382 21184484 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211844841741447382 21184486 change filename to text .change filename to text .imagette211844861741447383 21184489 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211844891741447383 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21130828 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21184503,21184493,21184509,21184505,21184496,21184497,21184498,21184499,21184500,21184508,21184502,21184504,21184507?tags=pet_clair,environnement,pet_fonce,papier,mal_croppe,flou,film_plastique,refus,tetrapak,pehd,autre,metal,carton&datou_id_consolidate=4235&port_consolidate=21130828&tree_id=82144 your option no_mail is active, we will not send the real mail to your client args[1341284099] : ((1341284099, -7.224648649613323, 492609224), (1341284099, -0.5103957023319077, 501862349), '0.16142053557190564') We are sending mail with results at cod@fotonower.com args[1341284095] : ((1341284095, -7.24710712875951, 492609224), (1341284095, -0.4949481653801117, 501862349), '0.16142053557190564') We are sending mail with results at cod@fotonower.com refus_total : 0.16142053557190564 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21130828 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21130828','results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf','pdf','','0.15','0.16142053557190564') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015918731689453125 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.748838663101196 time spend to save output : 0.016103506088256836 total time spend for step 10 : 4.764942169189453 step11:split_time_score Sat Mar 8 16:23:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 1), ('14', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06032025 21130828 Nombre de photos uploadées : 2 / 23040 (0%) 06032025 21130828 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 06032025 21130828 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.0002484321594238281 elapsed_time : insert_dashboard_record_day_entry 0.027676105499267578 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2552810083254836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116418_06-03-2025_12_35_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116418 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116418 AND mptpi.`type`=4230 To do Qualite : 0.2971831971307864 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116889_06-03-2025_13_32_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116889 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116889 AND mptpi.`type`=4230 To do Qualite : 0.27268135756742246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116890_07-03-2025_19_55_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116890 AND mptpi.`type`=4230 To do Qualite : 0.27840349976911927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116891_07-03-2025_19_58_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116891 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116891 AND mptpi.`type`=4230 To do Qualite : 0.2656426077944325 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116892_06-03-2025_17_57_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116892 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116892 AND mptpi.`type`=4230 To do Qualite : 0.2541566506702432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21116893_07-03-2025_21_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21116893 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21116893 AND mptpi.`type`=4230 To do Qualite : 0.2487335489167673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21117391_06-03-2025_17_40_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21117391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21117391 AND mptpi.`type`=4230 To do Qualite : 0.19606978781104878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21121258_06-03-2025_19_33_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21121258 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21121258 AND mptpi.`type`=4230 To do Qualite : 0.24433758362757385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21121259_06-03-2025_18_49_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21121259 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21121259 AND mptpi.`type`=4230 To do Qualite : 0.24199178619858192 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21132481_07-03-2025_02_19_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21132481 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21132481 AND mptpi.`type`=4230 To do Qualite : 0.257982925153035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21131708_07-03-2025_01_49_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131708 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131708 AND mptpi.`type`=4230 To do Qualite : 0.2087070242602511 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21131709_07-03-2025_01_24_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131709 AND mptpi.`type`=4230 To do Qualite : 0.2294703936907165 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21131710_07-03-2025_01_36_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131710 AND mptpi.`type`=4230 To do Qualite : 0.20871812148057614 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21131713_07-03-2025_01_17_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131713 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131713 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130819 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130822 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130824 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130825 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130826 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130827 order by id desc limit 1 Qualite : 0.16142053557190564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130828_08-03-2025_16_23_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130828 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130828 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127124 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127125 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127127 order by id desc limit 1 Qualite : 0.20039724120079236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130829_08-03-2025_16_21_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130829 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130829 AND mptpi.`type`=4230 To do Qualite : 0.20731599290291852 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130830_08-03-2025_11_47_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130830 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130830 AND mptpi.`type`=4230 To do Qualite : 0.24827332968621282 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130848_07-03-2025_08_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130848 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130848 AND mptpi.`type`=4230 To do Qualite : 0.1765195505751186 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130878_08-03-2025_11_17_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130878 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127129 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127131 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127132 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127134 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127135 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127137 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127138 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127139 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127141 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127142 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127144 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127145 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127147 order by id desc limit 1 Qualite : 0.24016860385296235 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21127148_06-03-2025_21_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127148 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21127148 AND mptpi.`type`=4230 To do Qualite : 0.24463049736262288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21127150_06-03-2025_21_48_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127150 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21127150 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21127151 order by id desc limit 1 Qualite : 0.18993339750484242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130879_07-03-2025_08_40_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130879 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130879 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129183 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129184 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129185 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129186 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129187 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129188 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129189 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129190 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129191 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129192 order by id desc limit 1 Qualite : 0.19400348214689367 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130880_08-03-2025_11_09_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130880 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130880 AND mptpi.`type`=4230 To do Qualite : 0.21257227382097693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129194_06-03-2025_22_50_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129194 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129195 order by id desc limit 1 Qualite : 0.16554427250971745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129196_06-03-2025_22_20_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129196 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129196 AND mptpi.`type`=4230 To do Qualite : 0.19915115649484433 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130881_07-03-2025_08_17_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130881 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130881 AND mptpi.`type`=4230 To do Qualite : 0.18812192786067572 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130882_07-03-2025_06_48_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130882 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130882 AND mptpi.`type`=4230 To do Qualite : 0.1585246361791784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130883_07-03-2025_07_32_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130883 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130883 AND mptpi.`type`=4230 To do Qualite : 0.22778389165218857 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130884_07-03-2025_07_49_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130884 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130884 AND mptpi.`type`=4230 To do Qualite : 0.27416417556722933 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130885_07-03-2025_06_37_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130885 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130885 AND mptpi.`type`=4230 To do Qualite : 0.20985468611018251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130886_07-03-2025_06_22_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130886 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130886 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129608 order by id desc limit 1 Qualite : 0.22426695870248817 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21129609_07-03-2025_00_02_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21129609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21129609 AND mptpi.`type`=4230 To do Qualite : 0.223398302429255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130887_07-03-2025_04_35_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130887 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130887 AND mptpi.`type`=4230 To do Qualite : 0.1978612239807828 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130888_07-03-2025_05_48_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130888 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130888 AND mptpi.`type`=4230 To do Qualite : 0.23565515903779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130889_07-03-2025_04_49_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130889 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130889 AND mptpi.`type`=4230 To do Qualite : 0.25858088245874145 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130890_07-03-2025_03_53_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130890 AND mptpi.`type`=4230 To do Qualite : 0.23499319745383068 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130891_07-03-2025_03_55_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130891 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130891 AND mptpi.`type`=4230 To do Qualite : 0.22029002069900358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130892_07-03-2025_03_23_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130892 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130892 AND mptpi.`type`=4230 To do Qualite : 0.20728644885268993 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130893_07-03-2025_00_50_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130893 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130893 AND mptpi.`type`=4230 To do Qualite : 0.22354729983925703 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130894_07-03-2025_00_44_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130894 AND mptpi.`type`=4230 To do Qualite : 0.22282342256478435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21130895_07-03-2025_00_36_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21130895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21130895 AND mptpi.`type`=4230 To do Qualite : 0.24537214151833436 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21131716_07-03-2025_01_11_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131716 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131716 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06032025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341284099, 1341284095] Looping around the photos to save general results len do output : 1 /21130828Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284099', None, None, None, None, None, '2646433') ('4234', None, None, None, None, None, None, None, '2646433') ('4234', '21130828', '1341284095', None, None, None, None, None, '2646433') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012953758239746094 save_final save missing photos in datou_result : time spend for datou_step_exec : 33.24319672584534 time spend to save output : 0.013135194778442383 total time spend for step 11 : 33.25633192062378 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 33.95user 24.82system 3:13.37elapsed 30%CPU (0avgtext+0avgdata 2343460maxresident)k 824512inputs+11488outputs (1467major+2167535minor)pagefaults 0swaps